Affective and holistic approach at TRECVID 2010 task - Semantic Indexing (SIN)

Kok Meng Ong, Supheakmungkol Sarin, Wataru Kameyama

Research output: Contribution to conferencePaper

1 Citation (Scopus)

Abstract

This paper reports our experiments for TRECVID 2010 task: Semantic Indexing. We present two approaches namely, Affective and Holistic. In the first approach, we have used combination of affective features from image, video and audio trained with neural network algorithm. Image features employed are color histogram and face detection from the keyframe. The number of face is also used in one of the runs. Video features include the motion activity and shot duration. Additionally, the audio power is included as feature. For the second approach, color, texture and scene features are extracted from the whole keyframe image as well as its background and saliency regions. Genetic algorithm is used to find the weight of each feature for effective combination. Then, KNN is used to propagate the annotation. We have submitted 4 runs where we distinguish the first two as affective category and the the last two as holistic ones. The summary is as follows: • kmlabGITS1-color histogram, motion, rhythm, sound and face number trained using neural network • kmlabGITS2-color histogram, motion, rhythm, sound and without face number trained using neural network • kmlabGITS3-combination of 5 image features (hsv bg, gabor, haar, gist and lab bg) using Genetic Algorithm and KNN • kmlabGITS4-combination of 5 image features (hsv, hsv bg, haar, haar roi and gist) using Genetic Algorithm and KNN.

Original languageEnglish
Publication statusPublished - 2010 Jan 1
EventTREC Video Retrieval Evaluation, TRECVID 2010 - Gaithersburg, MD, United States
Duration: 2010 Nov 152010 Nov 17

Conference

ConferenceTREC Video Retrieval Evaluation, TRECVID 2010
CountryUnited States
CityGaithersburg, MD
Period10/11/1510/11/17

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'Affective and holistic approach at TRECVID 2010 task - Semantic Indexing (SIN)'. Together they form a unique fingerprint.

  • Cite this

    Ong, K. M., Sarin, S., & Kameyama, W. (2010). Affective and holistic approach at TRECVID 2010 task - Semantic Indexing (SIN). Paper presented at TREC Video Retrieval Evaluation, TRECVID 2010, Gaithersburg, MD, United States.