Holistic feature extraction for automatic image annotation

Supheakmungkol Sarin, Michael Fahrmair, Matthias Wagner, Wataru Kameyama

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Automating the annotation process of digital images is a crucial step towards efficient and effective management of this increasingly high volume of content. It is, nevertheless, an extremely challenging task for the research community. One of the main bottle necks is the lack of integrity and diversity of features. We solve this problem by proposing to utilize 43 image features that cover the holistic content of the image from global to subject, background, and scene. In our approach, saliency regions and background are separated without prior knowledge. Each of them together with the whole image is treated independently for feature extraction. Extensive experiments were designed to show the efficiency and effectiveness of our approach. We chose two publicly available datasets manually annotated and with the diverse nature of images for our experiments, namely, the Corel5k and ESP Game datasets. They contain 5,000 images with 260 keywords and 20,770 images with 268 keywords, respectively. Through empirical experiments, it is confirmed that by using our features with the state-of-the-art technique, we achieve superior performance in many metrics, particularly in auto-annotation.

Original languageEnglish
Title of host publicationProceedings of the 2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011
Pages59-66
Number of pages8
DOIs
Publication statusPublished - 2011 Sep 14
Event2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011 - Loutraki, Greece
Duration: 2011 Jun 282011 Jun 30

Publication series

NameProceedings of the 2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011

Conference

Conference2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011
CountryGreece
CityLoutraki
Period11/6/2811/6/30

Keywords

  • Automatic image annotation
  • Background
  • Holistic feature extraction
  • K nearest neighbours
  • Saliency regions

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Holistic feature extraction for automatic image annotation'. Together they form a unique fingerprint.

  • Cite this

    Sarin, S., Fahrmair, M., Wagner, M., & Kameyama, W. (2011). Holistic feature extraction for automatic image annotation. In Proceedings of the 2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011 (pp. 59-66). [5992172] (Proceedings of the 2011 5th FTRA International Conference on Multimedia and Ubiquitous Engineering, MUE 2011). https://doi.org/10.1109/MUE.2011.22