Automatic evaluation of iconic image retrieval based on colour, shape, and texture

Riku Togashi, Sumio Fujita, Tetsuya Sakai

研究成果: Conference contribution

抜粋

Product image search is required to deal with large target image datasets which are frequently updated, and therefore it is not always practical to maintain exhaustive and up-to-date relevance assessments for tuning and evaluating the search engine. Moreover, in similar product image search where the query is also an image, it is difficult to identify the possible search intents behind it and thereby verbalise the relevance criteria for the assessors, especially if graded relevance assessments are required. In this study, we focus on similar product image search within a given product category (e.g., shoes), wherein each image is iconic (i.e., the image clearly shows what the product looks like and basically nothing else), and propose an initial approach to evaluating the task without relying on manual relevance assessments. More specifically, we build a simple probabilistic model that assumes that an image is generated from latent intents representing shape, texture, and colour, which enables us to estimate the relevance score of each image and thereby compute graded relevance measures for any image search engine result page. Through large-scale crowdsourcing experiments, we demonstrate that our proposed measures, InDCG (which is based on per-intent binary relevance) and D-InDCG (which is based on per-intent graded relevance), align reasonably well with human SERP preferences and with human image preferences. Hence, our automatic measures may be useful at least for rough tuning and evaluation of similar product image search.

元の言語English
ホスト出版物のタイトルICMR 2020 - Proceedings of the 2020 International Conference on Multimedia Retrieval
出版者Association for Computing Machinery, Inc
ページ346-354
ページ数9
ISBN(電子版)9781450370875
DOI
出版物ステータスPublished - 2020 6 8
イベント10th ACM International Conference on Multimedia Retrieval, ICMR 2020 - Dublin, Ireland
継続期間: 2020 6 82020 6 11

出版物シリーズ

名前ICMR 2020 - Proceedings of the 2020 International Conference on Multimedia Retrieval

Conference

Conference10th ACM International Conference on Multimedia Retrieval, ICMR 2020
Ireland
Dublin
期間20/6/820/6/11

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Computer Graphics and Computer-Aided Design

フィンガープリント Automatic evaluation of iconic image retrieval based on colour, shape, and texture' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Togashi, R., Fujita, S., & Sakai, T. (2020). Automatic evaluation of iconic image retrieval based on colour, shape, and texture. : ICMR 2020 - Proceedings of the 2020 International Conference on Multimedia Retrieval (pp. 346-354). (ICMR 2020 - Proceedings of the 2020 International Conference on Multimedia Retrieval). Association for Computing Machinery, Inc. https://doi.org/10.1145/3372278.3390741