Exploiting the cognitive synergy between different media modalities in multimodal information retrieval

Zhongfei Zhang, Ruofei Zhang, Jun Ohya

研究成果: Conference contribution

5 被引用数 (Scopus)

抄録

This is a position paper reporting an on-going collaboration project between SUNY Binghamton, USA, and Waseda University, Japan, on multimodal information retrieval through exploiting the cognitive synergy across the different modalities of the information to facilitate an effective retrieval. Specifically we focus on image retrieval in the applications where imagery data appear along with collateral text. It is noted that these applications are ubiquitous. We have proposed the Synergistic Indexing Scheme (SIS) to explicitly exploit the synergy between the information of imagery and text modalities. Since the synergy we have exploited between the information of imagery and text modalities is subjective and depends on specific cognitive context, we call this type of synergy as cognitive synergy. We have reported part of the empirical evaluation and are in the process to fully implement the SIS prototype for an extensive evaluation.

本文言語English
ホスト出版物のタイトル2004 IEEE International Conference on Multimedia and Expo (ICME)
ページ2227-2230
ページ数4
出版ステータスPublished - 2004 12 1
イベント2004 IEEE International Conference on Multimedia and Expo (ICME) - Taipei, Taiwan, Province of China
継続期間: 2004 6 272004 6 30

出版物シリーズ

名前2004 IEEE International Conference on Multimedia and Expo (ICME)
3

Conference

Conference2004 IEEE International Conference on Multimedia and Expo (ICME)
国/地域Taiwan, Province of China
CityTaipei
Period04/6/2704/6/30

ASJC Scopus subject areas

  • 工学(全般)

フィンガープリント

「Exploiting the cognitive synergy between different media modalities in multimodal information retrieval」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル