Click the search button and be happy: Evaluating direct and immediate information access

Tetsuya Sakai, Makoto P. Kato, Young In Song

研究成果: Conference contribution

15 被引用数 (Scopus)

抄録

We define Direct Information Access as a type of information access where there is no user operation such as clicking or scrolling between the user's click on the search button and the user's information acquisition; we define Immediate Information Access as a type of information access where the user can locate the relevant information within the system output very quickly. Hence, a Direct and Immediate Information Access (DIIA) system is expected to satisfy the user's information need very quickly with its very first response. We propose a nugget-based evaluation framework for DIIA, which takes nugget positions into account in order to evaluate the ability of a system to present important nuggets first and to minimise the amount of text the user has to read. To demonstrate the integrity, usefulness and limitations of our framework, we built a Japanese DIIA test collection with 60 queries and over 2,800 nuggets as well as an offset-based nugget match evaluation interface, and conducted experiments with manual and automatic runs. The results suggest our proposal is a useful complement to traditional ranked retrieval evaluation based on document relevance.

本文言語English
ホスト出版物のタイトルCIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management
ページ621-630
ページ数10
DOI
出版ステータスPublished - 2011 12 13
外部発表はい
イベント20th ACM Conference on Information and Knowledge Management, CIKM'11 - Glasgow, United Kingdom
継続期間: 2011 10 242011 10 28

出版物シリーズ

名前International Conference on Information and Knowledge Management, Proceedings

Conference

Conference20th ACM Conference on Information and Knowledge Management, CIKM'11
CountryUnited Kingdom
CityGlasgow
Period11/10/2411/10/28

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Business, Management and Accounting(all)

フィンガープリント 「Click the search button and be happy: Evaluating direct and immediate information access」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル