Towards zero-click mobile IR evaluation: Knowing what and knowing when

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this poster, we propose two evaluation tasks for mobile information access. The first task evaluates the system's ability to guess what the user's query should be given a context ("Knowing What"). The second task evaluates the system's ability to decide when to proactively deploy a given query ("Knowing When"). We conduct a preliminary manual analysis of a mobile query log to limit the space of possible queries so as to design feasible and practical evaluation tasks.

Original languageEnglish
Title of host publicationSIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval
Pages1157-1158
Number of pages2
DOIs
Publication statusPublished - 2012
Externally publishedYes
Event35th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2012 - Portland, OR
Duration: 2012 Aug 122012 Aug 16

Other

Other35th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2012
CityPortland, OR
Period12/8/1212/8/16

Keywords

  • evaluation
  • metric
  • mobile
  • query log
  • test collection

ASJC Scopus subject areas

  • Information Systems

Cite this

Sakai, T. (2012). Towards zero-click mobile IR evaluation: Knowing what and knowing when. In SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1157-1158) https://doi.org/10.1145/2348283.2348517