On labelling intent types for evaluating search result diversification

Tetsuya Sakai, Young In Song

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Search result diversification is important for accommodating different user needs by means of covering popular and diverse query intents within a single result page. To evaluate diversity, we believe that it is important to consider the distinction between informational and navigational intents, as users would not want redundant information especially for navigational intents. In this study, we conduct intent type-sensitive diversity evaluation based on both top-down labelling, which labels each intent as either navigational or informational a priori, and bottom-up labelling, which labels each intent based on whether a "navigational relevant" document has actually been identified in the document collection. Our results suggest that reliable type-sensitive diversity evaluation can be conducted using the top-down approach with a clear intent labelling guideline, while ensuring that the desired URLs for navigational intents make their way into relevance assessments.

Original languageEnglish
Title of host publicationInformation Retrieval Technology - 9th Asia Information Retrieval Societies Conference, AIRS 2013, Proceedings
Pages38-49
Number of pages12
DOIs
Publication statusPublished - 2013 Dec 1
Event9th Asia Information Retrieval Societies Conference on Information Retrieval Technology, AIRS 2013 - Singapore, Singapore
Duration: 2013 Dec 92013 Dec 11

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8281 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference9th Asia Information Retrieval Societies Conference on Information Retrieval Technology, AIRS 2013
CountrySingapore
CitySingapore
Period13/12/913/12/11

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'On labelling intent types for evaluating search result diversification'. Together they form a unique fingerprint.

  • Cite this

    Sakai, T., & Song, Y. I. (2013). On labelling intent types for evaluating search result diversification. In Information Retrieval Technology - 9th Asia Information Retrieval Societies Conference, AIRS 2013, Proceedings (pp. 38-49). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8281 LNCS). https://doi.org/10.1007/978-3-642-45068-6_4