New assessment criteria for query suggestion

Zhongrui Ma, Yu Chen, Ruihua Song, Tetsuya Sakai, Jiaheng Lu, Ji Rong Wen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Query suggestion is a useful tool to help users express their information needs by supplying alternative queries. When evaluating the effectiveness of query suggestion algorithms, many previous studies focus on measuring whether a suggestion query is relevant or not to the input query. This assessment criterion is too simple to describe users' requirements. In this paper, we introduce two scenarios of query suggestion. The first scenario represents cases where the search result of the input query is unsatisfactory. The second scenario represents cases where the search result is satisfactory but the user may be looking for alternative solutions. Based on the two scenarios, we propose two assessment criteria. Our labeling results indicate that the new assessment criteria provide finer distinctions among query suggestions than the traditional relevance-based criterion.

Original languageEnglish
Title of host publicationSIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval
Pages1109-1110
Number of pages2
DOIs
Publication statusPublished - 2012
Externally publishedYes
Event35th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2012 - Portland, OR
Duration: 2012 Aug 122012 Aug 16

Other

Other35th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2012
CityPortland, OR
Period12/8/1212/8/16

Fingerprint

Labeling

Keywords

  • assessment criteria
  • query suggestion

ASJC Scopus subject areas

  • Information Systems

Cite this

Ma, Z., Chen, Y., Song, R., Sakai, T., Lu, J., & Wen, J. R. (2012). New assessment criteria for query suggestion. In SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1109-1110) https://doi.org/10.1145/2348283.2348493

New assessment criteria for query suggestion. / Ma, Zhongrui; Chen, Yu; Song, Ruihua; Sakai, Tetsuya; Lu, Jiaheng; Wen, Ji Rong.

SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. 2012. p. 1109-1110.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ma, Z, Chen, Y, Song, R, Sakai, T, Lu, J & Wen, JR 2012, New assessment criteria for query suggestion. in SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. pp. 1109-1110, 35th Annual ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2012, Portland, OR, 12/8/12. https://doi.org/10.1145/2348283.2348493
Ma Z, Chen Y, Song R, Sakai T, Lu J, Wen JR. New assessment criteria for query suggestion. In SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. 2012. p. 1109-1110 https://doi.org/10.1145/2348283.2348493
Ma, Zhongrui ; Chen, Yu ; Song, Ruihua ; Sakai, Tetsuya ; Lu, Jiaheng ; Wen, Ji Rong. / New assessment criteria for query suggestion. SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. 2012. pp. 1109-1110
@inproceedings{a0e507dbe6504edabaf921df4e5a3db2,
title = "New assessment criteria for query suggestion",
abstract = "Query suggestion is a useful tool to help users express their information needs by supplying alternative queries. When evaluating the effectiveness of query suggestion algorithms, many previous studies focus on measuring whether a suggestion query is relevant or not to the input query. This assessment criterion is too simple to describe users' requirements. In this paper, we introduce two scenarios of query suggestion. The first scenario represents cases where the search result of the input query is unsatisfactory. The second scenario represents cases where the search result is satisfactory but the user may be looking for alternative solutions. Based on the two scenarios, we propose two assessment criteria. Our labeling results indicate that the new assessment criteria provide finer distinctions among query suggestions than the traditional relevance-based criterion.",
keywords = "assessment criteria, query suggestion",
author = "Zhongrui Ma and Yu Chen and Ruihua Song and Tetsuya Sakai and Jiaheng Lu and Wen, {Ji Rong}",
year = "2012",
doi = "10.1145/2348283.2348493",
language = "English",
isbn = "9781450316583",
pages = "1109--1110",
booktitle = "SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval",

}

TY - GEN

T1 - New assessment criteria for query suggestion

AU - Ma, Zhongrui

AU - Chen, Yu

AU - Song, Ruihua

AU - Sakai, Tetsuya

AU - Lu, Jiaheng

AU - Wen, Ji Rong

PY - 2012

Y1 - 2012

N2 - Query suggestion is a useful tool to help users express their information needs by supplying alternative queries. When evaluating the effectiveness of query suggestion algorithms, many previous studies focus on measuring whether a suggestion query is relevant or not to the input query. This assessment criterion is too simple to describe users' requirements. In this paper, we introduce two scenarios of query suggestion. The first scenario represents cases where the search result of the input query is unsatisfactory. The second scenario represents cases where the search result is satisfactory but the user may be looking for alternative solutions. Based on the two scenarios, we propose two assessment criteria. Our labeling results indicate that the new assessment criteria provide finer distinctions among query suggestions than the traditional relevance-based criterion.

AB - Query suggestion is a useful tool to help users express their information needs by supplying alternative queries. When evaluating the effectiveness of query suggestion algorithms, many previous studies focus on measuring whether a suggestion query is relevant or not to the input query. This assessment criterion is too simple to describe users' requirements. In this paper, we introduce two scenarios of query suggestion. The first scenario represents cases where the search result of the input query is unsatisfactory. The second scenario represents cases where the search result is satisfactory but the user may be looking for alternative solutions. Based on the two scenarios, we propose two assessment criteria. Our labeling results indicate that the new assessment criteria provide finer distinctions among query suggestions than the traditional relevance-based criterion.

KW - assessment criteria

KW - query suggestion

UR - http://www.scopus.com/inward/record.url?scp=84866628706&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84866628706&partnerID=8YFLogxK

U2 - 10.1145/2348283.2348493

DO - 10.1145/2348283.2348493

M3 - Conference contribution

AN - SCOPUS:84866628706

SN - 9781450316583

SP - 1109

EP - 1110

BT - SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval

ER -