Mining subtopics from text fragments for a web query

Qinglei Wang, Yanan Qian, Ruihua Song, Zhicheng Dou, Fan Zhang, Tetsuya Sakai, Qinghua Zheng

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

Web search queries are often ambiguous or faceted, and the task of identifying the major underlying senses and facets of queries has received much attention in recent years. We refer to this task as query subtopic mining. In this paper, we propose to use surrounding text of query terms in top retrieved documents to mine subtopics and rank them. We first extract text fragments containing query terms from different parts of documents. Then we group similar text fragments into clusters and generate a readable subtopic for each cluster. Based on the cluster and the language model trained from a query log, we calculate three features and combine them into a relevance score for each subtopic. Subtopics are finally ranked by balancing relevance and novelty. Our evaluation experiments with the NTCIR-9 INTENT Chinese Subtopic Mining test collection show that our method significantly outperforms a query log based method proposed by Radlinski et al. (2010) and a search result clustering based method proposed by Zeng et al. (2004) in terms of precision, I-rec, D-nDCG and D#-nDCG, the official evaluation metrics used at the NTCIR-9 INTENT task. Moreover, our generated subtopics are significantly more readable than those generated by the search result clustering method.

Original languageEnglish
Pages (from-to)484-503
Number of pages20
JournalInformation Retrieval
Volume16
Issue number4
DOIs
Publication statusPublished - 2013 Feb 27

Keywords

  • Intent mining
  • Intents ranking
  • Query intent

ASJC Scopus subject areas

  • Information Systems
  • Library and Information Sciences

Fingerprint Dive into the research topics of 'Mining subtopics from text fragments for a web query'. Together they form a unique fingerprint.

  • Cite this

    Wang, Q., Qian, Y., Song, R., Dou, Z., Zhang, F., Sakai, T., & Zheng, Q. (2013). Mining subtopics from text fragments for a web query. Information Retrieval, 16(4), 484-503. https://doi.org/10.1007/s10791-013-9221-8