Ranking the NTCIR systems based on multigrade relevance

Tetsuya Sakai*

*この研究の対応する著者

研究成果: Conference article査読

11 被引用数 (Scopus)

抄録

At NTCIR-4, new retrieval effectiveness metrics called Q-measure and R-measure were proposed for evaluation based on multigrade relevance. This paper shows that Q-measure inherits both the reliability of noninterpolated Average Precision and the multigrade relevance capability of Average Weighted Precision through a theoretical analysis, and then verify the above claim through experiments by actually ranking the systems submitted to the NTCIR-3 CLIR Task. Our experiments confirm that the Q-measure ranking is very highly correlated with the Average Precision ranking and that it is more reliable than Average Weighted Precision.

本文言語English
ページ(範囲)251-262
ページ数12
ジャーナルLECTURE NOTES IN COMPUTER SCIENCE
3411
DOI
出版ステータスPublished - 2005
外部発表はい
イベントAsia Information Retrieval Symposium, AIRS 2004 - Beijing, China
継続期間: 2004 10月 182004 10月 20

ASJC Scopus subject areas

  • 理論的コンピュータサイエンス
  • コンピュータ サイエンス(全般)

フィンガープリント

「Ranking the NTCIR systems based on multigrade relevance」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル