Metrics, statistics, tests

研究成果: Conference contribution

29 被引用数 (Scopus)

抄録

This lecture is intended to serve as an introduction to Information Retrieval (IR) effectiveness metrics and their usage in IR experiments using test collections. Evaluation metrics are important because they are inexpensive tools for monitoring technological advances. This lecture covers a wide variety of IR metrics (except for those designed for XML retrieval, as there is a separature lecture dedicated to this topic) and discusses some methods for evaluating evaluation metrics. It also briefly covers computer-based statistical significance testing. The takeaways for IR experimenters are: (1) It is important to understand the properties of IR metrics and choose or design appropriate ones for the task at hand; (2) Computer-based statistical significance tests are simple and useful, although statistical significance does not necessarily imply practical significance, and statistical insignificance does not necessarily imply practical insignificance; and (3) Several methods exist for discussing which metrics are "good," although none of them is perfect.

本文言語English
ホスト出版物のタイトルBridging Between Information Retrieval and Databases - PROMISE Winter School 2013, Revised Tutorial Lectures
出版社Springer Verlag
ページ116-163
ページ数48
ISBN(印刷版)9783642547973
DOI
出版ステータスPublished - 2014 1 1
イベント2013 PROMISE Winter School: Bridging Between Information Retrieval and Databases - Bressanone, Italy
継続期間: 2013 2 42013 2 8

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
8173 LNCS
ISSN(印刷版)0302-9743
ISSN(電子版)1611-3349

Conference

Conference2013 PROMISE Winter School: Bridging Between Information Retrieval and Databases
CountryItaly
CityBressanone
Period13/2/413/2/8

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

フィンガープリント 「Metrics, statistics, tests」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル