Average Gain Ratio: A Simple Retrieval Performance Measure for Evaluation with Multiple Relevance Levels

Research output: Contribution to journalConference article

11 Citations (Scopus)

Abstract

Average gain ratio which is based on the idea of cumulative gain and is used for evaluation with multiple relevance levels, is proposed. Cumulative gain assumes that an imaginary user scans the ranked output from the top, and 'gains' an additional score each time he finds a relevant document. Average gain ratio was proposed as a modification of weighted average precision. The results show that average gain ratio is more suitable for averaging across topics and is more robust to the variation in the number of relevant documents at each relevance level.

Original languageEnglish
Pages (from-to)417-418
Number of pages2
JournalSIGIR Forum (ACM Special Interest Group on Information Retrieval)
Issue numberSPEC. ISS.
Publication statusPublished - 2003 Dec 1
EventProceedings of the Twenty-Sixth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2003 - Toronto, Ont., Canada
Duration: 2003 Jul 282003 Aug 1

Keywords

  • Average Gain Ratio
  • Retrieval Performance

ASJC Scopus subject areas

  • Management Information Systems
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Average Gain Ratio: A Simple Retrieval Performance Measure for Evaluation with Multiple Relevance Levels'. Together they form a unique fingerprint.

  • Cite this