Average Gain Ratio: A Simple Retrieval Performance Measure for Evaluation with Multiple Relevance Levels

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

Average gain ratio which is based on the idea of cumulative gain and is used for evaluation with multiple relevance levels, is proposed. Cumulative gain assumes that an imaginary user scans the ranked output from the top, and 'gains' an additional score each time he finds a relevant document. Average gain ratio was proposed as a modification of weighted average precision. The results show that average gain ratio is more suitable for averaging across topics and is more robust to the variation in the number of relevant documents at each relevance level.

Original languageEnglish
Pages (from-to)417-418
Number of pages2
JournalSIGIR Forum (ACM Special Interest Group on Information Retrieval)
Issue numberSPEC. ISS.
Publication statusPublished - 2003
Externally publishedYes

    Fingerprint

Keywords

  • Average Gain Ratio
  • Retrieval Performance

ASJC Scopus subject areas

  • Hardware and Architecture
  • Management Information Systems

Cite this