Topic set size design and power analysis in practice

    研究成果: Conference contribution

    5 被引用数 (Scopus)

    抄録

    Topic set size design methods provide principles and procedures for test collection builders to decide on the number of topics to create. These methods can then help us keep improving the test collection design based on accumulated data. Simple Excel tools are available for such purposes. Post-hoc power analysis tools, available as simple R scripts, can help IR researchers examine the achieved power of a reported experiment and determine future sample sizes for ensuring high power. Thus, for example, underpowered user experiments can be detected, and a larger sample size can be proposed. If used appropriately, these Excel and R tools should be able to provide the IR community with better experimentation practices. The main objective of this tutorial is to let IR researchers familiarise themselves with these tools and understand the basic ideas behind them.

    本文言語English
    ホスト出版物のタイトルICTIR 2016 - Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval
    出版社Association for Computing Machinery, Inc
    ページ9-10
    ページ数2
    ISBN(電子版)9781450344975
    DOI
    出版ステータスPublished - 2016 9 12
    イベント2016 ACM International Conference on the Theory of Information Retrieval, ICTIR 2016 - Newark, United States
    継続期間: 2016 9 122016 9 16

    Other

    Other2016 ACM International Conference on the Theory of Information Retrieval, ICTIR 2016
    CountryUnited States
    CityNewark
    Period16/9/1216/9/16

    ASJC Scopus subject areas

    • Information Systems
    • Computer Science (miscellaneous)

    フィンガープリント 「Topic set size design and power analysis in practice」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

    引用スタイル