抄録
Topic set size design methods provide principles and procedures for test collection builders to decide on the number of topics to create. These methods can then help us keep improving the test collection design based on accumulated data. Simple Excel tools are available for such purposes. Post-hoc power analysis tools, available as simple R scripts, can help IR researchers examine the achieved power of a reported experiment and determine future sample sizes for ensuring high power. Thus, for example, underpowered user experiments can be detected, and a larger sample size can be proposed. If used appropriately, these Excel and R tools should be able to provide the IR community with better experimentation practices. The main objective of this tutorial is to let IR researchers familiarise themselves with these tools and understand the basic ideas behind them.
本文言語 | English |
---|---|
ホスト出版物のタイトル | ICTIR 2016 - Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval |
出版社 | Association for Computing Machinery, Inc |
ページ | 9-10 |
ページ数 | 2 |
ISBN(電子版) | 9781450344975 |
DOI | |
出版ステータス | Published - 2016 9月 12 |
イベント | 2016 ACM International Conference on the Theory of Information Retrieval, ICTIR 2016 - Newark, United States 継続期間: 2016 9月 12 → 2016 9月 16 |
Other
Other | 2016 ACM International Conference on the Theory of Information Retrieval, ICTIR 2016 |
---|---|
国/地域 | United States |
City | Newark |
Period | 16/9/12 → 16/9/16 |
ASJC Scopus subject areas
- 情報システム
- コンピュータ サイエンス(その他)