Lessons from BMIR-J2: A test collection for Japanese IR systems

Tsuyoshi Kitani*, Haruo Kimoto, Toshikazu Fukushima, Tetsuya Sakai, Hiroshi Tsuruoka, Yasushi Ogawa, Ikuo Keshi, Kunio Matsui, Takenobu Tokunaga, Hidekazu Nakawatase, Tetsuya Ishikawa, Jun Toyoura, Yoshihiro Ueda, Teru Agata


研究成果: Conference article査読

9 被引用数 (Scopus)


BMIR-J2 is the first complete Japanese test collection available for use in evaluating information retrieval systems. It contains sixty queries and the IDs of 5080 newspaper articles in the fields of economics and engineering. The queries are classified into five categories, based on the functions the system is likely to use to interpret them correctly and retrieve relevant texts. This collection has two levels of relevance, topically relevant and partially relevant. Also discussed are design issues such as collection types and size. This collection and the principles derived in designing it should be helpful in the future development of new test collections.

ジャーナルSIGIR Forum (ACM Special Interest Group on Information Retrieval)
出版ステータスPublished - 1998 12月 1
イベントProceedings of the 1998 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'98) - Melbourne, Vic., Aust
継続期間: 1998 8月 241998 8月 28

ASJC Scopus subject areas

  • 管理情報システム
  • ハードウェアとアーキテクチャ


「Lessons from BMIR-J2: A test collection for Japanese IR systems」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。