Towards Automatic Evaluation of Reused Answers in Community Question Answering

Hsin Wen Liu*, Sumio Fujita, Tetsuya Sakai

*この研究の対応する著者

研究成果: Conference contribution

抄録

We consider the problem of reused answer retrieval for community question answering (CQA): given a question q, retrieve answers (Formula presented) posted in response to other questions qi(≠ q), where (Formula presented) serves as an answer to q. While previous work evaluated this task by manually annotating the relationship between q and (Formula presented), this approach does not scale for large-scale CQA sites. We therefore explore an automatic evaluation method for reused answer retrieval, which computes nDCG by defining the gain value of each retrieved answer as a ROUGE score that treats the original answers to q as gold summaries. Our answer retrieval experiment suggests that effective reused answer retrieval systems may not be the same as effective gold answer retrieval systems. We provide case studies to discuss the benefits and limitations of our approach.

本文言語English
ホスト出版物のタイトルInformation Retrieval Technology - 15th Asia Information Retrieval Societies Conference, AIRS 2019, Proceedings
編集者Fu Lee Wang, Haoran Xie, Wai Lam, Aixin Sun, Lun-Wei Ku, Tianyong Hao, Wei Chen, Tak-Lam Wong, Xiaohui Tao
出版社Springer
ページ3-9
ページ数7
ISBN(印刷版)9783030428341
DOI
出版ステータスPublished - 2020
イベント15th Asia Information Retrieval Societies Conference, AIRS 2019 - Kowloon, Hong Kong
継続期間: 2019 11 72019 11 9

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
12004 LNCS
ISSN(印刷版)0302-9743
ISSN(電子版)1611-3349

Conference

Conference15th Asia Information Retrieval Societies Conference, AIRS 2019
国/地域Hong Kong
CityKowloon
Period19/11/719/11/9

ASJC Scopus subject areas

  • 理論的コンピュータサイエンス
  • コンピュータ サイエンス(全般)

フィンガープリント

「Towards Automatic Evaluation of Reused Answers in Community Question Answering」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル