Evaluating Image-Inspired Poetry Generation

Chao Chung Wu, Ruihua Song, Tetsuya Sakai, Wen Feng Cheng, Xing Xie, Shou De Lin

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

Creative natural language generation, such as poetry generation, writing lyrics, and storytelling, is appealing but difficult to evaluate. We take the application of image-inspired poetry generation as a showcase and investigate two problems in evaluation: (1) how to evaluate the generated text when there are no ground truths, and (2) how to evaluate nondeterministic systems that output different texts given the same input image. Regarding the first problem, we first design a judgment tool to collect ratings of a few poems for comparison with the inspiring image shown to assessors. We then propose a novelty measurement that quantifies how different a generated text is compared to a known corpus. Regarding the second problem, we experiment with different strategies to approximate evaluating multiple trials of output poems. We also use a measure for quantifying the diversity of different texts generated in response to the same input image, and discuss their merits.

本文言語English
ホスト出版物のタイトルNatural Language Processing and Chinese Computing - 8th CCF International Conference, NLPCC 2019, Proceedings
編集者Jie Tang, Min-Yen Kan, Dongyan Zhao, Sujian Li, Hongying Zan
出版社Springer
ページ539-551
ページ数13
ISBN(印刷版)9783030322328
DOI
出版ステータスPublished - 2019
イベント8th CCF International Conference on Natural Language Processing and Chinese Computing, NLPCC 2019 - Dunhuang, China
継続期間: 2019 10 92019 10 14

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
11838 LNAI
ISSN(印刷版)0302-9743
ISSN(電子版)1611-3349

Conference

Conference8th CCF International Conference on Natural Language Processing and Chinese Computing, NLPCC 2019
CountryChina
CityDunhuang
Period19/10/919/10/14

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

フィンガープリント 「Evaluating Image-Inspired Poetry Generation」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル