TY - GEN
T1 - Supporting content evaluation of student summaries by idea unit embedding
AU - Gecchele, Marcello
AU - Yamada, Hiroaki
AU - Tokunaga, Takenobu
AU - Sawaki, Yasuyo
N1 - Publisher Copyright:
© BEA 2019.All right reserved.
PY - 2019
Y1 - 2019
N2 - This paper discusses the computer-assisted content evaluation of summaries. We propose a method to make a correspondence between the segments of the source text and its summary. As a unit of the segment, we adopt "Idea Unit (IU)" which is proposed in Applied Linguistics. Introducing IUs enables us to make a correspondence even for the sentences that contain multiple ideas. The IU correspondence is made based on the similarity between vector representations of IU. An evaluation experiment with two source texts and 20 summaries showed that the proposed method is more robust against rephrased expressions than the conventional ROUGEbased baselines. Also, the proposed method outperformed the baselines in recall. We implemented the proposed method in a GUI tool "Segment Matcher" that aids teachers to establish a link between corresponding IUs across the summary and source text.
AB - This paper discusses the computer-assisted content evaluation of summaries. We propose a method to make a correspondence between the segments of the source text and its summary. As a unit of the segment, we adopt "Idea Unit (IU)" which is proposed in Applied Linguistics. Introducing IUs enables us to make a correspondence even for the sentences that contain multiple ideas. The IU correspondence is made based on the similarity between vector representations of IU. An evaluation experiment with two source texts and 20 summaries showed that the proposed method is more robust against rephrased expressions than the conventional ROUGEbased baselines. Also, the proposed method outperformed the baselines in recall. We implemented the proposed method in a GUI tool "Segment Matcher" that aids teachers to establish a link between corresponding IUs across the summary and source text.
UR - http://www.scopus.com/inward/record.url?scp=85121013517&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85121013517&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85121013517
T3 - ACL 2019 - Innovative Use of NLP for Building Educational Applications, BEA 2019 - Proceedings of the 14th Workshop
SP - 343
EP - 348
BT - ACL 2019 - Innovative Use of NLP for Building Educational Applications, BEA 2019 - Proceedings of the 14th Workshop
PB - Association for Computational Linguistics (ACL)
T2 - 14th Workshop on Innovative Use of NLP for Building Educational Applications, BEA 2019, collocated with ACL 2019
Y2 - 2 August 2019
ER -
