Comprehending Research Article in Minutes: A User Study of Reading Computer Generated Summary for Young Researchers

Shintaro Yamamoto*, Ryota Suzuki, Hitokatsu Kataoka, Shigeo Morishima

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The automatic summarization of scientific papers, to assist researchers in conducting literature surveys, has garnered significant attention because of the rapid increase in the number of scientific articles published each year. However, whether and how these summaries actually help readers in comprehending scientific papers has not been examined yet. In this work, we study the effectiveness of automatically generated summaries of scientific papers for students who do not have sufficient knowledge in research. We asked six students, enrolled in bachelor’s and master’s programs in Japan, to prepare a presentation on a scientific paper by providing them either the article alone, or the article and its summary generated by an automatic summarization system, after 15 min of reading time. The comprehension of an article was judged by four evaluators based on the participant’s presentation. The experimental results show that the completeness of the comprehension of the four participants was higher overall when the summary of the paper was provided. In addition, four participants, including the two whose completeness score reduced when the summary was provided, mentioned that the summary is helpful to comprehend a research article within a limited time span.

Original languageEnglish
Title of host publicationHuman Interface and the Management of Information. Information Presentation and Visualization - Thematic Area, HIMI 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Proceedings
EditorsSakae Yamamoto, Hirohiko Mori
PublisherSpringer Science and Business Media Deutschland GmbH
Pages101-112
Number of pages12
ISBN (Print)9783030783204
DOIs
Publication statusPublished - 2021
EventThematic area Human Interface and the Management of Information, HIMI 2021 Held as Part of the 23rd HCI International Conference, HCII 2021 - Virtual, Online
Duration: 2021 Jul 242021 Jul 29

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12765 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceThematic area Human Interface and the Management of Information, HIMI 2021 Held as Part of the 23rd HCI International Conference, HCII 2021
CityVirtual, Online
Period21/7/2421/7/29

Keywords

  • Scientific paper comprehension
  • Scientific paper summarization
  • User study

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Comprehending Research Article in Minutes: A User Study of Reading Computer Generated Summary for Young Researchers'. Together they form a unique fingerprint.

Cite this