Automatic paper summary generation from visual and textual information

Shintaro Yamamoto, Yoshihiro Fukuhara, Ryota Suzuki, Shigeo Morishima, Hirokatsu Kataoka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Due to the recent boom in artificial intelligence (AI) research, including computer vision (CV), it has become impossible for researchers in these fields to keep up with the exponentially increasing number of manuscripts. In response to this situation, this paper proposes the paper summary generation (PSG) task using a simple but effective method to automatically generate an academic paper summary from raw PDF data. We realized PSG by combination of vision-based supervised components detector and language-based unsupervised important sentence extractor, which is applicable for a trained format of manuscripts. We show the quantitative evaluation of ability of simple vision-based components extraction, and the qualitative evaluation that our system can extract both visual item and sentence that are helpful for understanding. After processing via our PSG, the 979 manuscripts accepted by the Conference on Computer Vision and Pattern Recognition (CVPR) 2018 are available1. It is believed that the proposed method will provide a better way for researchers to stay caught with important academic papers.

Original languageEnglish
Title of host publicationEleventh International Conference on Machine Vision, ICMV 2018
EditorsAntanas Verikas, Dmitry P. Nikolaev, Petia Radeva, Jianhong Zhou
PublisherSPIE
ISBN (Electronic)9781510627482
DOIs
Publication statusPublished - 2019 Jan 1
Event11th International Conference on Machine Vision, ICMV 2018 - Munich, Germany
Duration: 2018 Nov 12018 Nov 3

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11041
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference11th International Conference on Machine Vision, ICMV 2018
CountryGermany
CityMunich
Period18/11/118/11/3

Keywords

  • Document Analysis
  • Paper Summarization
  • Vision and Language

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Automatic paper summary generation from visual and textual information'. Together they form a unique fingerprint.

  • Cite this

    Yamamoto, S., Fukuhara, Y., Suzuki, R., Morishima, S., & Kataoka, H. (2019). Automatic paper summary generation from visual and textual information. In A. Verikas, D. P. Nikolaev, P. Radeva, & J. Zhou (Eds.), Eleventh International Conference on Machine Vision, ICMV 2018 [110410U] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 11041). SPIE. https://doi.org/10.1117/12.2522789