A study on object detection method from manga images using CNN

Hideaki Yanagisawa, Takuro Yamashita, Hiroshi Watanabe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Japanese comics (manga) are popular content worldwide. In order to acquire metadata from manga images, techniques automatic recognition of manga content have been studied. Recently, Convolutional Neural Network (CNN) has been applied to object detection in manga images. R-CNN and Fast R-CNN generate region proposals by Selective Search. Faster R-CNN generates them using CNN layers called Region Proposal Network (RPN). Single Shot MultiBox Detector (SSD), the latest detection method, performs object classification and box adjustment for small regions in an image. These methods are effective to natural images. However, it is unclear whether such methods work properly to manga images or not, since those image features are different from natural images. In this paper, we examine the effectiveness of manga object detection by comparing Fast R-CNN, Faster R-CNN, and SSD. Here, manga objects are panel layout, speech balloon, character face, and text. Experimental results show that Fast R-CNN is effective for panel layout and speech balloon, whereas Faster R-CNN is effective for character face and text.

Original languageEnglish
Title of host publication2018 International Workshop on Advanced Image Technology, IWAIT 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-4
Number of pages4
ISBN (Electronic)9781538626153
DOIs
Publication statusPublished - 2018 May 30
Event2018 International Workshop on Advanced Image Technology, IWAIT 2018 - Chiang Mai, Thailand
Duration: 2018 Jan 72018 Jan 9

Publication series

Name2018 International Workshop on Advanced Image Technology, IWAIT 2018

Other

Other2018 International Workshop on Advanced Image Technology, IWAIT 2018
CountryThailand
CityChiang Mai
Period18/1/718/1/9

    Fingerprint

Keywords

  • CNN
  • Fast R-CNN
  • Faster R-CNN
  • Manga
  • Object Detection
  • SSD

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Media Technology

Cite this

Yanagisawa, H., Yamashita, T., & Watanabe, H. (2018). A study on object detection method from manga images using CNN. In 2018 International Workshop on Advanced Image Technology, IWAIT 2018 (pp. 1-4). (2018 International Workshop on Advanced Image Technology, IWAIT 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWAIT.2018.8369633