A study on caption recognition for multi-color characters on complex background

Yutaka Katsuyama, Akihiro Minagawa, Yoshinobu Hotta, Jun Sun, Shinichiro Omachi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

we propose a caption recognition method for multicolor characters on complex background. Caption characters are used for an efficient search on a large amount of recorded TV programs. In the caption character recognition, the caption appearance section and the area is extracted, the character strokes are extracted from the area, and recognized. This paper focuses on caption character strokes extraction and recognition for multi-color characters on complex background which is a very difficult task for the conventional methods. The proposed method extracts decomposed binary images from input color caption image by color clustering. Then character candidates that are composed of combination of connect components are extracted by using recognition certainty. Finally, characters are selected by beyond-color Dynamic Programming method in which weight on recognition certainty and character alignment are used. In the character recognition evaluation of one-line multi-color character string on a complex background, a great improvement was achieved from a conventional technique that can recognize only one-color characters on complex background image.

Original languageEnglish
Title of host publicationProceedings - 2012 IEEE International Symposium on Multimedia, ISM 2012
Pages401-407
Number of pages7
DOIs
Publication statusPublished - 2012
Externally publishedYes
Event14th IEEE International Symposium on Multimedia, ISM 2012 - Irvine, CA, United States
Duration: 2012 Dec 102012 Dec 12

Publication series

NameProceedings - 2012 IEEE International Symposium on Multimedia, ISM 2012

Conference

Conference14th IEEE International Symposium on Multimedia, ISM 2012
CountryUnited States
CityIrvine, CA
Period12/12/1012/12/12

Keywords

  • Character recognition
  • Color clustering
  • Multi-color caption
  • Stroke extraction

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'A study on caption recognition for multi-color characters on complex background'. Together they form a unique fingerprint.

  • Cite this

    Katsuyama, Y., Minagawa, A., Hotta, Y., Sun, J., & Omachi, S. (2012). A study on caption recognition for multi-color characters on complex background. In Proceedings - 2012 IEEE International Symposium on Multimedia, ISM 2012 (pp. 401-407). [6424697] (Proceedings - 2012 IEEE International Symposium on Multimedia, ISM 2012). https://doi.org/10.1109/ISM.2012.83