Infrared Image Colorization Using a S-Shape Network

Ziyue Dong, Seiichiro Kamata, Toby P. Breckon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

This paper proposes a novel approach for colorizing near infrared (NIR) images using a S-shape network (SNet). The proposed approach is based on the usage of an encoder-decoder architecture followed with a secondary assistant network. The encoder-decoder consists of a contracting path to capture context and a symmetric expanding path that enables precise localization. The assistant network is a shallow encoder-decoder to enhance the edge and improve the output, which can be trained end-to-end from a few image examples. The trained model does not require any user guidance or a reference image database. Furthermore, our architecture will preserve clear edges within NIR images. Our overall architecture is trained and evaluated on a real-world dataset containing a significant amount of road scene images. This dataset was captured by a NIR camera and a corresponding RGB camera to facilitate side-by-side comparison. In the experiments, we demonstrate that our SNet works well, and outperforms contemporary state-of-the-art approaches.

Original languageEnglish
Title of host publication2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings
PublisherIEEE Computer Society
Pages2242-2246
Number of pages5
ISBN (Electronic)9781479970612
DOIs
Publication statusPublished - 2018 Aug 29
Event25th IEEE International Conference on Image Processing, ICIP 2018 - Athens, Greece
Duration: 2018 Oct 72018 Oct 10

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Conference

Conference25th IEEE International Conference on Image Processing, ICIP 2018
CountryGreece
CityAthens
Period18/10/718/10/10

    Fingerprint

Keywords

  • Colorization
  • Convolutional neural network
  • Infrared
  • S-shape network

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Cite this

Dong, Z., Kamata, S., & Breckon, T. P. (2018). Infrared Image Colorization Using a S-Shape Network. In 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings (pp. 2242-2246). [8451230] (Proceedings - International Conference on Image Processing, ICIP). IEEE Computer Society. https://doi.org/10.1109/ICIP.2018.8451230