Retinex based visual identicalness detection for videos corrupted by imaging noise

Xin Jin, Satoshi Goto, Qionghai Dai

Research output: Contribution to journalArticle

Abstract

Detecting the visually identical regions among successive frames for noisy videos, called visual identicalness detection (VID) in this paper, is a fundamental tool in video applications for lower power consumption and higher efficiency. In this paper, instead of performing VID on the original video signal or on the de-noised video signal, a Retinex based VID approach is proposed to perform VID on the Retinex signal to eliminate the noise influence introduced by imaging system. Several Retinex output generation approaches are compared, within which the proposed Cohen-Daubechies-Feauveau wavelet based approach is demonstrated to have better efficiency in detection and higher adaptability to the video content and noise severity. Compared with approaches performing detection in the de-noised images, the proposed algorithm presents up to 4.78 times higher detection rate for the videos with moving objects and up to 30.79 times higher detection rate for the videos with static scenes, respectively, at the same error rate. Also, an application of this technique is provided by integrating it into an H.264/AVC video encoder. Compared with compressing the de-noised videos using the existing fast algorithm, an average of 1.7 dB performance improvement is achieved with up to 5.47 times higher encoding speed. Relative to the reference encoder, up to 32.47 times higher encoding speed is achieved without sacrificing the subjective quality.

Original languageEnglish
Pages (from-to)1187-1201
Number of pages15
JournalSignal Processing: Image Communication
Volume28
Issue number9
DOIs
Publication statusPublished - 2013 Oct

Fingerprint

Imaging techniques
Imaging systems
Electric power utilization

Keywords

  • Identicalness detection
  • Noise robust technique
  • Retinex theory
  • Video applications

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Software
  • Electrical and Electronic Engineering

Cite this

Retinex based visual identicalness detection for videos corrupted by imaging noise. / Jin, Xin; Goto, Satoshi; Dai, Qionghai.

In: Signal Processing: Image Communication, Vol. 28, No. 9, 10.2013, p. 1187-1201.

Research output: Contribution to journalArticle

Jin, Xin ; Goto, Satoshi ; Dai, Qionghai. / Retinex based visual identicalness detection for videos corrupted by imaging noise. In: Signal Processing: Image Communication. 2013 ; Vol. 28, No. 9. pp. 1187-1201.
@article{1ec47e9e36b541fb945e26a4fc038b80,
title = "Retinex based visual identicalness detection for videos corrupted by imaging noise",
abstract = "Detecting the visually identical regions among successive frames for noisy videos, called visual identicalness detection (VID) in this paper, is a fundamental tool in video applications for lower power consumption and higher efficiency. In this paper, instead of performing VID on the original video signal or on the de-noised video signal, a Retinex based VID approach is proposed to perform VID on the Retinex signal to eliminate the noise influence introduced by imaging system. Several Retinex output generation approaches are compared, within which the proposed Cohen-Daubechies-Feauveau wavelet based approach is demonstrated to have better efficiency in detection and higher adaptability to the video content and noise severity. Compared with approaches performing detection in the de-noised images, the proposed algorithm presents up to 4.78 times higher detection rate for the videos with moving objects and up to 30.79 times higher detection rate for the videos with static scenes, respectively, at the same error rate. Also, an application of this technique is provided by integrating it into an H.264/AVC video encoder. Compared with compressing the de-noised videos using the existing fast algorithm, an average of 1.7 dB performance improvement is achieved with up to 5.47 times higher encoding speed. Relative to the reference encoder, up to 32.47 times higher encoding speed is achieved without sacrificing the subjective quality.",
keywords = "Identicalness detection, Noise robust technique, Retinex theory, Video applications",
author = "Xin Jin and Satoshi Goto and Qionghai Dai",
year = "2013",
month = "10",
doi = "10.1016/j.image.2013.06.004",
language = "English",
volume = "28",
pages = "1187--1201",
journal = "Signal Processing: Image Communication",
issn = "0923-5965",
publisher = "Elsevier",
number = "9",

}

TY - JOUR

T1 - Retinex based visual identicalness detection for videos corrupted by imaging noise

AU - Jin, Xin

AU - Goto, Satoshi

AU - Dai, Qionghai

PY - 2013/10

Y1 - 2013/10

N2 - Detecting the visually identical regions among successive frames for noisy videos, called visual identicalness detection (VID) in this paper, is a fundamental tool in video applications for lower power consumption and higher efficiency. In this paper, instead of performing VID on the original video signal or on the de-noised video signal, a Retinex based VID approach is proposed to perform VID on the Retinex signal to eliminate the noise influence introduced by imaging system. Several Retinex output generation approaches are compared, within which the proposed Cohen-Daubechies-Feauveau wavelet based approach is demonstrated to have better efficiency in detection and higher adaptability to the video content and noise severity. Compared with approaches performing detection in the de-noised images, the proposed algorithm presents up to 4.78 times higher detection rate for the videos with moving objects and up to 30.79 times higher detection rate for the videos with static scenes, respectively, at the same error rate. Also, an application of this technique is provided by integrating it into an H.264/AVC video encoder. Compared with compressing the de-noised videos using the existing fast algorithm, an average of 1.7 dB performance improvement is achieved with up to 5.47 times higher encoding speed. Relative to the reference encoder, up to 32.47 times higher encoding speed is achieved without sacrificing the subjective quality.

AB - Detecting the visually identical regions among successive frames for noisy videos, called visual identicalness detection (VID) in this paper, is a fundamental tool in video applications for lower power consumption and higher efficiency. In this paper, instead of performing VID on the original video signal or on the de-noised video signal, a Retinex based VID approach is proposed to perform VID on the Retinex signal to eliminate the noise influence introduced by imaging system. Several Retinex output generation approaches are compared, within which the proposed Cohen-Daubechies-Feauveau wavelet based approach is demonstrated to have better efficiency in detection and higher adaptability to the video content and noise severity. Compared with approaches performing detection in the de-noised images, the proposed algorithm presents up to 4.78 times higher detection rate for the videos with moving objects and up to 30.79 times higher detection rate for the videos with static scenes, respectively, at the same error rate. Also, an application of this technique is provided by integrating it into an H.264/AVC video encoder. Compared with compressing the de-noised videos using the existing fast algorithm, an average of 1.7 dB performance improvement is achieved with up to 5.47 times higher encoding speed. Relative to the reference encoder, up to 32.47 times higher encoding speed is achieved without sacrificing the subjective quality.

KW - Identicalness detection

KW - Noise robust technique

KW - Retinex theory

KW - Video applications

UR - http://www.scopus.com/inward/record.url?scp=84884595769&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84884595769&partnerID=8YFLogxK

U2 - 10.1016/j.image.2013.06.004

DO - 10.1016/j.image.2013.06.004

M3 - Article

VL - 28

SP - 1187

EP - 1201

JO - Signal Processing: Image Communication

JF - Signal Processing: Image Communication

SN - 0923-5965

IS - 9

ER -