Region-of-interest based H.264 encoder for videophone with a hardware macroblock level face detector

Tianruo Zhang; Chen Liu; Minghui Wang; Satoshi Goto

doi:10.1109/MMSP.2009.5293338

Region-of-interest based H.264 encoder for videophone with a hardware macroblock level face detector

Tianruo Zhang^*, Chen Liu, Minghui Wang, Satoshi Goto

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

9 Citations (Scopus)

Abstract

Region-of-interest (ROI) can be applied in H.264 video encoder to enhance subjective quality and reduce computation complexity. For the aiming application of low cost hardware real-time encoder in videophone with faces as ROI, this paper proposes a face detection algorithm to detect each macroblock (MB) as one part of a face or not. This face detection algorithm has a unique estimation-and-verification process and can be combined with a H.264 encoder by MB level pipeline architecture. 97.91% MBs in faces can be detected. VLSI architecture of proposed face detection algorithm is designed and an area of 4.3k gates is achieved. Power consumption is only 1.45mW at 100MHz. A ROI based H.264 encoder with dynamic parameters is proposed to enhance subjective quality and reduce the rate-distortion-optimization (RDO) complexity. The PSNR in ROI increases for 4.8dB under similar bit rate. Encoding time is reduced to 54.4% in videophone-like sequences.

Original language	English
Title of host publication	2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09
DOIs	https://doi.org/10.1109/MMSP.2009.5293338
Publication status	Published - 2009
Event	2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09 - Rio De Janeiro Duration: 2009 Oct 5 → 2009 Oct 7

Other

Other	2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09
City	Rio De Janeiro
Period	09/10/5 → 09/10/7

ASJC Scopus subject areas

Artificial Intelligence
Computer Networks and Communications
Computer Vision and Pattern Recognition
Signal Processing

Access to Document

10.1109/MMSP.2009.5293338

Cite this

Zhang, T, Liu, C, Wang, M & Goto, S 2009, Region-of-interest based H.264 encoder for videophone with a hardware macroblock level face detector. in 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09., 5293338, 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09, Rio De Janeiro, 09/10/5. https://doi.org/10.1109/MMSP.2009.5293338

@inproceedings{51040e7fcd9743a7bfbb48419d1e530e,

title = "Region-of-interest based H.264 encoder for videophone with a hardware macroblock level face detector",

abstract = "Region-of-interest (ROI) can be applied in H.264 video encoder to enhance subjective quality and reduce computation complexity. For the aiming application of low cost hardware real-time encoder in videophone with faces as ROI, this paper proposes a face detection algorithm to detect each macroblock (MB) as one part of a face or not. This face detection algorithm has a unique estimation-and-verification process and can be combined with a H.264 encoder by MB level pipeline architecture. 97.91% MBs in faces can be detected. VLSI architecture of proposed face detection algorithm is designed and an area of 4.3k gates is achieved. Power consumption is only 1.45mW at 100MHz. A ROI based H.264 encoder with dynamic parameters is proposed to enhance subjective quality and reduce the rate-distortion-optimization (RDO) complexity. The PSNR in ROI increases for 4.8dB under similar bit rate. Encoding time is reduced to 54.4% in videophone-like sequences.",

author = "Tianruo Zhang and Chen Liu and Minghui Wang and Satoshi Goto",

year = "2009",

doi = "10.1109/MMSP.2009.5293338",

language = "English",

isbn = "9781424444649",

booktitle = "2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09",

note = "2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09 ; Conference date: 05-10-2009 Through 07-10-2009",

}

TY - GEN

T1 - Region-of-interest based H.264 encoder for videophone with a hardware macroblock level face detector

AU - Zhang, Tianruo

AU - Liu, Chen

AU - Wang, Minghui

AU - Goto, Satoshi

PY - 2009

Y1 - 2009

N2 - Region-of-interest (ROI) can be applied in H.264 video encoder to enhance subjective quality and reduce computation complexity. For the aiming application of low cost hardware real-time encoder in videophone with faces as ROI, this paper proposes a face detection algorithm to detect each macroblock (MB) as one part of a face or not. This face detection algorithm has a unique estimation-and-verification process and can be combined with a H.264 encoder by MB level pipeline architecture. 97.91% MBs in faces can be detected. VLSI architecture of proposed face detection algorithm is designed and an area of 4.3k gates is achieved. Power consumption is only 1.45mW at 100MHz. A ROI based H.264 encoder with dynamic parameters is proposed to enhance subjective quality and reduce the rate-distortion-optimization (RDO) complexity. The PSNR in ROI increases for 4.8dB under similar bit rate. Encoding time is reduced to 54.4% in videophone-like sequences.

AB - Region-of-interest (ROI) can be applied in H.264 video encoder to enhance subjective quality and reduce computation complexity. For the aiming application of low cost hardware real-time encoder in videophone with faces as ROI, this paper proposes a face detection algorithm to detect each macroblock (MB) as one part of a face or not. This face detection algorithm has a unique estimation-and-verification process and can be combined with a H.264 encoder by MB level pipeline architecture. 97.91% MBs in faces can be detected. VLSI architecture of proposed face detection algorithm is designed and an area of 4.3k gates is achieved. Power consumption is only 1.45mW at 100MHz. A ROI based H.264 encoder with dynamic parameters is proposed to enhance subjective quality and reduce the rate-distortion-optimization (RDO) complexity. The PSNR in ROI increases for 4.8dB under similar bit rate. Encoding time is reduced to 54.4% in videophone-like sequences.

UR - http://www.scopus.com/inward/record.url?scp=74349083981&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=74349083981&partnerID=8YFLogxK

U2 - 10.1109/MMSP.2009.5293338

DO - 10.1109/MMSP.2009.5293338

M3 - Conference contribution

AN - SCOPUS:74349083981

SN - 9781424444649

BT - 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09

T2 - 2009 IEEE International Workshop on Multimedia Signal Processing, MMSP '09

Y2 - 5 October 2009 through 7 October 2009

ER -

Region-of-interest based H.264 encoder for videophone with a hardware macroblock level face detector

Abstract

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this