Content-aware fast motion estimation for H.264/AVC

Zhenyu Liu, Satoshi Goto, Takeshi Ikenaga

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

SUMMARY The key to high performance in video coding lies on efficiently reducing the temporal redundancies. For this purpose, H.264/AVC coding standard has adopted variable block size motion estimation on multiple reference frames to improve the coding gain. However, the computational complexity of motion estimation is also increased in proportion to the product of the reference frame number and the intermode number. The mathematical analysis in this paper reveals that the prediction errors mainly depend on the image edge gradient amplitude and quantization parameter. Consequently, this paper proposes the image content based early termination algorithm, which outperforms the original method adopted by JVT reference software, especially at high and moderate bit rates. In light of rate-distortion theory, this paper also relates the homogeneity of image to the quantization parameter. For the homogenous block, its search computation for futile reference frames and intermodes can be efficiently discarded. Therefore, the computation saving performance increases with the value of quantization parameter. These content based fast algorithms were integrated with Unsymmetrical-cross Multihexagon-grid Search (UMllexagonS) algorithm to demonstrate their performance. Compared to the original UMHexagonS fast matching algorithm, 26.14-54.97% search time can be saved with an average of 0.0369 dB coding quality degradation.

Original languageEnglish
Pages (from-to)1944-1952
Number of pages9
JournalIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
VolumeE91-A
Issue number8
DOIs
Publication statusPublished - 2008 Aug

Fingerprint

Motion Estimation
Motion estimation
Quantization
Fast Algorithm
Coding
Early Termination
Coding Gain
Rate-distortion
Video Coding
Prediction Error
Matching Algorithm
Mathematical Analysis
Homogeneity
Search Algorithm
Redundancy
Computational Complexity
Degradation
Proportion
High Performance
Image coding

Keywords

  • Early termination
  • H.264/AVC
  • Motion estimation
  • Multiple reference frame
  • Variable block size

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Graphics and Computer-Aided Design
  • Applied Mathematics
  • Signal Processing

Cite this

Content-aware fast motion estimation for H.264/AVC. / Liu, Zhenyu; Goto, Satoshi; Ikenaga, Takeshi.

In: IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, Vol. E91-A, No. 8, 08.2008, p. 1944-1952.

Research output: Contribution to journalArticle

@article{a98afdc54d8d4749abd639148128879c,
title = "Content-aware fast motion estimation for H.264/AVC",
abstract = "SUMMARY The key to high performance in video coding lies on efficiently reducing the temporal redundancies. For this purpose, H.264/AVC coding standard has adopted variable block size motion estimation on multiple reference frames to improve the coding gain. However, the computational complexity of motion estimation is also increased in proportion to the product of the reference frame number and the intermode number. The mathematical analysis in this paper reveals that the prediction errors mainly depend on the image edge gradient amplitude and quantization parameter. Consequently, this paper proposes the image content based early termination algorithm, which outperforms the original method adopted by JVT reference software, especially at high and moderate bit rates. In light of rate-distortion theory, this paper also relates the homogeneity of image to the quantization parameter. For the homogenous block, its search computation for futile reference frames and intermodes can be efficiently discarded. Therefore, the computation saving performance increases with the value of quantization parameter. These content based fast algorithms were integrated with Unsymmetrical-cross Multihexagon-grid Search (UMllexagonS) algorithm to demonstrate their performance. Compared to the original UMHexagonS fast matching algorithm, 26.14-54.97{\%} search time can be saved with an average of 0.0369 dB coding quality degradation.",
keywords = "Early termination, H.264/AVC, Motion estimation, Multiple reference frame, Variable block size",
author = "Zhenyu Liu and Satoshi Goto and Takeshi Ikenaga",
year = "2008",
month = "8",
doi = "10.1093/ietfec/e9l-a.8.1944",
language = "English",
volume = "E91-A",
pages = "1944--1952",
journal = "IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences",
issn = "0916-8508",
publisher = "Maruzen Co., Ltd/Maruzen Kabushikikaisha",
number = "8",

}

TY - JOUR

T1 - Content-aware fast motion estimation for H.264/AVC

AU - Liu, Zhenyu

AU - Goto, Satoshi

AU - Ikenaga, Takeshi

PY - 2008/8

Y1 - 2008/8

N2 - SUMMARY The key to high performance in video coding lies on efficiently reducing the temporal redundancies. For this purpose, H.264/AVC coding standard has adopted variable block size motion estimation on multiple reference frames to improve the coding gain. However, the computational complexity of motion estimation is also increased in proportion to the product of the reference frame number and the intermode number. The mathematical analysis in this paper reveals that the prediction errors mainly depend on the image edge gradient amplitude and quantization parameter. Consequently, this paper proposes the image content based early termination algorithm, which outperforms the original method adopted by JVT reference software, especially at high and moderate bit rates. In light of rate-distortion theory, this paper also relates the homogeneity of image to the quantization parameter. For the homogenous block, its search computation for futile reference frames and intermodes can be efficiently discarded. Therefore, the computation saving performance increases with the value of quantization parameter. These content based fast algorithms were integrated with Unsymmetrical-cross Multihexagon-grid Search (UMllexagonS) algorithm to demonstrate their performance. Compared to the original UMHexagonS fast matching algorithm, 26.14-54.97% search time can be saved with an average of 0.0369 dB coding quality degradation.

AB - SUMMARY The key to high performance in video coding lies on efficiently reducing the temporal redundancies. For this purpose, H.264/AVC coding standard has adopted variable block size motion estimation on multiple reference frames to improve the coding gain. However, the computational complexity of motion estimation is also increased in proportion to the product of the reference frame number and the intermode number. The mathematical analysis in this paper reveals that the prediction errors mainly depend on the image edge gradient amplitude and quantization parameter. Consequently, this paper proposes the image content based early termination algorithm, which outperforms the original method adopted by JVT reference software, especially at high and moderate bit rates. In light of rate-distortion theory, this paper also relates the homogeneity of image to the quantization parameter. For the homogenous block, its search computation for futile reference frames and intermodes can be efficiently discarded. Therefore, the computation saving performance increases with the value of quantization parameter. These content based fast algorithms were integrated with Unsymmetrical-cross Multihexagon-grid Search (UMllexagonS) algorithm to demonstrate their performance. Compared to the original UMHexagonS fast matching algorithm, 26.14-54.97% search time can be saved with an average of 0.0369 dB coding quality degradation.

KW - Early termination

KW - H.264/AVC

KW - Motion estimation

KW - Multiple reference frame

KW - Variable block size

UR - http://www.scopus.com/inward/record.url?scp=77953458890&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77953458890&partnerID=8YFLogxK

U2 - 10.1093/ietfec/e9l-a.8.1944

DO - 10.1093/ietfec/e9l-a.8.1944

M3 - Article

AN - SCOPUS:77953458890

VL - E91-A

SP - 1944

EP - 1952

JO - IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

JF - IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

SN - 0916-8508

IS - 8

ER -