Edge gradient based fast inter motion estimation for H.264/AVC

Zhenyu Liu, Yang Song, Yiqing Huang, Ngfeng Li, Satoshi Goto, Takeshi Ikenaga

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

H.264/AVC coding standard processes variable block size (VBS) motion estimation(ME) on multiple reference frames (MRF) to improve the coding gain. However, the computation is also increased in proportion to the product of the reference frame number and the inter modes. Through mathematical analysis, it is illustrated that the motion-compensated prediction error is mainly determined by the edge gradient amplitude. The image block being rich of texture and sharp edges contains much high frequency signal and this nature makes VBS MRF ME essential. The spatial homogeneity of a block is decided by its maximum edge gradient and its threshold for the edge gradient detection, which is 5 times quantization parameter (QP), is derived from rate-distortion theory. For the homogenous block, its ME computation for the futile reference frames and inter modes can be saved. Through evaluating the edge gradient, the block motion speed can be estimated to reduce the search area of integer ME. Based on the homogeneity of one 8×8 block, its Lagrangian Multiplier is also optimized to improve the coding quality. Moreover, we also provide a fast 'skip_mb' detection algorithm based on Hadamard co-efficients and the current QP. Experimental results show that 61.4%-88.9% computation can be saved by our approaches with the competitive coding quality as the exhaustive search algorithm.

Original languageEnglish
Title of host publicationISPA 2007 - Proceedings of the 5th International Symposium on Image and Signal Processing and Analysis
Pages52-57
Number of pages6
DOIs
Publication statusPublished - 2007
EventISPA 2007 - 5th International Symposium on Image and Signal Processing and Analysis - Istanbul
Duration: 2007 Sep 272007 Sep 29

Other

OtherISPA 2007 - 5th International Symposium on Image and Signal Processing and Analysis
CityIstanbul
Period07/9/2707/9/29

Fingerprint

Motion estimation
Textures

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing

Cite this

Liu, Z., Song, Y., Huang, Y., Li, N., Goto, S., & Ikenaga, T. (2007). Edge gradient based fast inter motion estimation for H.264/AVC. In ISPA 2007 - Proceedings of the 5th International Symposium on Image and Signal Processing and Analysis (pp. 52-57). [4383663] https://doi.org/10.1109/ISPA.2007.4383663

Edge gradient based fast inter motion estimation for H.264/AVC. / Liu, Zhenyu; Song, Yang; Huang, Yiqing; Li, Ngfeng; Goto, Satoshi; Ikenaga, Takeshi.

ISPA 2007 - Proceedings of the 5th International Symposium on Image and Signal Processing and Analysis. 2007. p. 52-57 4383663.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Liu, Z, Song, Y, Huang, Y, Li, N, Goto, S & Ikenaga, T 2007, Edge gradient based fast inter motion estimation for H.264/AVC. in ISPA 2007 - Proceedings of the 5th International Symposium on Image and Signal Processing and Analysis., 4383663, pp. 52-57, ISPA 2007 - 5th International Symposium on Image and Signal Processing and Analysis, Istanbul, 07/9/27. https://doi.org/10.1109/ISPA.2007.4383663
Liu Z, Song Y, Huang Y, Li N, Goto S, Ikenaga T. Edge gradient based fast inter motion estimation for H.264/AVC. In ISPA 2007 - Proceedings of the 5th International Symposium on Image and Signal Processing and Analysis. 2007. p. 52-57. 4383663 https://doi.org/10.1109/ISPA.2007.4383663
Liu, Zhenyu ; Song, Yang ; Huang, Yiqing ; Li, Ngfeng ; Goto, Satoshi ; Ikenaga, Takeshi. / Edge gradient based fast inter motion estimation for H.264/AVC. ISPA 2007 - Proceedings of the 5th International Symposium on Image and Signal Processing and Analysis. 2007. pp. 52-57
@inproceedings{c835147d90704f2390a9e5a09ab0b288,
title = "Edge gradient based fast inter motion estimation for H.264/AVC",
abstract = "H.264/AVC coding standard processes variable block size (VBS) motion estimation(ME) on multiple reference frames (MRF) to improve the coding gain. However, the computation is also increased in proportion to the product of the reference frame number and the inter modes. Through mathematical analysis, it is illustrated that the motion-compensated prediction error is mainly determined by the edge gradient amplitude. The image block being rich of texture and sharp edges contains much high frequency signal and this nature makes VBS MRF ME essential. The spatial homogeneity of a block is decided by its maximum edge gradient and its threshold for the edge gradient detection, which is 5 times quantization parameter (QP), is derived from rate-distortion theory. For the homogenous block, its ME computation for the futile reference frames and inter modes can be saved. Through evaluating the edge gradient, the block motion speed can be estimated to reduce the search area of integer ME. Based on the homogeneity of one 8×8 block, its Lagrangian Multiplier is also optimized to improve the coding quality. Moreover, we also provide a fast 'skip_mb' detection algorithm based on Hadamard co-efficients and the current QP. Experimental results show that 61.4{\%}-88.9{\%} computation can be saved by our approaches with the competitive coding quality as the exhaustive search algorithm.",
author = "Zhenyu Liu and Yang Song and Yiqing Huang and Ngfeng Li and Satoshi Goto and Takeshi Ikenaga",
year = "2007",
doi = "10.1109/ISPA.2007.4383663",
language = "English",
isbn = "9789531841160",
pages = "52--57",
booktitle = "ISPA 2007 - Proceedings of the 5th International Symposium on Image and Signal Processing and Analysis",

}

TY - GEN

T1 - Edge gradient based fast inter motion estimation for H.264/AVC

AU - Liu, Zhenyu

AU - Song, Yang

AU - Huang, Yiqing

AU - Li, Ngfeng

AU - Goto, Satoshi

AU - Ikenaga, Takeshi

PY - 2007

Y1 - 2007

N2 - H.264/AVC coding standard processes variable block size (VBS) motion estimation(ME) on multiple reference frames (MRF) to improve the coding gain. However, the computation is also increased in proportion to the product of the reference frame number and the inter modes. Through mathematical analysis, it is illustrated that the motion-compensated prediction error is mainly determined by the edge gradient amplitude. The image block being rich of texture and sharp edges contains much high frequency signal and this nature makes VBS MRF ME essential. The spatial homogeneity of a block is decided by its maximum edge gradient and its threshold for the edge gradient detection, which is 5 times quantization parameter (QP), is derived from rate-distortion theory. For the homogenous block, its ME computation for the futile reference frames and inter modes can be saved. Through evaluating the edge gradient, the block motion speed can be estimated to reduce the search area of integer ME. Based on the homogeneity of one 8×8 block, its Lagrangian Multiplier is also optimized to improve the coding quality. Moreover, we also provide a fast 'skip_mb' detection algorithm based on Hadamard co-efficients and the current QP. Experimental results show that 61.4%-88.9% computation can be saved by our approaches with the competitive coding quality as the exhaustive search algorithm.

AB - H.264/AVC coding standard processes variable block size (VBS) motion estimation(ME) on multiple reference frames (MRF) to improve the coding gain. However, the computation is also increased in proportion to the product of the reference frame number and the inter modes. Through mathematical analysis, it is illustrated that the motion-compensated prediction error is mainly determined by the edge gradient amplitude. The image block being rich of texture and sharp edges contains much high frequency signal and this nature makes VBS MRF ME essential. The spatial homogeneity of a block is decided by its maximum edge gradient and its threshold for the edge gradient detection, which is 5 times quantization parameter (QP), is derived from rate-distortion theory. For the homogenous block, its ME computation for the futile reference frames and inter modes can be saved. Through evaluating the edge gradient, the block motion speed can be estimated to reduce the search area of integer ME. Based on the homogeneity of one 8×8 block, its Lagrangian Multiplier is also optimized to improve the coding quality. Moreover, we also provide a fast 'skip_mb' detection algorithm based on Hadamard co-efficients and the current QP. Experimental results show that 61.4%-88.9% computation can be saved by our approaches with the competitive coding quality as the exhaustive search algorithm.

UR - http://www.scopus.com/inward/record.url?scp=47949110358&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=47949110358&partnerID=8YFLogxK

U2 - 10.1109/ISPA.2007.4383663

DO - 10.1109/ISPA.2007.4383663

M3 - Conference contribution

AN - SCOPUS:47949110358

SN - 9789531841160

SP - 52

EP - 57

BT - ISPA 2007 - Proceedings of the 5th International Symposium on Image and Signal Processing and Analysis

ER -