Two-stage motion compensation using adaptive global MC and local affine MC

Hirohisa Jozawa, Kazuto Kamikura, Atsushi Sagata, Hiroshi Kotera, Hiroshi Watanabe

Research output: Contribution to journalArticle

63 Citations (Scopus)

Abstract

This paper describes a high-efficiency video coding method based on ITU-T H.263. To improve the coding efficiency of H.263, a two-stage motion compensation (MC) method is proposed, consisting of global MC (GMC) for predicting camera motion and local MC (LMC) for macroblock prediction. First, global motion such as panning, tilting, and zooming is estimated, and the global-motion-compensated image is produced for use as a reference in LMC. Next, LMC is performed both for the global-motion-compensated reference image and for the image without GMC. LMC employs an affine motion model in the context of H.263's overlapped block motion compensation. Using the overlapped block affine MC, rotation and scaling of small objects can be predicted, in addition to translational motion. In the proposed method, GMC is adaptively turned on/off for each macroblock since GMC cannot be used for prediction in all regions in a frame. In addition, either an affine or a translational motion model is adaptively selected in LMC for each macroblock. Simulation results show that the proposed video coding technique using the two-stage MC significantly outperforms H.263 under identical conditions, especially for sequences with fast camera motion. The performance improvements in peak-to-peak SNR (PSNR) are about 3 dB over the original H.263, which does not use the two-stage MC.

Original languageEnglish
Pages (from-to)75-85
Number of pages11
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume7
Issue number1
DOIs
Publication statusPublished - 1997
Externally publishedYes

Fingerprint

Motion compensation
Image coding
Cameras

Keywords

  • Image coding
  • Image communication
  • Image motion analysis
  • Motion compensation
  • Video signal processing

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Two-stage motion compensation using adaptive global MC and local affine MC. / Jozawa, Hirohisa; Kamikura, Kazuto; Sagata, Atsushi; Kotera, Hiroshi; Watanabe, Hiroshi.

In: IEEE Transactions on Circuits and Systems for Video Technology, Vol. 7, No. 1, 1997, p. 75-85.

Research output: Contribution to journalArticle

Jozawa, Hirohisa ; Kamikura, Kazuto ; Sagata, Atsushi ; Kotera, Hiroshi ; Watanabe, Hiroshi. / Two-stage motion compensation using adaptive global MC and local affine MC. In: IEEE Transactions on Circuits and Systems for Video Technology. 1997 ; Vol. 7, No. 1. pp. 75-85.
@article{327b8dfcb5664687839b4d536c7e9053,
title = "Two-stage motion compensation using adaptive global MC and local affine MC",
abstract = "This paper describes a high-efficiency video coding method based on ITU-T H.263. To improve the coding efficiency of H.263, a two-stage motion compensation (MC) method is proposed, consisting of global MC (GMC) for predicting camera motion and local MC (LMC) for macroblock prediction. First, global motion such as panning, tilting, and zooming is estimated, and the global-motion-compensated image is produced for use as a reference in LMC. Next, LMC is performed both for the global-motion-compensated reference image and for the image without GMC. LMC employs an affine motion model in the context of H.263's overlapped block motion compensation. Using the overlapped block affine MC, rotation and scaling of small objects can be predicted, in addition to translational motion. In the proposed method, GMC is adaptively turned on/off for each macroblock since GMC cannot be used for prediction in all regions in a frame. In addition, either an affine or a translational motion model is adaptively selected in LMC for each macroblock. Simulation results show that the proposed video coding technique using the two-stage MC significantly outperforms H.263 under identical conditions, especially for sequences with fast camera motion. The performance improvements in peak-to-peak SNR (PSNR) are about 3 dB over the original H.263, which does not use the two-stage MC.",
keywords = "Image coding, Image communication, Image motion analysis, Motion compensation, Video signal processing",
author = "Hirohisa Jozawa and Kazuto Kamikura and Atsushi Sagata and Hiroshi Kotera and Hiroshi Watanabe",
year = "1997",
doi = "10.1109/76.554419",
language = "English",
volume = "7",
pages = "75--85",
journal = "IEEE Transactions on Circuits and Systems for Video Technology",
issn = "1051-8215",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - Two-stage motion compensation using adaptive global MC and local affine MC

AU - Jozawa, Hirohisa

AU - Kamikura, Kazuto

AU - Sagata, Atsushi

AU - Kotera, Hiroshi

AU - Watanabe, Hiroshi

PY - 1997

Y1 - 1997

N2 - This paper describes a high-efficiency video coding method based on ITU-T H.263. To improve the coding efficiency of H.263, a two-stage motion compensation (MC) method is proposed, consisting of global MC (GMC) for predicting camera motion and local MC (LMC) for macroblock prediction. First, global motion such as panning, tilting, and zooming is estimated, and the global-motion-compensated image is produced for use as a reference in LMC. Next, LMC is performed both for the global-motion-compensated reference image and for the image without GMC. LMC employs an affine motion model in the context of H.263's overlapped block motion compensation. Using the overlapped block affine MC, rotation and scaling of small objects can be predicted, in addition to translational motion. In the proposed method, GMC is adaptively turned on/off for each macroblock since GMC cannot be used for prediction in all regions in a frame. In addition, either an affine or a translational motion model is adaptively selected in LMC for each macroblock. Simulation results show that the proposed video coding technique using the two-stage MC significantly outperforms H.263 under identical conditions, especially for sequences with fast camera motion. The performance improvements in peak-to-peak SNR (PSNR) are about 3 dB over the original H.263, which does not use the two-stage MC.

AB - This paper describes a high-efficiency video coding method based on ITU-T H.263. To improve the coding efficiency of H.263, a two-stage motion compensation (MC) method is proposed, consisting of global MC (GMC) for predicting camera motion and local MC (LMC) for macroblock prediction. First, global motion such as panning, tilting, and zooming is estimated, and the global-motion-compensated image is produced for use as a reference in LMC. Next, LMC is performed both for the global-motion-compensated reference image and for the image without GMC. LMC employs an affine motion model in the context of H.263's overlapped block motion compensation. Using the overlapped block affine MC, rotation and scaling of small objects can be predicted, in addition to translational motion. In the proposed method, GMC is adaptively turned on/off for each macroblock since GMC cannot be used for prediction in all regions in a frame. In addition, either an affine or a translational motion model is adaptively selected in LMC for each macroblock. Simulation results show that the proposed video coding technique using the two-stage MC significantly outperforms H.263 under identical conditions, especially for sequences with fast camera motion. The performance improvements in peak-to-peak SNR (PSNR) are about 3 dB over the original H.263, which does not use the two-stage MC.

KW - Image coding

KW - Image communication

KW - Image motion analysis

KW - Motion compensation

KW - Video signal processing

UR - http://www.scopus.com/inward/record.url?scp=0031077570&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031077570&partnerID=8YFLogxK

U2 - 10.1109/76.554419

DO - 10.1109/76.554419

M3 - Article

VL - 7

SP - 75

EP - 85

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

SN - 1051-8215

IS - 1

ER -