Automatic face tracking and model match-move automatic face tracking and model match-move in video sequence using 3D face model in video sequence using 3D face model

Takafumi Misawa*, Kazumasa Murai, Satoshi Nakamura, Shigeo Morishima

*この研究の対応する著者

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

A stand-in is a common technique for movies and TV programs in foreign languages. The current stand-in that only substitutes the voice channel results awkward matching to the mouth motion. Videophone with automatic voice translation are expected to be widely used in the near future, which may face the same problem without lip-synchronized speaking face image translation. In this paper, we propose a method to track motion of the face from the video image, that is one of the key technologies for speaking image translation. Almost all the old tracking algorithms aim to detect feature points of the face. However, these algorithms had problems, such as blurring of a feature point between frames and occlusion of the hidden feature point by rotation of the head, and so on. In this paper, we propose a method which detects movement and rotation of the head given the three dimensional shape of the face, by template matching using a 3D personal face wireframe model. The evaluation experiments are carried out with the measured reference data of the head. The proposed method achieves 0.48 angle error in average. This result confirms effectiveness of the proposed method.

本文言語English
ホスト出版物のタイトルProceedings - IEEE International Conference on Multimedia and Expo
出版社IEEE Computer Society
ページ234-236
ページ数3
ISBN(電子版)0769511988
DOI
出版ステータスPublished - 2001 1 1
外部発表はい
イベント2001 IEEE International Conference on Multimedia and Expo, ICME 2001 - Tokyo, Japan
継続期間: 2001 8 222001 8 25

出版物シリーズ

名前Proceedings - IEEE International Conference on Multimedia and Expo
ISSN(印刷版)1945-7871
ISSN(電子版)1945-788X

Other

Other2001 IEEE International Conference on Multimedia and Expo, ICME 2001
国/地域Japan
CityTokyo
Period01/8/2201/8/25

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • コンピュータ サイエンスの応用

フィンガープリント

「Automatic face tracking and model match-move automatic face tracking and model match-move in video sequence using 3D face model in video sequence using 3D face model」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル