Real-time facial action image synthesis system driven by speech and text

Shigeo Morishima*, Kiyoharu Aizawa, Hiroshi Harashima

*この研究の対応する著者

研究成果: Conference contribution

13 被引用数 (Scopus)

抄録

Automatic facial motion image synthesis schemes and a real-time system design are presented. The purpose of this scheme is to realize an intelligent human-machine interface or intelligent communication system with talking head images. A human face is reconstructed with 3D surface model and texture mapping technique on the display of terminal. Facial motion images are synthesized naturally by transformation of the lattice points on wire frames. Two types of motion drive methods, text to image conversion and speech to image conversion are proposed in this paper. In the former manner, the synthesized head can speak some given texts naturally and in the latter case, some mouth and jaw motions can be synthesized in time to speech signal of behind speaker. These schemes were implemented to a parallel image computer and a real-time image synthesizer could output facial motion images to the display as fast as video rate.

本文言語English
ホスト出版物のタイトルProceedings of SPIE - The International Society for Optical Engineering
編集者Murat Kunt
出版社Publ by Int Soc for Optical Engineering
ページ1151-1158
ページ数8
ISBN(印刷版)0819404217
出版ステータスPublished - 1990 12月 1
外部発表はい
イベントVisual Communications and Image Processing '90 - Lausanne, Switz
継続期間: 1990 10月 11990 10月 4

出版物シリーズ

名前Proceedings of SPIE - The International Society for Optical Engineering
1360 pt 2
ISSN(印刷版)0277-786X

Other

OtherVisual Communications and Image Processing '90
CityLausanne, Switz
Period90/10/190/10/4

ASJC Scopus subject areas

  • 電子材料、光学材料、および磁性材料
  • 凝縮系物理学
  • コンピュータ サイエンスの応用
  • 応用数学
  • 電子工学および電気工学

フィンガープリント

「Real-time facial action image synthesis system driven by speech and text」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル