Intelligent facial image coding driven by speech and phoneme

Shigeo Morishima, Kiyoharu Aizawa, Hiroshi Harashima

Research output: Contribution to journalConference article

40 Citations (Scopus)

Abstract

The authors propose and compare two types of model-based facial motion coding schemes, i.e., synthesis by rules and synthesis by parameters. In synthesis by rules, facial motion images are synthesized on the basis of rules extracted by analysis of training image samples that include all of the phonemes and coarticulation. This system can be utilized as an automatic facial animation synthesizer from text input or as a man-machine interface using the facial motion image. In synthesis by parameters, facial motion images are synthesized on the basis of a code word index of speech parameters. Experimental results indicate good performance for both systems, which can create natural facial-motion images with very low transmission rate. Details of 3-D modeling, algorithm synthesis, and performance are discussed.

Original languageEnglish
Pages (from-to)1795-1798
Number of pages4
JournalICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Volume3
Publication statusPublished - 1989 Dec 1
Externally publishedYes
Event1989 International Conference on Acoustics, Speech, and Signal Processing - Glasgow, Scotland
Duration: 1989 May 231989 May 26

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Intelligent facial image coding driven by speech and phoneme'. Together they form a unique fingerprint.

  • Cite this