3D face expression estimation and generation from 2D image based on a physically constraint model

Takahiro Ishikawa, Shigeo Morishima, Demetri Terzopoulos

Research output: Contribution to journalArticle

8 Citations (Scopus)


Muscle based face image synthesis is one of the most realistic approaches to the realization of a life-like agent in computers. A facial muscle model is composed of facial tissue elements and simulated muscles. In this model, forces are calculated effecting a facial tissue element by contraction of each muscle string, so the combination of each muscle contracting force decides a specific facial expression. This muscle parameter is determined on a trial and error basis by comparing the sample photograph and a generated image using our Muscle-Editor to generate a specific face image. In this paper, we propose the strategy of automatic estimation of facial muscle parameters from 2D markers' movements located on a face using a neural network. This corresponds to the non-realtime 3D facial motion capturing from 2D camera image under the physics based condition.

Original languageEnglish
Pages (from-to)251-258
Number of pages8
JournalIEICE Transactions on Information and Systems
Issue number2
Publication statusPublished - 2000 Jan 1



  • Facial image reconstruction
  • Facial muscle model
  • Muscle parameter
  • Neural network

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering
  • Artificial Intelligence

Cite this