Face analysis and synthesis for interactive entertainment

Shoichiro Iwasawa, Tatsuo Yotsukura, Shigeo Morishima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A stand-in is a common technique for movies and TV programs in foreign languages. The current stand-in that only substitutes the voice channel results awkward matching to the mouth motion. Videophone with automatic voice translation are expected to be widely used in the near future, which may face the same problem without lip-synchronized speaking face image translation. In this paper, we propose a method to track motion of the face from the video image and then replace the face part or only mouth part with synthesized one which is synchronized with synthetic voice or spoken voice. This is one of the key technologies not only for speaking image translation and communication system, but also for an interactive entertainment system. Finally, an interactive movie system is introduced as an application of entertainment system.

Original languageEnglish
Title of host publicationEntertainment Computing
Subtitle of host publicationTechnologies and Applications - IFlP 1st International Workshop on Entertainment Computing, IWEC 2002
PublisherSpringer New York LLC
Pages157-164
Number of pages8
ISBN (Print)9781475751536
Publication statusPublished - 2003 Jan 1
EventIFIP 1st International Workshop on Entertainment Computing, IWEC 2002 - Makuhari, Japan
Duration: 2002 May 142002 May 17

Publication series

NameIFIP Advances in Information and Communication Technology
Volume112
ISSN (Print)1868-4238

Conference

ConferenceIFIP 1st International Workshop on Entertainment Computing, IWEC 2002
CountryJapan
CityMakuhari
Period02/5/1402/5/17

    Fingerprint

Keywords

  • Face image synthesis
  • Face tracking
  • Interactive movie
  • Lip synchronization

ASJC Scopus subject areas

  • Information Systems
  • Computer Networks and Communications
  • Information Systems and Management

Cite this

Iwasawa, S., Yotsukura, T., & Morishima, S. (2003). Face analysis and synthesis for interactive entertainment. In Entertainment Computing: Technologies and Applications - IFlP 1st International Workshop on Entertainment Computing, IWEC 2002 (pp. 157-164). (IFIP Advances in Information and Communication Technology; Vol. 112). Springer New York LLC.