HyperMask - Projecting a talking head onto a real object

T. Yotsukura, S. Morishima, F. Nielsen, K. Binsted, C. Pinhanez

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

HyperMask is a system which projects an animated face onto a physical mask worn by an actor. As the mask moves within a prescribed area, its position and orientation are detected by a camera and the projected image changes with respect to the viewpoint of the audience. The lips of the projected face are automatically synthesized in real time with the voice of the actor, who also controls the facial expressions. As a theatrical tool, HyperMask enables a new style of storytelling. As a prototype system, we put a self-contained HyperMask system in a trolley (disguised as a linen cart), so that it projects onto the mask worn by the actor pushing the trolley.

Original languageEnglish
Pages (from-to)111-120
Number of pages10
JournalVisual Computer
Volume18
Issue number2
DOIs
Publication statusPublished - 2002 Mar 1

    Fingerprint

Keywords

  • Computerized theatrical performances
  • Homography
  • Lip-synch
  • Neural networks
  • Talking heads

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Cite this

Yotsukura, T., Morishima, S., Nielsen, F., Binsted, K., & Pinhanez, C. (2002). HyperMask - Projecting a talking head onto a real object. Visual Computer, 18(2), 111-120. https://doi.org/10.1007/s003710100140