HyperMask - Projecting a talking head onto a real object

T. Yotsukura, Shigeo Morishima, F. Nielsen, K. Binsted, C. Pinhanez

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

HyperMask is a system which projects an animated face onto a physical mask worn by an actor. As the mask moves within a prescribed area, its position and orientation are detected by a camera and the projected image changes with respect to the viewpoint of the audience. The lips of the projected face are automatically synthesized in real time with the voice of the actor, who also controls the facial expressions. As a theatrical tool, HyperMask enables a new style of storytelling. As a prototype system, we put a self-contained HyperMask system in a trolley (disguised as a linen cart), so that it projects onto the mask worn by the actor pushing the trolley.

Original languageEnglish
Pages (from-to)111-120
Number of pages10
JournalVisual Computer
Volume18
Issue number2
DOIs
Publication statusPublished - 2002 Mar
Externally publishedYes

Fingerprint

Masks
Linen
Cameras

Keywords

  • Computerized theatrical performances
  • Homography
  • Lip-synch
  • Neural networks
  • Talking heads

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Yotsukura, T., Morishima, S., Nielsen, F., Binsted, K., & Pinhanez, C. (2002). HyperMask - Projecting a talking head onto a real object. Visual Computer, 18(2), 111-120. https://doi.org/10.1007/s003710100140

HyperMask - Projecting a talking head onto a real object. / Yotsukura, T.; Morishima, Shigeo; Nielsen, F.; Binsted, K.; Pinhanez, C.

In: Visual Computer, Vol. 18, No. 2, 03.2002, p. 111-120.

Research output: Contribution to journalArticle

Yotsukura, T, Morishima, S, Nielsen, F, Binsted, K & Pinhanez, C 2002, 'HyperMask - Projecting a talking head onto a real object' Visual Computer, vol. 18, no. 2, pp. 111-120. https://doi.org/10.1007/s003710100140
Yotsukura, T. ; Morishima, Shigeo ; Nielsen, F. ; Binsted, K. ; Pinhanez, C. / HyperMask - Projecting a talking head onto a real object. In: Visual Computer. 2002 ; Vol. 18, No. 2. pp. 111-120.
@article{597d056816a642dd943196a90a5e87a1,
title = "HyperMask - Projecting a talking head onto a real object",
abstract = "HyperMask is a system which projects an animated face onto a physical mask worn by an actor. As the mask moves within a prescribed area, its position and orientation are detected by a camera and the projected image changes with respect to the viewpoint of the audience. The lips of the projected face are automatically synthesized in real time with the voice of the actor, who also controls the facial expressions. As a theatrical tool, HyperMask enables a new style of storytelling. As a prototype system, we put a self-contained HyperMask system in a trolley (disguised as a linen cart), so that it projects onto the mask worn by the actor pushing the trolley.",
keywords = "Computerized theatrical performances, Homography, Lip-synch, Neural networks, Talking heads",
author = "T. Yotsukura and Shigeo Morishima and F. Nielsen and K. Binsted and C. Pinhanez",
year = "2002",
month = "3",
doi = "10.1007/s003710100140",
language = "English",
volume = "18",
pages = "111--120",
journal = "Visual Computer",
issn = "0178-2789",
publisher = "Springer Verlag",
number = "2",

}

TY - JOUR

T1 - HyperMask - Projecting a talking head onto a real object

AU - Yotsukura, T.

AU - Morishima, Shigeo

AU - Nielsen, F.

AU - Binsted, K.

AU - Pinhanez, C.

PY - 2002/3

Y1 - 2002/3

N2 - HyperMask is a system which projects an animated face onto a physical mask worn by an actor. As the mask moves within a prescribed area, its position and orientation are detected by a camera and the projected image changes with respect to the viewpoint of the audience. The lips of the projected face are automatically synthesized in real time with the voice of the actor, who also controls the facial expressions. As a theatrical tool, HyperMask enables a new style of storytelling. As a prototype system, we put a self-contained HyperMask system in a trolley (disguised as a linen cart), so that it projects onto the mask worn by the actor pushing the trolley.

AB - HyperMask is a system which projects an animated face onto a physical mask worn by an actor. As the mask moves within a prescribed area, its position and orientation are detected by a camera and the projected image changes with respect to the viewpoint of the audience. The lips of the projected face are automatically synthesized in real time with the voice of the actor, who also controls the facial expressions. As a theatrical tool, HyperMask enables a new style of storytelling. As a prototype system, we put a self-contained HyperMask system in a trolley (disguised as a linen cart), so that it projects onto the mask worn by the actor pushing the trolley.

KW - Computerized theatrical performances

KW - Homography

KW - Lip-synch

KW - Neural networks

KW - Talking heads

UR - http://www.scopus.com/inward/record.url?scp=0036504995&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036504995&partnerID=8YFLogxK

U2 - 10.1007/s003710100140

DO - 10.1007/s003710100140

M3 - Article

VL - 18

SP - 111

EP - 120

JO - Visual Computer

JF - Visual Computer

SN - 0178-2789

IS - 2

ER -