Real-Time 3-D Facial Image Reconstruction for Virtual Space Teleconferencing

Kazuyuki Ebihara, Noriko Suzuki, Jun Ohya, Fumio Kishino

Research output: Contribution to journalArticle

Abstract

In this paper, a new method was proposed for implementing 3-D facial image models designed to allow faithful reconstruction of facial images in virtual space teleconferencing by using 3-D measurement while detecting various facial expressions. In the method proposed, first many dots are painted on the face. Then, for a variety of facial expressions (eight expressions in this study) selected with regard to the action of the major facial muscles, 3-D displacement vectors for the normal (neutral) face are measured at each dot and recorded in the facial image plane as reference vectors. When the facial image is reconstructed, 2-D displacement vectors are detected by tracking markers that were previously placed on the face and are represented as the sum of two enclosing reference vectors. Based on these data, the vertices of a 3-D wireframe face model (WFM) are moved appropriately, and the facial expression is reconstructed.

Original languageEnglish
Pages (from-to)80-90
Number of pages11
JournalElectronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)
Volume82
Issue number5
Publication statusPublished - 1999 May
Externally publishedYes

Fingerprint

Teleconferencing
Image reconstruction
Muscle

Keywords

  • 3-D model
  • Facial image
  • Real-time processing
  • Reconstruction
  • Virtual space teleconferencing

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

@article{73091a0bb6e74cdebfb73ca71d0e929d,
title = "Real-Time 3-D Facial Image Reconstruction for Virtual Space Teleconferencing",
abstract = "In this paper, a new method was proposed for implementing 3-D facial image models designed to allow faithful reconstruction of facial images in virtual space teleconferencing by using 3-D measurement while detecting various facial expressions. In the method proposed, first many dots are painted on the face. Then, for a variety of facial expressions (eight expressions in this study) selected with regard to the action of the major facial muscles, 3-D displacement vectors for the normal (neutral) face are measured at each dot and recorded in the facial image plane as reference vectors. When the facial image is reconstructed, 2-D displacement vectors are detected by tracking markers that were previously placed on the face and are represented as the sum of two enclosing reference vectors. Based on these data, the vertices of a 3-D wireframe face model (WFM) are moved appropriately, and the facial expression is reconstructed.",
keywords = "3-D model, Facial image, Real-time processing, Reconstruction, Virtual space teleconferencing",
author = "Kazuyuki Ebihara and Noriko Suzuki and Jun Ohya and Fumio Kishino",
year = "1999",
month = "5",
language = "English",
volume = "82",
pages = "80--90",
journal = "Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)",
issn = "1042-0967",
publisher = "John Wiley and Sons Inc.",
number = "5",

}

TY - JOUR

T1 - Real-Time 3-D Facial Image Reconstruction for Virtual Space Teleconferencing

AU - Ebihara, Kazuyuki

AU - Suzuki, Noriko

AU - Ohya, Jun

AU - Kishino, Fumio

PY - 1999/5

Y1 - 1999/5

N2 - In this paper, a new method was proposed for implementing 3-D facial image models designed to allow faithful reconstruction of facial images in virtual space teleconferencing by using 3-D measurement while detecting various facial expressions. In the method proposed, first many dots are painted on the face. Then, for a variety of facial expressions (eight expressions in this study) selected with regard to the action of the major facial muscles, 3-D displacement vectors for the normal (neutral) face are measured at each dot and recorded in the facial image plane as reference vectors. When the facial image is reconstructed, 2-D displacement vectors are detected by tracking markers that were previously placed on the face and are represented as the sum of two enclosing reference vectors. Based on these data, the vertices of a 3-D wireframe face model (WFM) are moved appropriately, and the facial expression is reconstructed.

AB - In this paper, a new method was proposed for implementing 3-D facial image models designed to allow faithful reconstruction of facial images in virtual space teleconferencing by using 3-D measurement while detecting various facial expressions. In the method proposed, first many dots are painted on the face. Then, for a variety of facial expressions (eight expressions in this study) selected with regard to the action of the major facial muscles, 3-D displacement vectors for the normal (neutral) face are measured at each dot and recorded in the facial image plane as reference vectors. When the facial image is reconstructed, 2-D displacement vectors are detected by tracking markers that were previously placed on the face and are represented as the sum of two enclosing reference vectors. Based on these data, the vertices of a 3-D wireframe face model (WFM) are moved appropriately, and the facial expression is reconstructed.

KW - 3-D model

KW - Facial image

KW - Real-time processing

KW - Reconstruction

KW - Virtual space teleconferencing

UR - http://www.scopus.com/inward/record.url?scp=0033133747&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0033133747&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:0033133747

VL - 82

SP - 80

EP - 90

JO - Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)

JF - Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)

SN - 1042-0967

IS - 5

ER -