Real-time voice driven facial animation system

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Recently computer can make cyberspace to walk through by an interactive virtual reality technique. An avatar in cyberspace can bring us a virtual face-to-face communication environment. In this paper, we realize an avatar which has a real face in cyberspace to construct a multi-user communication system by voice transmission through network. Voice from microphone is transmitted and analyzed, then mouth shape and facial expression of avatar are synchronously estimated and synthesized on real time. And also we introduce an entertainment application of a real-time voice driven synthetic face. This project is named 'Fifteen Seconds of Fame' which is an example of interactive movie.

Original languageEnglish
Title of host publicationProceedings of the IEEE International Conference on Systems, Man and Cybernetics
PublisherIEEE
Volume6
Publication statusPublished - 1999
Externally publishedYes
Event1999 IEEE International Conference on Systems, Man, and Cybernetics 'Human Communication and Cybernetics' - Tokyo, Jpn
Duration: 1999 Oct 121999 Oct 15

Other

Other1999 IEEE International Conference on Systems, Man, and Cybernetics 'Human Communication and Cybernetics'
CityTokyo, Jpn
Period99/10/1299/10/15

Fingerprint

Animation
Speech transmission
Microphones
Virtual reality
Communication systems
Communication

ASJC Scopus subject areas

  • Hardware and Architecture
  • Control and Systems Engineering

Cite this

Morishima, S. (1999). Real-time voice driven facial animation system. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (Vol. 6). IEEE.

Real-time voice driven facial animation system. / Morishima, Shigeo.

Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Vol. 6 IEEE, 1999.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Morishima, S 1999, Real-time voice driven facial animation system. in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. vol. 6, IEEE, 1999 IEEE International Conference on Systems, Man, and Cybernetics 'Human Communication and Cybernetics', Tokyo, Jpn, 99/10/12.
Morishima S. Real-time voice driven facial animation system. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Vol. 6. IEEE. 1999
Morishima, Shigeo. / Real-time voice driven facial animation system. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Vol. 6 IEEE, 1999.
@inproceedings{61aecd7e3d6e4d74ae7bcf3b3c90042e,
title = "Real-time voice driven facial animation system",
abstract = "Recently computer can make cyberspace to walk through by an interactive virtual reality technique. An avatar in cyberspace can bring us a virtual face-to-face communication environment. In this paper, we realize an avatar which has a real face in cyberspace to construct a multi-user communication system by voice transmission through network. Voice from microphone is transmitted and analyzed, then mouth shape and facial expression of avatar are synchronously estimated and synthesized on real time. And also we introduce an entertainment application of a real-time voice driven synthetic face. This project is named 'Fifteen Seconds of Fame' which is an example of interactive movie.",
author = "Shigeo Morishima",
year = "1999",
language = "English",
volume = "6",
booktitle = "Proceedings of the IEEE International Conference on Systems, Man and Cybernetics",
publisher = "IEEE",

}

TY - GEN

T1 - Real-time voice driven facial animation system

AU - Morishima, Shigeo

PY - 1999

Y1 - 1999

N2 - Recently computer can make cyberspace to walk through by an interactive virtual reality technique. An avatar in cyberspace can bring us a virtual face-to-face communication environment. In this paper, we realize an avatar which has a real face in cyberspace to construct a multi-user communication system by voice transmission through network. Voice from microphone is transmitted and analyzed, then mouth shape and facial expression of avatar are synchronously estimated and synthesized on real time. And also we introduce an entertainment application of a real-time voice driven synthetic face. This project is named 'Fifteen Seconds of Fame' which is an example of interactive movie.

AB - Recently computer can make cyberspace to walk through by an interactive virtual reality technique. An avatar in cyberspace can bring us a virtual face-to-face communication environment. In this paper, we realize an avatar which has a real face in cyberspace to construct a multi-user communication system by voice transmission through network. Voice from microphone is transmitted and analyzed, then mouth shape and facial expression of avatar are synchronously estimated and synthesized on real time. And also we introduce an entertainment application of a real-time voice driven synthetic face. This project is named 'Fifteen Seconds of Fame' which is an example of interactive movie.

UR - http://www.scopus.com/inward/record.url?scp=0033351613&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0033351613&partnerID=8YFLogxK

M3 - Conference contribution

VL - 6

BT - Proceedings of the IEEE International Conference on Systems, Man and Cybernetics

PB - IEEE

ER -