TY - GEN
T1 - Real-time facial action image synthesis system driven by speech and text
AU - Morishima, Shigeo
AU - Aizawa, Kiyoharu
AU - Harashima, Hiroshi
PY - 1990/12/1
Y1 - 1990/12/1
N2 - Automatic facial motion image synthesis schemes and a real-time system design are presented. The purpose of this scheme is to realize an intelligent human-machine interface or intelligent communication system with talking head images. A human face is reconstructed with 3D surface model and texture mapping technique on the display of terminal. Facial motion images are synthesized naturally by transformation of the lattice points on wire frames. Two types of motion drive methods, text to image conversion and speech to image conversion are proposed in this paper. In the former manner, the synthesized head can speak some given texts naturally and in the latter case, some mouth and jaw motions can be synthesized in time to speech signal of behind speaker. These schemes were implemented to a parallel image computer and a real-time image synthesizer could output facial motion images to the display as fast as video rate.
AB - Automatic facial motion image synthesis schemes and a real-time system design are presented. The purpose of this scheme is to realize an intelligent human-machine interface or intelligent communication system with talking head images. A human face is reconstructed with 3D surface model and texture mapping technique on the display of terminal. Facial motion images are synthesized naturally by transformation of the lattice points on wire frames. Two types of motion drive methods, text to image conversion and speech to image conversion are proposed in this paper. In the former manner, the synthesized head can speak some given texts naturally and in the latter case, some mouth and jaw motions can be synthesized in time to speech signal of behind speaker. These schemes were implemented to a parallel image computer and a real-time image synthesizer could output facial motion images to the display as fast as video rate.
UR - http://www.scopus.com/inward/record.url?scp=0025541390&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0025541390&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:0025541390
SN - 0819404217
T3 - Proceedings of SPIE - The International Society for Optical Engineering
SP - 1151
EP - 1158
BT - Proceedings of SPIE - The International Society for Optical Engineering
A2 - Kunt, Murat
PB - Publ by Int Soc for Optical Engineering
T2 - Visual Communications and Image Processing '90
Y2 - 1 October 1990 through 4 October 1990
ER -