Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities

N. P. Chandrasiri, I. Barakonyi, T. Naemura, M. Ishizuka, H. Harashima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

We present a system for Internet communication that enhances traditional text-based chatting with real-time analysis and synthesis of the chat parties' facial expressions. It is composed of three main modules: a real-time facial expression analysis component, a 3D agent with facial expression synthesis and text-to-speech capabilities - a talking head, and a communication module. So far we have realized a prototype to find out attractive ways of communication on the Internet and are currently experimenting on how to utilize this new type of modalities in chat communication.

Original languageEnglish
Title of host publication8th International Conference on Communication Systems, ICCS 2002 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages480-484
Number of pages5
ISBN (Print)0780375106, 9780780375109
DOIs
Publication statusPublished - 2002
Externally publishedYes
Event8th International Conference on Communication Systems, ICCS 2002 - Singapore, Singapore
Duration: 2002 Nov 252002 Nov 28

Other

Other8th International Conference on Communication Systems, ICCS 2002
CountrySingapore
CitySingapore
Period02/11/2502/11/28

Fingerprint

Internet
Communication

Keywords

  • 3D agent
  • chat
  • facial expression
  • MPEG-4 FAP

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Networks and Communications

Cite this

Chandrasiri, N. P., Barakonyi, I., Naemura, T., Ishizuka, M., & Harashima, H. (2002). Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities. In 8th International Conference on Communication Systems, ICCS 2002 - Proceedings (pp. 480-484). [1182522] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCS.2002.1182522

Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities. / Chandrasiri, N. P.; Barakonyi, I.; Naemura, T.; Ishizuka, M.; Harashima, H.

8th International Conference on Communication Systems, ICCS 2002 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2002. p. 480-484 1182522.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chandrasiri, NP, Barakonyi, I, Naemura, T, Ishizuka, M & Harashima, H 2002, Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities. in 8th International Conference on Communication Systems, ICCS 2002 - Proceedings., 1182522, Institute of Electrical and Electronics Engineers Inc., pp. 480-484, 8th International Conference on Communication Systems, ICCS 2002, Singapore, Singapore, 02/11/25. https://doi.org/10.1109/ICCS.2002.1182522
Chandrasiri NP, Barakonyi I, Naemura T, Ishizuka M, Harashima H. Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities. In 8th International Conference on Communication Systems, ICCS 2002 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2002. p. 480-484. 1182522 https://doi.org/10.1109/ICCS.2002.1182522
Chandrasiri, N. P. ; Barakonyi, I. ; Naemura, T. ; Ishizuka, M. ; Harashima, H. / Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities. 8th International Conference on Communication Systems, ICCS 2002 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2002. pp. 480-484
@inproceedings{76a151a45d1b42adb7dbeae4951d22c5,
title = "Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities",
abstract = "We present a system for Internet communication that enhances traditional text-based chatting with real-time analysis and synthesis of the chat parties' facial expressions. It is composed of three main modules: a real-time facial expression analysis component, a 3D agent with facial expression synthesis and text-to-speech capabilities - a talking head, and a communication module. So far we have realized a prototype to find out attractive ways of communication on the Internet and are currently experimenting on how to utilize this new type of modalities in chat communication.",
keywords = "3D agent, chat, facial expression, MPEG-4 FAP",
author = "Chandrasiri, {N. P.} and I. Barakonyi and T. Naemura and M. Ishizuka and H. Harashima",
year = "2002",
doi = "10.1109/ICCS.2002.1182522",
language = "English",
isbn = "0780375106",
pages = "480--484",
booktitle = "8th International Conference on Communication Systems, ICCS 2002 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities

AU - Chandrasiri, N. P.

AU - Barakonyi, I.

AU - Naemura, T.

AU - Ishizuka, M.

AU - Harashima, H.

PY - 2002

Y1 - 2002

N2 - We present a system for Internet communication that enhances traditional text-based chatting with real-time analysis and synthesis of the chat parties' facial expressions. It is composed of three main modules: a real-time facial expression analysis component, a 3D agent with facial expression synthesis and text-to-speech capabilities - a talking head, and a communication module. So far we have realized a prototype to find out attractive ways of communication on the Internet and are currently experimenting on how to utilize this new type of modalities in chat communication.

AB - We present a system for Internet communication that enhances traditional text-based chatting with real-time analysis and synthesis of the chat parties' facial expressions. It is composed of three main modules: a real-time facial expression analysis component, a 3D agent with facial expression synthesis and text-to-speech capabilities - a talking head, and a communication module. So far we have realized a prototype to find out attractive ways of communication on the Internet and are currently experimenting on how to utilize this new type of modalities in chat communication.

KW - 3D agent

KW - chat

KW - facial expression

KW - MPEG-4 FAP

UR - http://www.scopus.com/inward/record.url?scp=84961695960&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84961695960&partnerID=8YFLogxK

U2 - 10.1109/ICCS.2002.1182522

DO - 10.1109/ICCS.2002.1182522

M3 - Conference contribution

SN - 0780375106

SN - 9780780375109

SP - 480

EP - 484

BT - 8th International Conference on Communication Systems, ICCS 2002 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -