Automatic generation of conversational behavior for multiple embodied virtual characters: The rules and models behind our system

Werner Breitfuss, Helmut Prendinger, Mitsuru Ishizuka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we presented the rules and algorithms we use to automatically generate non-verbal behavior like gestures and gaze for two embodied virtual agents. They allow us to transform a dialogue in text format into an agent behavior script enriched by eye gaze and conversational gesture behavior. The agents' gaze behavior is informed by theories of human face-to-face gaze behavior. Gestures are generated based on the analysis of linguistic and contextual information of the input text. Since all behaviors are generated automatically, our system offers content creators a convenient method to compose multimodal presentations, a task that would otherwise be very cumbersome and time consuming.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages472-473
Number of pages2
Volume5208 LNAI
DOIs
Publication statusPublished - 2008
Externally publishedYes
Event8th International Conference on Intelligent Virtual Agents, IVA 2008 - Tokyo
Duration: 2008 Sep 12008 Sep 3

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5208 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other8th International Conference on Intelligent Virtual Agents, IVA 2008
CityTokyo
Period08/9/108/9/3

Fingerprint

Virtual Characters
Gesture
Linguistics
Model
Virtual Agents
Transform

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Breitfuss, W., Prendinger, H., & Ishizuka, M. (2008). Automatic generation of conversational behavior for multiple embodied virtual characters: The rules and models behind our system. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 5208 LNAI, pp. 472-473). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5208 LNAI). https://doi.org/10.1007/978-3-540-85483-8_49

Automatic generation of conversational behavior for multiple embodied virtual characters : The rules and models behind our system. / Breitfuss, Werner; Prendinger, Helmut; Ishizuka, Mitsuru.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5208 LNAI 2008. p. 472-473 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5208 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Breitfuss, W, Prendinger, H & Ishizuka, M 2008, Automatic generation of conversational behavior for multiple embodied virtual characters: The rules and models behind our system. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 5208 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5208 LNAI, pp. 472-473, 8th International Conference on Intelligent Virtual Agents, IVA 2008, Tokyo, 08/9/1. https://doi.org/10.1007/978-3-540-85483-8_49
Breitfuss W, Prendinger H, Ishizuka M. Automatic generation of conversational behavior for multiple embodied virtual characters: The rules and models behind our system. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5208 LNAI. 2008. p. 472-473. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-540-85483-8_49
Breitfuss, Werner ; Prendinger, Helmut ; Ishizuka, Mitsuru. / Automatic generation of conversational behavior for multiple embodied virtual characters : The rules and models behind our system. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5208 LNAI 2008. pp. 472-473 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{39885dca5a844f6fbaf05edc834a7c22,
title = "Automatic generation of conversational behavior for multiple embodied virtual characters: The rules and models behind our system",
abstract = "In this paper we presented the rules and algorithms we use to automatically generate non-verbal behavior like gestures and gaze for two embodied virtual agents. They allow us to transform a dialogue in text format into an agent behavior script enriched by eye gaze and conversational gesture behavior. The agents' gaze behavior is informed by theories of human face-to-face gaze behavior. Gestures are generated based on the analysis of linguistic and contextual information of the input text. Since all behaviors are generated automatically, our system offers content creators a convenient method to compose multimodal presentations, a task that would otherwise be very cumbersome and time consuming.",
author = "Werner Breitfuss and Helmut Prendinger and Mitsuru Ishizuka",
year = "2008",
doi = "10.1007/978-3-540-85483-8_49",
language = "English",
isbn = "3540854827",
volume = "5208 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "472--473",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Automatic generation of conversational behavior for multiple embodied virtual characters

T2 - The rules and models behind our system

AU - Breitfuss, Werner

AU - Prendinger, Helmut

AU - Ishizuka, Mitsuru

PY - 2008

Y1 - 2008

N2 - In this paper we presented the rules and algorithms we use to automatically generate non-verbal behavior like gestures and gaze for two embodied virtual agents. They allow us to transform a dialogue in text format into an agent behavior script enriched by eye gaze and conversational gesture behavior. The agents' gaze behavior is informed by theories of human face-to-face gaze behavior. Gestures are generated based on the analysis of linguistic and contextual information of the input text. Since all behaviors are generated automatically, our system offers content creators a convenient method to compose multimodal presentations, a task that would otherwise be very cumbersome and time consuming.

AB - In this paper we presented the rules and algorithms we use to automatically generate non-verbal behavior like gestures and gaze for two embodied virtual agents. They allow us to transform a dialogue in text format into an agent behavior script enriched by eye gaze and conversational gesture behavior. The agents' gaze behavior is informed by theories of human face-to-face gaze behavior. Gestures are generated based on the analysis of linguistic and contextual information of the input text. Since all behaviors are generated automatically, our system offers content creators a convenient method to compose multimodal presentations, a task that would otherwise be very cumbersome and time consuming.

UR - http://www.scopus.com/inward/record.url?scp=52149109311&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=52149109311&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-85483-8_49

DO - 10.1007/978-3-540-85483-8_49

M3 - Conference contribution

AN - SCOPUS:52149109311

SN - 3540854827

SN - 9783540854821

VL - 5208 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 472

EP - 473

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -