Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study

Werner Breitfuss, Ielka Van Der Sluis, Saturnino Luz, Helmut Prendinger, Mitsuru Ishizuka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages181-187
Number of pages7
Volume5773 LNAI
DOIs
Publication statusPublished - 2009
Externally publishedYes
Event9th International Conference on Intelligent Virtual Agents, IVA 2009 - Amsterdam
Duration: 2009 Sep 142009 Sep 16

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5773 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other9th International Conference on Intelligent Virtual Agents, IVA 2009
CityAmsterdam
Period09/9/1409/9/16

Fingerprint

Virtual Worlds
Second Life
Evaluation Method
Questionnaire
Output
Evaluation

Keywords

  • Automatic Behavior Generation
  • Embodied Conversational Agents
  • Generation of Multimodal Referring Expressions
  • Virtual Worlds

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Breitfuss, W., Van Der Sluis, I., Luz, S., Prendinger, H., & Ishizuka, M. (2009). Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 5773 LNAI, pp. 181-187). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5773 LNAI). https://doi.org/10.1007/978-3-642-04380-2_22

Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world : A pilot study. / Breitfuss, Werner; Van Der Sluis, Ielka; Luz, Saturnino; Prendinger, Helmut; Ishizuka, Mitsuru.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5773 LNAI 2009. p. 181-187 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5773 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Breitfuss, W, Van Der Sluis, I, Luz, S, Prendinger, H & Ishizuka, M 2009, Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 5773 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5773 LNAI, pp. 181-187, 9th International Conference on Intelligent Virtual Agents, IVA 2009, Amsterdam, 09/9/14. https://doi.org/10.1007/978-3-642-04380-2_22
Breitfuss W, Van Der Sluis I, Luz S, Prendinger H, Ishizuka M. Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5773 LNAI. 2009. p. 181-187. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-04380-2_22
Breitfuss, Werner ; Van Der Sluis, Ielka ; Luz, Saturnino ; Prendinger, Helmut ; Ishizuka, Mitsuru. / Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world : A pilot study. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5773 LNAI 2009. pp. 181-187 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{bd2e7693b30246f5bf8f2116dae4b93d,
title = "Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study",
abstract = "This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.",
keywords = "Automatic Behavior Generation, Embodied Conversational Agents, Generation of Multimodal Referring Expressions, Virtual Worlds",
author = "Werner Breitfuss and {Van Der Sluis}, Ielka and Saturnino Luz and Helmut Prendinger and Mitsuru Ishizuka",
year = "2009",
doi = "10.1007/978-3-642-04380-2_22",
language = "English",
isbn = "3642043798",
volume = "5773 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "181--187",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world

T2 - A pilot study

AU - Breitfuss, Werner

AU - Van Der Sluis, Ielka

AU - Luz, Saturnino

AU - Prendinger, Helmut

AU - Ishizuka, Mitsuru

PY - 2009

Y1 - 2009

N2 - This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.

AB - This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.

KW - Automatic Behavior Generation

KW - Embodied Conversational Agents

KW - Generation of Multimodal Referring Expressions

KW - Virtual Worlds

UR - http://www.scopus.com/inward/record.url?scp=70350409675&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350409675&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-04380-2_22

DO - 10.1007/978-3-642-04380-2_22

M3 - Conference contribution

AN - SCOPUS:70350409675

SN - 3642043798

SN - 9783642043796

VL - 5773 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 181

EP - 187

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -