Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game

Helmut Prendinger, Junichiro Mori, Mitsuru Ishizuka

Research output: Contribution to journalArticle

79 Citations (Scopus)

Abstract

The aim of the experimental study described in this article is to investigate the effect of a life-like character with subtle expressivity on the affective state of users. The character acts as a quizmaster in the context of a mathematical game. This application was chosen as a simple, and for the sake of the experiment, highly controllable, instance of human-computer interfaces and software. Subtle expressivity refers to the character's affective response to the user's performance by emulating multimodal human-human communicative behavior such as different body gestures and varying linguistic style. The impact of em-pathic behavior, which is a special form of affective response, is examined by deliberately frustrating the user during the game progress. There are two novel aspects in this investigation. First, we employ an animated interface agent to address the affective state of users rather than a text-based interface, which has been used in related research. Second, while previous empirical studies rely on questionnaires to evaluate the effect of life-like characters, we utilize physiological information of users (in addition to questionnaire data) in order to precisely associate the occurrence of interface events with users' autonomic nervous system activity. The results of our study indicate that empathic character response can significantly decrease user stress and that affective behavior may have a positive effect on users' perception of the difficulty of a task.

Original languageEnglish
Pages (from-to)231-245
Number of pages15
JournalInternational Journal of Human Computer Studies
Volume62
Issue number2
DOIs
Publication statusPublished - 2005 Feb
Externally publishedYes

Fingerprint

Physiology
physiology
Neurology
Linguistics
Interfaces (computer)
Gestures
Experiments
Autonomic Nervous System
Software
Research
questionnaire
Surveys and Questionnaires
linguistics
event
experiment
performance

Keywords

  • Affective behavior
  • Empathy
  • Evaluation
  • Life-like characters
  • Physiological user information

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Experimental and Cognitive Psychology

Cite this

Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game. / Prendinger, Helmut; Mori, Junichiro; Ishizuka, Mitsuru.

In: International Journal of Human Computer Studies, Vol. 62, No. 2, 02.2005, p. 231-245.

Research output: Contribution to journalArticle

Prendinger, Helmut ; Mori, Junichiro ; Ishizuka, Mitsuru. / Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game. In: International Journal of Human Computer Studies. 2005 ; Vol. 62, No. 2. pp. 231-245.
@article{c1397ce01ae6432a87c2c67117f25566,
title = "Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game",
abstract = "The aim of the experimental study described in this article is to investigate the effect of a life-like character with subtle expressivity on the affective state of users. The character acts as a quizmaster in the context of a mathematical game. This application was chosen as a simple, and for the sake of the experiment, highly controllable, instance of human-computer interfaces and software. Subtle expressivity refers to the character's affective response to the user's performance by emulating multimodal human-human communicative behavior such as different body gestures and varying linguistic style. The impact of em-pathic behavior, which is a special form of affective response, is examined by deliberately frustrating the user during the game progress. There are two novel aspects in this investigation. First, we employ an animated interface agent to address the affective state of users rather than a text-based interface, which has been used in related research. Second, while previous empirical studies rely on questionnaires to evaluate the effect of life-like characters, we utilize physiological information of users (in addition to questionnaire data) in order to precisely associate the occurrence of interface events with users' autonomic nervous system activity. The results of our study indicate that empathic character response can significantly decrease user stress and that affective behavior may have a positive effect on users' perception of the difficulty of a task.",
keywords = "Affective behavior, Empathy, Evaluation, Life-like characters, Physiological user information",
author = "Helmut Prendinger and Junichiro Mori and Mitsuru Ishizuka",
year = "2005",
month = "2",
doi = "10.1016/j.ijhcs.2004.11.009",
language = "English",
volume = "62",
pages = "231--245",
journal = "International Journal of Human Computer Studies",
issn = "1071-5819",
publisher = "Academic Press Inc.",
number = "2",

}

TY - JOUR

T1 - Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game

AU - Prendinger, Helmut

AU - Mori, Junichiro

AU - Ishizuka, Mitsuru

PY - 2005/2

Y1 - 2005/2

N2 - The aim of the experimental study described in this article is to investigate the effect of a life-like character with subtle expressivity on the affective state of users. The character acts as a quizmaster in the context of a mathematical game. This application was chosen as a simple, and for the sake of the experiment, highly controllable, instance of human-computer interfaces and software. Subtle expressivity refers to the character's affective response to the user's performance by emulating multimodal human-human communicative behavior such as different body gestures and varying linguistic style. The impact of em-pathic behavior, which is a special form of affective response, is examined by deliberately frustrating the user during the game progress. There are two novel aspects in this investigation. First, we employ an animated interface agent to address the affective state of users rather than a text-based interface, which has been used in related research. Second, while previous empirical studies rely on questionnaires to evaluate the effect of life-like characters, we utilize physiological information of users (in addition to questionnaire data) in order to precisely associate the occurrence of interface events with users' autonomic nervous system activity. The results of our study indicate that empathic character response can significantly decrease user stress and that affective behavior may have a positive effect on users' perception of the difficulty of a task.

AB - The aim of the experimental study described in this article is to investigate the effect of a life-like character with subtle expressivity on the affective state of users. The character acts as a quizmaster in the context of a mathematical game. This application was chosen as a simple, and for the sake of the experiment, highly controllable, instance of human-computer interfaces and software. Subtle expressivity refers to the character's affective response to the user's performance by emulating multimodal human-human communicative behavior such as different body gestures and varying linguistic style. The impact of em-pathic behavior, which is a special form of affective response, is examined by deliberately frustrating the user during the game progress. There are two novel aspects in this investigation. First, we employ an animated interface agent to address the affective state of users rather than a text-based interface, which has been used in related research. Second, while previous empirical studies rely on questionnaires to evaluate the effect of life-like characters, we utilize physiological information of users (in addition to questionnaire data) in order to precisely associate the occurrence of interface events with users' autonomic nervous system activity. The results of our study indicate that empathic character response can significantly decrease user stress and that affective behavior may have a positive effect on users' perception of the difficulty of a task.

KW - Affective behavior

KW - Empathy

KW - Evaluation

KW - Life-like characters

KW - Physiological user information

UR - http://www.scopus.com/inward/record.url?scp=13444283583&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=13444283583&partnerID=8YFLogxK

U2 - 10.1016/j.ijhcs.2004.11.009

DO - 10.1016/j.ijhcs.2004.11.009

M3 - Article

AN - SCOPUS:13444283583

VL - 62

SP - 231

EP - 245

JO - International Journal of Human Computer Studies

JF - International Journal of Human Computer Studies

SN - 1071-5819

IS - 2

ER -