User study on AffectIM, an avatar-based Instant Messaging system employing rule-based affect sensing from text

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

Social interaction among people is an essential part of every society, and a strong foundation for the development and self-actualization of a person. Even in virtual environments we tend to interact in a social way. Our research addresses the tasks of recognition, interpretation, and visualization of affect communicated through text messaging. In order to facilitate sensitive and expressive interaction in computer-mediated communication, we previously introduced a novel syntactical rule-based approach to affect recognition from text. The evaluation of the developed Affect Analysis Model showed promising results regarding its capability to accurately recognize affective information in text from an existing corpus of informal online conversations. To enrich the user's experience in online communication, to make it enjoyable, exciting, and fun, we implemented a web-based Instant Messaging (IM) application, AffectIM, and endowed it with emotional intelligence by integrating the developed Affect Analysis Model. This paper describes the findings of a twenty-person study conducted with our AffectIM system. The results of the study indicate that our IM system with automatic emotion recognition function can achieve a level of affective intelligence (system is successful at conveying the user's feelings, avatar expression is appropriate) that is comparable to "gold standard", where users select the label of the conveyed emotion manually.

Original languageEnglish
Pages (from-to)432-450
Number of pages19
JournalInternational Journal of Human Computer Studies
Volume68
Issue number7
DOIs
Publication statusPublished - 2010 Jul
Externally publishedYes

Fingerprint

Knowledge based systems
Text messaging
model analysis
Communication
Conveying
emotion
Virtual reality
Labels
emotional intelligence
Visualization
human being
gold standard
computer-mediated communication
interaction
visualization
intelligence
conversation
interpretation
communication
evaluation

Keywords

  • Affect sensing from text
  • Affective user interface
  • Avatar-based Instant Messaging
  • User study

ASJC Scopus subject areas

  • Hardware and Architecture
  • Engineering(all)
  • Software
  • Human-Computer Interaction
  • Human Factors and Ergonomics
  • Education

Cite this

User study on AffectIM, an avatar-based Instant Messaging system employing rule-based affect sensing from text. / Neviarouskaya, Alena; Prendinger, Helmut; Ishizuka, Mitsuru.

In: International Journal of Human Computer Studies, Vol. 68, No. 7, 07.2010, p. 432-450.

Research output: Contribution to journalArticle

Neviarouskaya, Alena ; Prendinger, Helmut ; Ishizuka, Mitsuru. / User study on AffectIM, an avatar-based Instant Messaging system employing rule-based affect sensing from text. In: International Journal of Human Computer Studies. 2010 ; Vol. 68, No. 7. pp. 432-450.
@article{5772d14d098e4d2aa812bdb0d331a902,
title = "User study on AffectIM, an avatar-based Instant Messaging system employing rule-based affect sensing from text",
abstract = "Social interaction among people is an essential part of every society, and a strong foundation for the development and self-actualization of a person. Even in virtual environments we tend to interact in a social way. Our research addresses the tasks of recognition, interpretation, and visualization of affect communicated through text messaging. In order to facilitate sensitive and expressive interaction in computer-mediated communication, we previously introduced a novel syntactical rule-based approach to affect recognition from text. The evaluation of the developed Affect Analysis Model showed promising results regarding its capability to accurately recognize affective information in text from an existing corpus of informal online conversations. To enrich the user's experience in online communication, to make it enjoyable, exciting, and fun, we implemented a web-based Instant Messaging (IM) application, AffectIM, and endowed it with emotional intelligence by integrating the developed Affect Analysis Model. This paper describes the findings of a twenty-person study conducted with our AffectIM system. The results of the study indicate that our IM system with automatic emotion recognition function can achieve a level of affective intelligence (system is successful at conveying the user's feelings, avatar expression is appropriate) that is comparable to {"}gold standard{"}, where users select the label of the conveyed emotion manually.",
keywords = "Affect sensing from text, Affective user interface, Avatar-based Instant Messaging, User study",
author = "Alena Neviarouskaya and Helmut Prendinger and Mitsuru Ishizuka",
year = "2010",
month = "7",
doi = "10.1016/j.ijhcs.2010.02.003",
language = "English",
volume = "68",
pages = "432--450",
journal = "International Journal of Human Computer Studies",
issn = "1071-5819",
publisher = "Academic Press Inc.",
number = "7",

}

TY - JOUR

T1 - User study on AffectIM, an avatar-based Instant Messaging system employing rule-based affect sensing from text

AU - Neviarouskaya, Alena

AU - Prendinger, Helmut

AU - Ishizuka, Mitsuru

PY - 2010/7

Y1 - 2010/7

N2 - Social interaction among people is an essential part of every society, and a strong foundation for the development and self-actualization of a person. Even in virtual environments we tend to interact in a social way. Our research addresses the tasks of recognition, interpretation, and visualization of affect communicated through text messaging. In order to facilitate sensitive and expressive interaction in computer-mediated communication, we previously introduced a novel syntactical rule-based approach to affect recognition from text. The evaluation of the developed Affect Analysis Model showed promising results regarding its capability to accurately recognize affective information in text from an existing corpus of informal online conversations. To enrich the user's experience in online communication, to make it enjoyable, exciting, and fun, we implemented a web-based Instant Messaging (IM) application, AffectIM, and endowed it with emotional intelligence by integrating the developed Affect Analysis Model. This paper describes the findings of a twenty-person study conducted with our AffectIM system. The results of the study indicate that our IM system with automatic emotion recognition function can achieve a level of affective intelligence (system is successful at conveying the user's feelings, avatar expression is appropriate) that is comparable to "gold standard", where users select the label of the conveyed emotion manually.

AB - Social interaction among people is an essential part of every society, and a strong foundation for the development and self-actualization of a person. Even in virtual environments we tend to interact in a social way. Our research addresses the tasks of recognition, interpretation, and visualization of affect communicated through text messaging. In order to facilitate sensitive and expressive interaction in computer-mediated communication, we previously introduced a novel syntactical rule-based approach to affect recognition from text. The evaluation of the developed Affect Analysis Model showed promising results regarding its capability to accurately recognize affective information in text from an existing corpus of informal online conversations. To enrich the user's experience in online communication, to make it enjoyable, exciting, and fun, we implemented a web-based Instant Messaging (IM) application, AffectIM, and endowed it with emotional intelligence by integrating the developed Affect Analysis Model. This paper describes the findings of a twenty-person study conducted with our AffectIM system. The results of the study indicate that our IM system with automatic emotion recognition function can achieve a level of affective intelligence (system is successful at conveying the user's feelings, avatar expression is appropriate) that is comparable to "gold standard", where users select the label of the conveyed emotion manually.

KW - Affect sensing from text

KW - Affective user interface

KW - Avatar-based Instant Messaging

KW - User study

UR - http://www.scopus.com/inward/record.url?scp=77950935466&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77950935466&partnerID=8YFLogxK

U2 - 10.1016/j.ijhcs.2010.02.003

DO - 10.1016/j.ijhcs.2010.02.003

M3 - Article

AN - SCOPUS:77950935466

VL - 68

SP - 432

EP - 450

JO - International Journal of Human Computer Studies

JF - International Journal of Human Computer Studies

SN - 1071-5819

IS - 7

ER -