Cross-Cultural Perspectives on Emotion Expressive Humanoid Robotic Head

Recognition of Facial Expressions and Symbols

Gabriele Trovato, Tatsuhiro Kishi, Nobutsuna Endo, Massimiliano Zecca, Kenji Hashimoto, Atsuo Takanishi

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Emotion display through facial expressions is an important channel of communication. However, between humans there are differences in the way a meaning to facial cues is assigned, depending on the background culture. This leads to a gap in recognition rates of expressions: this problem is present when displaying a robotic face too, as a robot's facial expression recognition is often hampered by a cultural divide, and poor scores of recognition rate may lead to poor acceptance and interaction. It would be desirable if robots could switch their output facial configuration flexibly, adapting to different cultural backgrounds. To achieve this, we made a generation system that produces facial expressions and applied it to the 24 degrees of freedom head of the humanoid social robot KOBIAN-R, and thanks to the work of illustrators and cartoonists, the system can generate two versions of the same expression, in order to be easily recognisable by both Japanese and Western subjects. As a tool for making recognition easier, the display of Japanese comic symbols on the robotic face has also been introduced and evaluated. In this work, we conducted a cross-cultural study aimed at assessing this gap in recognition and finding solutions for it. The investigation was extended to Egyptian subjects too, as a sample of another different culture. Results confirmed the differences in recognition rates, the effectiveness of customising expressions, and the usefulness of symbols display, thereby suggesting that this approach might be valuable for robots that in the future will interact in a multi-cultural environment.

Original languageEnglish
Pages (from-to)515-527
Number of pages13
JournalInternational Journal of Social Robotics
Volume5
Issue number4
DOIs
Publication statusPublished - 2013 Nov

Fingerprint

Robotics
Robots
Display devices
Switches
Communication

Keywords

  • Communication
  • Culture
  • Emotion expression
  • Facial expressions
  • Human-Robot Interaction

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Cross-Cultural Perspectives on Emotion Expressive Humanoid Robotic Head : Recognition of Facial Expressions and Symbols. / Trovato, Gabriele; Kishi, Tatsuhiro; Endo, Nobutsuna; Zecca, Massimiliano; Hashimoto, Kenji; Takanishi, Atsuo.

In: International Journal of Social Robotics, Vol. 5, No. 4, 11.2013, p. 515-527.

Research output: Contribution to journalArticle

@article{6f84eb4dee344185ac888838ec82368d,
title = "Cross-Cultural Perspectives on Emotion Expressive Humanoid Robotic Head: Recognition of Facial Expressions and Symbols",
abstract = "Emotion display through facial expressions is an important channel of communication. However, between humans there are differences in the way a meaning to facial cues is assigned, depending on the background culture. This leads to a gap in recognition rates of expressions: this problem is present when displaying a robotic face too, as a robot's facial expression recognition is often hampered by a cultural divide, and poor scores of recognition rate may lead to poor acceptance and interaction. It would be desirable if robots could switch their output facial configuration flexibly, adapting to different cultural backgrounds. To achieve this, we made a generation system that produces facial expressions and applied it to the 24 degrees of freedom head of the humanoid social robot KOBIAN-R, and thanks to the work of illustrators and cartoonists, the system can generate two versions of the same expression, in order to be easily recognisable by both Japanese and Western subjects. As a tool for making recognition easier, the display of Japanese comic symbols on the robotic face has also been introduced and evaluated. In this work, we conducted a cross-cultural study aimed at assessing this gap in recognition and finding solutions for it. The investigation was extended to Egyptian subjects too, as a sample of another different culture. Results confirmed the differences in recognition rates, the effectiveness of customising expressions, and the usefulness of symbols display, thereby suggesting that this approach might be valuable for robots that in the future will interact in a multi-cultural environment.",
keywords = "Communication, Culture, Emotion expression, Facial expressions, Human-Robot Interaction",
author = "Gabriele Trovato and Tatsuhiro Kishi and Nobutsuna Endo and Massimiliano Zecca and Kenji Hashimoto and Atsuo Takanishi",
year = "2013",
month = "11",
doi = "10.1007/s12369-013-0213-z",
language = "English",
volume = "5",
pages = "515--527",
journal = "International Journal of Social Robotics",
issn = "1875-4791",
publisher = "Springer Verlag",
number = "4",

}

TY - JOUR

T1 - Cross-Cultural Perspectives on Emotion Expressive Humanoid Robotic Head

T2 - Recognition of Facial Expressions and Symbols

AU - Trovato, Gabriele

AU - Kishi, Tatsuhiro

AU - Endo, Nobutsuna

AU - Zecca, Massimiliano

AU - Hashimoto, Kenji

AU - Takanishi, Atsuo

PY - 2013/11

Y1 - 2013/11

N2 - Emotion display through facial expressions is an important channel of communication. However, between humans there are differences in the way a meaning to facial cues is assigned, depending on the background culture. This leads to a gap in recognition rates of expressions: this problem is present when displaying a robotic face too, as a robot's facial expression recognition is often hampered by a cultural divide, and poor scores of recognition rate may lead to poor acceptance and interaction. It would be desirable if robots could switch their output facial configuration flexibly, adapting to different cultural backgrounds. To achieve this, we made a generation system that produces facial expressions and applied it to the 24 degrees of freedom head of the humanoid social robot KOBIAN-R, and thanks to the work of illustrators and cartoonists, the system can generate two versions of the same expression, in order to be easily recognisable by both Japanese and Western subjects. As a tool for making recognition easier, the display of Japanese comic symbols on the robotic face has also been introduced and evaluated. In this work, we conducted a cross-cultural study aimed at assessing this gap in recognition and finding solutions for it. The investigation was extended to Egyptian subjects too, as a sample of another different culture. Results confirmed the differences in recognition rates, the effectiveness of customising expressions, and the usefulness of symbols display, thereby suggesting that this approach might be valuable for robots that in the future will interact in a multi-cultural environment.

AB - Emotion display through facial expressions is an important channel of communication. However, between humans there are differences in the way a meaning to facial cues is assigned, depending on the background culture. This leads to a gap in recognition rates of expressions: this problem is present when displaying a robotic face too, as a robot's facial expression recognition is often hampered by a cultural divide, and poor scores of recognition rate may lead to poor acceptance and interaction. It would be desirable if robots could switch their output facial configuration flexibly, adapting to different cultural backgrounds. To achieve this, we made a generation system that produces facial expressions and applied it to the 24 degrees of freedom head of the humanoid social robot KOBIAN-R, and thanks to the work of illustrators and cartoonists, the system can generate two versions of the same expression, in order to be easily recognisable by both Japanese and Western subjects. As a tool for making recognition easier, the display of Japanese comic symbols on the robotic face has also been introduced and evaluated. In this work, we conducted a cross-cultural study aimed at assessing this gap in recognition and finding solutions for it. The investigation was extended to Egyptian subjects too, as a sample of another different culture. Results confirmed the differences in recognition rates, the effectiveness of customising expressions, and the usefulness of symbols display, thereby suggesting that this approach might be valuable for robots that in the future will interact in a multi-cultural environment.

KW - Communication

KW - Culture

KW - Emotion expression

KW - Facial expressions

KW - Human-Robot Interaction

UR - http://www.scopus.com/inward/record.url?scp=84886790451&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84886790451&partnerID=8YFLogxK

U2 - 10.1007/s12369-013-0213-z

DO - 10.1007/s12369-013-0213-z

M3 - Article

VL - 5

SP - 515

EP - 527

JO - International Journal of Social Robotics

JF - International Journal of Social Robotics

SN - 1875-4791

IS - 4

ER -