Development of a comic mark based expressive robotic head adapted to Japanese cultural background

T. Kishi, H. Futaki, Gabriele Trovato, N. Endo, M. Destephe, Sarah Cosentino, K. Hashimoto, Atsuo Takanishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

This paper describes the development of a robotic head that has cartoon facial expression ability with comic marks. For communicating with humans, robots should have expressive facial expression ability for indicating their inner state. Our previous research suggests that robots can express its emotion clearly if it performs facial expressions that are adapted to the cultural background of the communication partner. As a first step, we focus on making expressions for Japanese people. Comic mark is a unique and famous way of emotion expression in Japanese culture. First, we defined facial expressions by combining cartoon-like shape of the facial parts with high emotion recognition rates. Then we asked cartoonists to draw comic marks which they think are effective for emotion expression and find the effective comic marks as 'Cross popping veins' for 'Anger', 'Tear mark' for 'Sadness' and 'Vertical lines' for 'Fear'. Finally we obtained a model expression which has sufficiently high emotion recognition rate from the combination of the facial expression and the comic marks. In order to achieve these expressions, we developed flexible full color LED display matrix module and mechanism that push and pull the sheet for expressing black lines. Results of experimental evaluation shows that the new robotic head has over 90% average emotion recognition rates for each of the six basic emotions. The results with non-Japanese subjects suggests that impression of emotion expression on robotic head changes depending on the cultural background. These findings encourage us in pursuing this concept of designing robots that display emotions that are adapted to cultural background of communication partner.

Original languageEnglish
Title of host publicationIEEE International Conference on Intelligent Robots and Systems
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2608-2613
Number of pages6
ISBN (Print)9781479969340
DOIs
Publication statusPublished - 2014 Oct 31
Event2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014 - Chicago
Duration: 2014 Sep 142014 Sep 18

Other

Other2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014
CityChicago
Period14/9/1414/9/18

Fingerprint

Robotics
Robots
Communication
Light emitting diodes
Display devices
Color

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Cite this

Kishi, T., Futaki, H., Trovato, G., Endo, N., Destephe, M., Cosentino, S., ... Takanishi, A. (2014). Development of a comic mark based expressive robotic head adapted to Japanese cultural background. In IEEE International Conference on Intelligent Robots and Systems (pp. 2608-2613). [6942918] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IROS.2014.6942918

Development of a comic mark based expressive robotic head adapted to Japanese cultural background. / Kishi, T.; Futaki, H.; Trovato, Gabriele; Endo, N.; Destephe, M.; Cosentino, Sarah; Hashimoto, K.; Takanishi, Atsuo.

IEEE International Conference on Intelligent Robots and Systems. Institute of Electrical and Electronics Engineers Inc., 2014. p. 2608-2613 6942918.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kishi, T, Futaki, H, Trovato, G, Endo, N, Destephe, M, Cosentino, S, Hashimoto, K & Takanishi, A 2014, Development of a comic mark based expressive robotic head adapted to Japanese cultural background. in IEEE International Conference on Intelligent Robots and Systems., 6942918, Institute of Electrical and Electronics Engineers Inc., pp. 2608-2613, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014, Chicago, 14/9/14. https://doi.org/10.1109/IROS.2014.6942918
Kishi T, Futaki H, Trovato G, Endo N, Destephe M, Cosentino S et al. Development of a comic mark based expressive robotic head adapted to Japanese cultural background. In IEEE International Conference on Intelligent Robots and Systems. Institute of Electrical and Electronics Engineers Inc. 2014. p. 2608-2613. 6942918 https://doi.org/10.1109/IROS.2014.6942918
Kishi, T. ; Futaki, H. ; Trovato, Gabriele ; Endo, N. ; Destephe, M. ; Cosentino, Sarah ; Hashimoto, K. ; Takanishi, Atsuo. / Development of a comic mark based expressive robotic head adapted to Japanese cultural background. IEEE International Conference on Intelligent Robots and Systems. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 2608-2613
@inproceedings{ec94b5301483486580498f2ccc845301,
title = "Development of a comic mark based expressive robotic head adapted to Japanese cultural background",
abstract = "This paper describes the development of a robotic head that has cartoon facial expression ability with comic marks. For communicating with humans, robots should have expressive facial expression ability for indicating their inner state. Our previous research suggests that robots can express its emotion clearly if it performs facial expressions that are adapted to the cultural background of the communication partner. As a first step, we focus on making expressions for Japanese people. Comic mark is a unique and famous way of emotion expression in Japanese culture. First, we defined facial expressions by combining cartoon-like shape of the facial parts with high emotion recognition rates. Then we asked cartoonists to draw comic marks which they think are effective for emotion expression and find the effective comic marks as 'Cross popping veins' for 'Anger', 'Tear mark' for 'Sadness' and 'Vertical lines' for 'Fear'. Finally we obtained a model expression which has sufficiently high emotion recognition rate from the combination of the facial expression and the comic marks. In order to achieve these expressions, we developed flexible full color LED display matrix module and mechanism that push and pull the sheet for expressing black lines. Results of experimental evaluation shows that the new robotic head has over 90{\%} average emotion recognition rates for each of the six basic emotions. The results with non-Japanese subjects suggests that impression of emotion expression on robotic head changes depending on the cultural background. These findings encourage us in pursuing this concept of designing robots that display emotions that are adapted to cultural background of communication partner.",
author = "T. Kishi and H. Futaki and Gabriele Trovato and N. Endo and M. Destephe and Sarah Cosentino and K. Hashimoto and Atsuo Takanishi",
year = "2014",
month = "10",
day = "31",
doi = "10.1109/IROS.2014.6942918",
language = "English",
isbn = "9781479969340",
pages = "2608--2613",
booktitle = "IEEE International Conference on Intelligent Robots and Systems",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Development of a comic mark based expressive robotic head adapted to Japanese cultural background

AU - Kishi, T.

AU - Futaki, H.

AU - Trovato, Gabriele

AU - Endo, N.

AU - Destephe, M.

AU - Cosentino, Sarah

AU - Hashimoto, K.

AU - Takanishi, Atsuo

PY - 2014/10/31

Y1 - 2014/10/31

N2 - This paper describes the development of a robotic head that has cartoon facial expression ability with comic marks. For communicating with humans, robots should have expressive facial expression ability for indicating their inner state. Our previous research suggests that robots can express its emotion clearly if it performs facial expressions that are adapted to the cultural background of the communication partner. As a first step, we focus on making expressions for Japanese people. Comic mark is a unique and famous way of emotion expression in Japanese culture. First, we defined facial expressions by combining cartoon-like shape of the facial parts with high emotion recognition rates. Then we asked cartoonists to draw comic marks which they think are effective for emotion expression and find the effective comic marks as 'Cross popping veins' for 'Anger', 'Tear mark' for 'Sadness' and 'Vertical lines' for 'Fear'. Finally we obtained a model expression which has sufficiently high emotion recognition rate from the combination of the facial expression and the comic marks. In order to achieve these expressions, we developed flexible full color LED display matrix module and mechanism that push and pull the sheet for expressing black lines. Results of experimental evaluation shows that the new robotic head has over 90% average emotion recognition rates for each of the six basic emotions. The results with non-Japanese subjects suggests that impression of emotion expression on robotic head changes depending on the cultural background. These findings encourage us in pursuing this concept of designing robots that display emotions that are adapted to cultural background of communication partner.

AB - This paper describes the development of a robotic head that has cartoon facial expression ability with comic marks. For communicating with humans, robots should have expressive facial expression ability for indicating their inner state. Our previous research suggests that robots can express its emotion clearly if it performs facial expressions that are adapted to the cultural background of the communication partner. As a first step, we focus on making expressions for Japanese people. Comic mark is a unique and famous way of emotion expression in Japanese culture. First, we defined facial expressions by combining cartoon-like shape of the facial parts with high emotion recognition rates. Then we asked cartoonists to draw comic marks which they think are effective for emotion expression and find the effective comic marks as 'Cross popping veins' for 'Anger', 'Tear mark' for 'Sadness' and 'Vertical lines' for 'Fear'. Finally we obtained a model expression which has sufficiently high emotion recognition rate from the combination of the facial expression and the comic marks. In order to achieve these expressions, we developed flexible full color LED display matrix module and mechanism that push and pull the sheet for expressing black lines. Results of experimental evaluation shows that the new robotic head has over 90% average emotion recognition rates for each of the six basic emotions. The results with non-Japanese subjects suggests that impression of emotion expression on robotic head changes depending on the cultural background. These findings encourage us in pursuing this concept of designing robots that display emotions that are adapted to cultural background of communication partner.

UR - http://www.scopus.com/inward/record.url?scp=84911499803&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84911499803&partnerID=8YFLogxK

U2 - 10.1109/IROS.2014.6942918

DO - 10.1109/IROS.2014.6942918

M3 - Conference contribution

AN - SCOPUS:84911499803

SN - 9781479969340

SP - 2608

EP - 2613

BT - IEEE International Conference on Intelligent Robots and Systems

PB - Institute of Electrical and Electronics Engineers Inc.

ER -