Group emotion recognition strategies for entertainment robots

Sarah Cosentino, Estelle I.S. Randria, Jia Yeu Lin, Thomas Pellegrini, Salvatore Sessa, Atsuo Takanishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, a system to determine the emotion of a group of people via facial expression analysis is proposed for the Waseda Entertainment Robots. General models and standard methods for emotion definition and recognition are briefly described, as well as strategies for computing the group global emotion, knowing the individual emotions of group members. This work is based on Ekman's extended 'Big Six' emotional model, popular in Computer Science and Affective Computing. Emotion recognition via facial expression analysis is performed with a cloud-computing based solution, using Microsoft Azure Cognitive services. First, the performances of both the Face API to detect faces, and Emotion API, to compute emotion via face expression analysis, are tested. After that, a solution to compute the emotion of a group of people has been implemented and its performances compared to human perceptions. This work presents concepts and strategies which can be generalized for applications within the scope of assistive robotics and, more broadly, affective computing, wherever it will be necessary to determine the emotion of a group of people.

Original languageEnglish
Title of host publication2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages813-818
Number of pages6
ISBN (Electronic)9781538680940
DOIs
Publication statusPublished - 2018 Dec 27
Event2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018 - Madrid, Spain
Duration: 2018 Oct 12018 Oct 5

Publication series

NameIEEE International Conference on Intelligent Robots and Systems
ISSN (Print)2153-0858
ISSN (Electronic)2153-0866

Conference

Conference2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018
CountrySpain
CityMadrid
Period18/10/118/10/5

Fingerprint

Application programming interfaces (API)
Robots
Cloud computing
Computer science
Robotics

Keywords

  • assistive robotics
  • emotion recognition
  • entertainment robot
  • humanoid robot

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Cite this

Cosentino, S., Randria, E. I. S., Lin, J. Y., Pellegrini, T., Sessa, S., & Takanishi, A. (2018). Group emotion recognition strategies for entertainment robots. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018 (pp. 813-818). [8593503] (IEEE International Conference on Intelligent Robots and Systems). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IROS.2018.8593503

Group emotion recognition strategies for entertainment robots. / Cosentino, Sarah; Randria, Estelle I.S.; Lin, Jia Yeu; Pellegrini, Thomas; Sessa, Salvatore; Takanishi, Atsuo.

2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 813-818 8593503 (IEEE International Conference on Intelligent Robots and Systems).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cosentino, S, Randria, EIS, Lin, JY, Pellegrini, T, Sessa, S & Takanishi, A 2018, Group emotion recognition strategies for entertainment robots. in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018., 8593503, IEEE International Conference on Intelligent Robots and Systems, Institute of Electrical and Electronics Engineers Inc., pp. 813-818, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018, Madrid, Spain, 18/10/1. https://doi.org/10.1109/IROS.2018.8593503
Cosentino S, Randria EIS, Lin JY, Pellegrini T, Sessa S, Takanishi A. Group emotion recognition strategies for entertainment robots. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 813-818. 8593503. (IEEE International Conference on Intelligent Robots and Systems). https://doi.org/10.1109/IROS.2018.8593503
Cosentino, Sarah ; Randria, Estelle I.S. ; Lin, Jia Yeu ; Pellegrini, Thomas ; Sessa, Salvatore ; Takanishi, Atsuo. / Group emotion recognition strategies for entertainment robots. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 813-818 (IEEE International Conference on Intelligent Robots and Systems).
@inproceedings{b7062100bb3045789f3d4fc8e4d997d3,
title = "Group emotion recognition strategies for entertainment robots",
abstract = "In this paper, a system to determine the emotion of a group of people via facial expression analysis is proposed for the Waseda Entertainment Robots. General models and standard methods for emotion definition and recognition are briefly described, as well as strategies for computing the group global emotion, knowing the individual emotions of group members. This work is based on Ekman's extended 'Big Six' emotional model, popular in Computer Science and Affective Computing. Emotion recognition via facial expression analysis is performed with a cloud-computing based solution, using Microsoft Azure Cognitive services. First, the performances of both the Face API to detect faces, and Emotion API, to compute emotion via face expression analysis, are tested. After that, a solution to compute the emotion of a group of people has been implemented and its performances compared to human perceptions. This work presents concepts and strategies which can be generalized for applications within the scope of assistive robotics and, more broadly, affective computing, wherever it will be necessary to determine the emotion of a group of people.",
keywords = "assistive robotics, emotion recognition, entertainment robot, humanoid robot",
author = "Sarah Cosentino and Randria, {Estelle I.S.} and Lin, {Jia Yeu} and Thomas Pellegrini and Salvatore Sessa and Atsuo Takanishi",
year = "2018",
month = "12",
day = "27",
doi = "10.1109/IROS.2018.8593503",
language = "English",
series = "IEEE International Conference on Intelligent Robots and Systems",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "813--818",
booktitle = "2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018",

}

TY - GEN

T1 - Group emotion recognition strategies for entertainment robots

AU - Cosentino, Sarah

AU - Randria, Estelle I.S.

AU - Lin, Jia Yeu

AU - Pellegrini, Thomas

AU - Sessa, Salvatore

AU - Takanishi, Atsuo

PY - 2018/12/27

Y1 - 2018/12/27

N2 - In this paper, a system to determine the emotion of a group of people via facial expression analysis is proposed for the Waseda Entertainment Robots. General models and standard methods for emotion definition and recognition are briefly described, as well as strategies for computing the group global emotion, knowing the individual emotions of group members. This work is based on Ekman's extended 'Big Six' emotional model, popular in Computer Science and Affective Computing. Emotion recognition via facial expression analysis is performed with a cloud-computing based solution, using Microsoft Azure Cognitive services. First, the performances of both the Face API to detect faces, and Emotion API, to compute emotion via face expression analysis, are tested. After that, a solution to compute the emotion of a group of people has been implemented and its performances compared to human perceptions. This work presents concepts and strategies which can be generalized for applications within the scope of assistive robotics and, more broadly, affective computing, wherever it will be necessary to determine the emotion of a group of people.

AB - In this paper, a system to determine the emotion of a group of people via facial expression analysis is proposed for the Waseda Entertainment Robots. General models and standard methods for emotion definition and recognition are briefly described, as well as strategies for computing the group global emotion, knowing the individual emotions of group members. This work is based on Ekman's extended 'Big Six' emotional model, popular in Computer Science and Affective Computing. Emotion recognition via facial expression analysis is performed with a cloud-computing based solution, using Microsoft Azure Cognitive services. First, the performances of both the Face API to detect faces, and Emotion API, to compute emotion via face expression analysis, are tested. After that, a solution to compute the emotion of a group of people has been implemented and its performances compared to human perceptions. This work presents concepts and strategies which can be generalized for applications within the scope of assistive robotics and, more broadly, affective computing, wherever it will be necessary to determine the emotion of a group of people.

KW - assistive robotics

KW - emotion recognition

KW - entertainment robot

KW - humanoid robot

UR - http://www.scopus.com/inward/record.url?scp=85062984749&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062984749&partnerID=8YFLogxK

U2 - 10.1109/IROS.2018.8593503

DO - 10.1109/IROS.2018.8593503

M3 - Conference contribution

AN - SCOPUS:85062984749

T3 - IEEE International Conference on Intelligent Robots and Systems

SP - 813

EP - 818

BT - 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -