A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder

Yean Han; Yuya Nishio; Yi Hsiang Ma; Chiaki Oshiyama; Jia Yeu Lin; Atsuo Takanishi; Sarah Cosentino

doi:10.1109/ICAwST.2018.8517228

A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder

Yean Han, Yuya Nishio, Yi Hsiang Ma, Chiaki Oshiyama, Jia Yeu Lin, Atsuo Takanishi, Sarah Cosentino

Global Center for Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Waseda Anthropomorphic Saxophonist No.5 (WAS-5) will be used in the music therapy of subjects with Spectrum Disorder (ASD). The impairment to recognize facial expression by ASD in other people causes problems when interacting with other people. WAS-5 will have a protocol to train the subjects to react with specific action to specific music then transfer that correlation to the expressions made by WAS5 through classical conditioning to differentiate expressions. This research has done a preliminary experiment with a mock program of the training program on normal people with positive effects. To effectively ensure subject fully perceive the facial expression of WAS-5, a gaze detection is also being developed using OpenCV and a USB camera. This research aims to improve the social skills of ASD subjects to better interact with other people. Further experiments with ASD subjects will be done with hardware upgrade.

Original language	English
Title of host publication	2018 9th International Conference on Awareness Science and Technology, iCAST 2018
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	179-184
Number of pages	6
ISBN (Electronic)	9781538658260
DOIs	https://doi.org/10.1109/ICAwST.2018.8517228
Publication status	Published - 2018 Oct 31
Event	9th International Conference on Awareness Science and Technology, iCAST 2018 - Fukuoka, Japan Duration: 2018 Sep 19 → 2018 Sep 21

Other

Other	9th International Conference on Awareness Science and Technology, iCAST 2018
Country	Japan
City	Fukuoka
Period	18/9/19 → 18/9/21

Fingerprint

Keywords

autism
behaviour conditioning
child care
humanoid robot
music robot
music therapy
social skill

ASJC Scopus subject areas

Computer Networks and Communications
Human-Computer Interaction
Information Systems and Management
Experimental and Cognitive Psychology
Social Psychology
Communication

Cite this

Han, Y., Nishio, Y., Ma, Y. H., Oshiyama, C., Lin, J. Y., Takanishi, A., & Cosentino, S. (2018). A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. In 2018 9th International Conference on Awareness Science and Technology, iCAST 2018 (pp. 179-184). [8517228] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICAwST.2018.8517228

A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. / Han, Yean; Nishio, Yuya; Ma, Yi Hsiang; Oshiyama, Chiaki; Lin, Jia Yeu; Takanishi, Atsuo ; Cosentino, Sarah.

2018 9th International Conference on Awareness Science and Technology, iCAST 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 179-184 8517228.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Han, Y, Nishio, Y, Ma, YH, Oshiyama, C, Lin, JY, Takanishi, A & Cosentino, S 2018, A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. in 2018 9th International Conference on Awareness Science and Technology, iCAST 2018., 8517228, Institute of Electrical and Electronics Engineers Inc., pp. 179-184, 9th International Conference on Awareness Science and Technology, iCAST 2018, Fukuoka, Japan, 18/9/19. https://doi.org/10.1109/ICAwST.2018.8517228

Han Y, Nishio Y, Ma YH, Oshiyama C, Lin JY, Takanishi A et al. A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. In 2018 9th International Conference on Awareness Science and Technology, iCAST 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 179-184. 8517228 https://doi.org/10.1109/ICAwST.2018.8517228

Han, Yean ; Nishio, Yuya ; Ma, Yi Hsiang ; Oshiyama, Chiaki ; Lin, Jia Yeu ; Takanishi, Atsuo ; Cosentino, Sarah. / A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. 2018 9th International Conference on Awareness Science and Technology, iCAST 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 179-184

@inproceedings{a430214b7cbd4f2a92cd2748d2cfc07b,

title = "A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder",

abstract = "Waseda Anthropomorphic Saxophonist No.5 (WAS-5) will be used in the music therapy of subjects with Spectrum Disorder (ASD). The impairment to recognize facial expression by ASD in other people causes problems when interacting with other people. WAS-5 will have a protocol to train the subjects to react with specific action to specific music then transfer that correlation to the expressions made by WAS5 through classical conditioning to differentiate expressions. This research has done a preliminary experiment with a mock program of the training program on normal people with positive effects. To effectively ensure subject fully perceive the facial expression of WAS-5, a gaze detection is also being developed using OpenCV and a USB camera. This research aims to improve the social skills of ASD subjects to better interact with other people. Further experiments with ASD subjects will be done with hardware upgrade.",

keywords = "autism, behaviour conditioning, child care, humanoid robot, music robot, music therapy, social skill",

author = "Yean Han and Yuya Nishio and Ma, {Yi Hsiang} and Chiaki Oshiyama and Lin, {Jia Yeu} and Atsuo Takanishi and Sarah Cosentino",

year = "2018",

month = oct

day = "31",

doi = "10.1109/ICAwST.2018.8517228",

language = "English",

pages = "179--184",

booktitle = "2018 9th International Conference on Awareness Science and Technology, iCAST 2018",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "9th International Conference on Awareness Science and Technology, iCAST 2018 ; Conference date: 19-09-2018 Through 21-09-2018",

}

TY - GEN

T1 - A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder

AU - Han, Yean

AU - Nishio, Yuya

AU - Ma, Yi Hsiang

AU - Oshiyama, Chiaki

AU - Lin, Jia Yeu

AU - Takanishi, Atsuo

AU - Cosentino, Sarah

PY - 2018/10/31

Y1 - 2018/10/31

N2 - Waseda Anthropomorphic Saxophonist No.5 (WAS-5) will be used in the music therapy of subjects with Spectrum Disorder (ASD). The impairment to recognize facial expression by ASD in other people causes problems when interacting with other people. WAS-5 will have a protocol to train the subjects to react with specific action to specific music then transfer that correlation to the expressions made by WAS5 through classical conditioning to differentiate expressions. This research has done a preliminary experiment with a mock program of the training program on normal people with positive effects. To effectively ensure subject fully perceive the facial expression of WAS-5, a gaze detection is also being developed using OpenCV and a USB camera. This research aims to improve the social skills of ASD subjects to better interact with other people. Further experiments with ASD subjects will be done with hardware upgrade.

AB - Waseda Anthropomorphic Saxophonist No.5 (WAS-5) will be used in the music therapy of subjects with Spectrum Disorder (ASD). The impairment to recognize facial expression by ASD in other people causes problems when interacting with other people. WAS-5 will have a protocol to train the subjects to react with specific action to specific music then transfer that correlation to the expressions made by WAS5 through classical conditioning to differentiate expressions. This research has done a preliminary experiment with a mock program of the training program on normal people with positive effects. To effectively ensure subject fully perceive the facial expression of WAS-5, a gaze detection is also being developed using OpenCV and a USB camera. This research aims to improve the social skills of ASD subjects to better interact with other people. Further experiments with ASD subjects will be done with hardware upgrade.

KW - autism

KW - behaviour conditioning

KW - child care

KW - humanoid robot

KW - music robot

KW - music therapy

KW - social skill

UR - http://www.scopus.com/inward/record.url?scp=85057354706&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057354706&partnerID=8YFLogxK

U2 - 10.1109/ICAwST.2018.8517228

DO - 10.1109/ICAwST.2018.8517228

M3 - Conference contribution

AN - SCOPUS:85057354706

SP - 179

EP - 184

BT - 2018 9th International Conference on Awareness Science and Technology, iCAST 2018

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 9th International Conference on Awareness Science and Technology, iCAST 2018

Y2 - 19 September 2018 through 21 September 2018

ER -

Access to Document

10.1109/ICAwST.2018.8517228