A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder

Yean Han, Yuya Nishio, Yi Hsiang Ma, Chiaki Oshiyama, Jia Yeu Lin, Atsuo Takanishi, Sarah Cosentino

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Waseda Anthropomorphic Saxophonist No.5 (WAS-5) will be used in the music therapy of subjects with Spectrum Disorder (ASD). The impairment to recognize facial expression by ASD in other people causes problems when interacting with other people. WAS-5 will have a protocol to train the subjects to react with specific action to specific music then transfer that correlation to the expressions made by WAS5 through classical conditioning to differentiate expressions. This research has done a preliminary experiment with a mock program of the training program on normal people with positive effects. To effectively ensure subject fully perceive the facial expression of WAS-5, a gaze detection is also being developed using OpenCV and a USB camera. This research aims to improve the social skills of ASD subjects to better interact with other people. Further experiments with ASD subjects will be done with hardware upgrade.

Original languageEnglish
Title of host publication2018 9th International Conference on Awareness Science and Technology, iCAST 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages179-184
Number of pages6
ISBN (Electronic)9781538658260
DOIs
Publication statusPublished - 2018 Oct 31
Event9th International Conference on Awareness Science and Technology, iCAST 2018 - Fukuoka, Japan
Duration: 2018 Sep 192018 Sep 21

Other

Other9th International Conference on Awareness Science and Technology, iCAST 2018
CountryJapan
CityFukuoka
Period18/9/1918/9/21

Fingerprint

Facial Expression
facial expression
autism
robot
Robots
Music Therapy
Classical Conditioning
Music
Research
Experiments
Cameras
Hardware
Education
music therapy
experiment
conditioning
hardware
training program
music
Autism Spectrum Disorder

Keywords

  • autism
  • behaviour conditioning
  • child care
  • humanoid robot
  • music robot
  • music therapy
  • social skill

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Human-Computer Interaction
  • Information Systems and Management
  • Experimental and Cognitive Psychology
  • Social Psychology
  • Communication

Cite this

Han, Y., Nishio, Y., Ma, Y. H., Oshiyama, C., Lin, J. Y., Takanishi, A., & Cosentino, S. (2018). A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. In 2018 9th International Conference on Awareness Science and Technology, iCAST 2018 (pp. 179-184). [8517228] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICAwST.2018.8517228

A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. / Han, Yean; Nishio, Yuya; Ma, Yi Hsiang; Oshiyama, Chiaki; Lin, Jia Yeu; Takanishi, Atsuo; Cosentino, Sarah.

2018 9th International Conference on Awareness Science and Technology, iCAST 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 179-184 8517228.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Han, Y, Nishio, Y, Ma, YH, Oshiyama, C, Lin, JY, Takanishi, A & Cosentino, S 2018, A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. in 2018 9th International Conference on Awareness Science and Technology, iCAST 2018., 8517228, Institute of Electrical and Electronics Engineers Inc., pp. 179-184, 9th International Conference on Awareness Science and Technology, iCAST 2018, Fukuoka, Japan, 18/9/19. https://doi.org/10.1109/ICAwST.2018.8517228
Han Y, Nishio Y, Ma YH, Oshiyama C, Lin JY, Takanishi A et al. A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. In 2018 9th International Conference on Awareness Science and Technology, iCAST 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 179-184. 8517228 https://doi.org/10.1109/ICAwST.2018.8517228
Han, Yean ; Nishio, Yuya ; Ma, Yi Hsiang ; Oshiyama, Chiaki ; Lin, Jia Yeu ; Takanishi, Atsuo ; Cosentino, Sarah. / A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder. 2018 9th International Conference on Awareness Science and Technology, iCAST 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 179-184
@inproceedings{a430214b7cbd4f2a92cd2748d2cfc07b,
title = "A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder",
abstract = "Waseda Anthropomorphic Saxophonist No.5 (WAS-5) will be used in the music therapy of subjects with Spectrum Disorder (ASD). The impairment to recognize facial expression by ASD in other people causes problems when interacting with other people. WAS-5 will have a protocol to train the subjects to react with specific action to specific music then transfer that correlation to the expressions made by WAS5 through classical conditioning to differentiate expressions. This research has done a preliminary experiment with a mock program of the training program on normal people with positive effects. To effectively ensure subject fully perceive the facial expression of WAS-5, a gaze detection is also being developed using OpenCV and a USB camera. This research aims to improve the social skills of ASD subjects to better interact with other people. Further experiments with ASD subjects will be done with hardware upgrade.",
keywords = "autism, behaviour conditioning, child care, humanoid robot, music robot, music therapy, social skill",
author = "Yean Han and Yuya Nishio and Ma, {Yi Hsiang} and Chiaki Oshiyama and Lin, {Jia Yeu} and Atsuo Takanishi and Sarah Cosentino",
year = "2018",
month = "10",
day = "31",
doi = "10.1109/ICAwST.2018.8517228",
language = "English",
pages = "179--184",
booktitle = "2018 9th International Conference on Awareness Science and Technology, iCAST 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - A human-robot interface to improve facial expression recognition in subjects with Autism Spectrum Disorder

AU - Han, Yean

AU - Nishio, Yuya

AU - Ma, Yi Hsiang

AU - Oshiyama, Chiaki

AU - Lin, Jia Yeu

AU - Takanishi, Atsuo

AU - Cosentino, Sarah

PY - 2018/10/31

Y1 - 2018/10/31

N2 - Waseda Anthropomorphic Saxophonist No.5 (WAS-5) will be used in the music therapy of subjects with Spectrum Disorder (ASD). The impairment to recognize facial expression by ASD in other people causes problems when interacting with other people. WAS-5 will have a protocol to train the subjects to react with specific action to specific music then transfer that correlation to the expressions made by WAS5 through classical conditioning to differentiate expressions. This research has done a preliminary experiment with a mock program of the training program on normal people with positive effects. To effectively ensure subject fully perceive the facial expression of WAS-5, a gaze detection is also being developed using OpenCV and a USB camera. This research aims to improve the social skills of ASD subjects to better interact with other people. Further experiments with ASD subjects will be done with hardware upgrade.

AB - Waseda Anthropomorphic Saxophonist No.5 (WAS-5) will be used in the music therapy of subjects with Spectrum Disorder (ASD). The impairment to recognize facial expression by ASD in other people causes problems when interacting with other people. WAS-5 will have a protocol to train the subjects to react with specific action to specific music then transfer that correlation to the expressions made by WAS5 through classical conditioning to differentiate expressions. This research has done a preliminary experiment with a mock program of the training program on normal people with positive effects. To effectively ensure subject fully perceive the facial expression of WAS-5, a gaze detection is also being developed using OpenCV and a USB camera. This research aims to improve the social skills of ASD subjects to better interact with other people. Further experiments with ASD subjects will be done with hardware upgrade.

KW - autism

KW - behaviour conditioning

KW - child care

KW - humanoid robot

KW - music robot

KW - music therapy

KW - social skill

UR - http://www.scopus.com/inward/record.url?scp=85057354706&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057354706&partnerID=8YFLogxK

U2 - 10.1109/ICAwST.2018.8517228

DO - 10.1109/ICAwST.2018.8517228

M3 - Conference contribution

AN - SCOPUS:85057354706

SP - 179

EP - 184

BT - 2018 9th International Conference on Awareness Science and Technology, iCAST 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -