A Synchronization Feedback System to Improve Interaction Correlation in Subjects with Autism Spectrum Disorder

Yi Hsiang Ma, Yean Han, Jia Yeu Lin, Sarah Cosentino, Yuya Nishio, Chiaki Oshiyama, Atsuo Takanishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This research is part of a WAS-5 robot project to make it possible to assist music therapist in treating Autism Spectrum Disorder (ASD) subjects. One of the challenges faced by ASD subjects is social skills where tempo matching is an important factor when interacting with other people such as conversations and physical activities. This research aims to develop a system that trains the subject to match the music tempo played by WAS-5 with a feedback system. The system evaluates the tempo of the subject's movement and varies the tempo of the music in real-time to guide the subject in order to achieve tempo synchronization. Tempo has been successfully captured in this research through the use of Optical Flow with USB camera and achieved better accuracy using PID control. However, error is still present due to hardware limitations and human factors. Future works includes the fine tuning of the PID to lower error rate, hardware upgrade for better image acquisition, and preliminary experiments with a group of ASD subjects before implementation into actual therapy.

Original languageEnglish
Title of host publication2018 9th International Conference on Awareness Science and Technology, iCAST 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages285-290
Number of pages6
ISBN (Electronic)9781538658260
DOIs
Publication statusPublished - 2018 Oct 31
Event9th International Conference on Awareness Science and Technology, iCAST 2018 - Fukuoka, Japan
Duration: 2018 Sep 192018 Sep 21

Other

Other9th International Conference on Awareness Science and Technology, iCAST 2018
CountryJapan
CityFukuoka
Period18/9/1918/9/21

Fingerprint

Music
autism
Synchronization
Feedback
interaction
Research
Hardware
music
Optical flows
Image acquisition
Three term control systems
Human engineering
hardware
Tuning
Cameras
Robots
robot
therapist
Autism Spectrum Disorder
Interaction

Keywords

  • autism
  • child care
  • correlation of action
  • humanoid robot
  • music robot
  • music therapy
  • social skill

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Human-Computer Interaction
  • Information Systems and Management
  • Experimental and Cognitive Psychology
  • Social Psychology
  • Communication

Cite this

Ma, Y. H., Han, Y., Lin, J. Y., Cosentino, S., Nishio, Y., Oshiyama, C., & Takanishi, A. (2018). A Synchronization Feedback System to Improve Interaction Correlation in Subjects with Autism Spectrum Disorder. In 2018 9th International Conference on Awareness Science and Technology, iCAST 2018 (pp. 285-290). [8517233] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICAwST.2018.8517233

A Synchronization Feedback System to Improve Interaction Correlation in Subjects with Autism Spectrum Disorder. / Ma, Yi Hsiang; Han, Yean; Lin, Jia Yeu; Cosentino, Sarah; Nishio, Yuya; Oshiyama, Chiaki; Takanishi, Atsuo.

2018 9th International Conference on Awareness Science and Technology, iCAST 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 285-290 8517233.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ma, YH, Han, Y, Lin, JY, Cosentino, S, Nishio, Y, Oshiyama, C & Takanishi, A 2018, A Synchronization Feedback System to Improve Interaction Correlation in Subjects with Autism Spectrum Disorder. in 2018 9th International Conference on Awareness Science and Technology, iCAST 2018., 8517233, Institute of Electrical and Electronics Engineers Inc., pp. 285-290, 9th International Conference on Awareness Science and Technology, iCAST 2018, Fukuoka, Japan, 18/9/19. https://doi.org/10.1109/ICAwST.2018.8517233
Ma YH, Han Y, Lin JY, Cosentino S, Nishio Y, Oshiyama C et al. A Synchronization Feedback System to Improve Interaction Correlation in Subjects with Autism Spectrum Disorder. In 2018 9th International Conference on Awareness Science and Technology, iCAST 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 285-290. 8517233 https://doi.org/10.1109/ICAwST.2018.8517233
Ma, Yi Hsiang ; Han, Yean ; Lin, Jia Yeu ; Cosentino, Sarah ; Nishio, Yuya ; Oshiyama, Chiaki ; Takanishi, Atsuo. / A Synchronization Feedback System to Improve Interaction Correlation in Subjects with Autism Spectrum Disorder. 2018 9th International Conference on Awareness Science and Technology, iCAST 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 285-290
@inproceedings{47751cfb23b347fca5bc898a8e34959e,
title = "A Synchronization Feedback System to Improve Interaction Correlation in Subjects with Autism Spectrum Disorder",
abstract = "This research is part of a WAS-5 robot project to make it possible to assist music therapist in treating Autism Spectrum Disorder (ASD) subjects. One of the challenges faced by ASD subjects is social skills where tempo matching is an important factor when interacting with other people such as conversations and physical activities. This research aims to develop a system that trains the subject to match the music tempo played by WAS-5 with a feedback system. The system evaluates the tempo of the subject's movement and varies the tempo of the music in real-time to guide the subject in order to achieve tempo synchronization. Tempo has been successfully captured in this research through the use of Optical Flow with USB camera and achieved better accuracy using PID control. However, error is still present due to hardware limitations and human factors. Future works includes the fine tuning of the PID to lower error rate, hardware upgrade for better image acquisition, and preliminary experiments with a group of ASD subjects before implementation into actual therapy.",
keywords = "autism, child care, correlation of action, humanoid robot, music robot, music therapy, social skill",
author = "Ma, {Yi Hsiang} and Yean Han and Lin, {Jia Yeu} and Sarah Cosentino and Yuya Nishio and Chiaki Oshiyama and Atsuo Takanishi",
year = "2018",
month = "10",
day = "31",
doi = "10.1109/ICAwST.2018.8517233",
language = "English",
pages = "285--290",
booktitle = "2018 9th International Conference on Awareness Science and Technology, iCAST 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - A Synchronization Feedback System to Improve Interaction Correlation in Subjects with Autism Spectrum Disorder

AU - Ma, Yi Hsiang

AU - Han, Yean

AU - Lin, Jia Yeu

AU - Cosentino, Sarah

AU - Nishio, Yuya

AU - Oshiyama, Chiaki

AU - Takanishi, Atsuo

PY - 2018/10/31

Y1 - 2018/10/31

N2 - This research is part of a WAS-5 robot project to make it possible to assist music therapist in treating Autism Spectrum Disorder (ASD) subjects. One of the challenges faced by ASD subjects is social skills where tempo matching is an important factor when interacting with other people such as conversations and physical activities. This research aims to develop a system that trains the subject to match the music tempo played by WAS-5 with a feedback system. The system evaluates the tempo of the subject's movement and varies the tempo of the music in real-time to guide the subject in order to achieve tempo synchronization. Tempo has been successfully captured in this research through the use of Optical Flow with USB camera and achieved better accuracy using PID control. However, error is still present due to hardware limitations and human factors. Future works includes the fine tuning of the PID to lower error rate, hardware upgrade for better image acquisition, and preliminary experiments with a group of ASD subjects before implementation into actual therapy.

AB - This research is part of a WAS-5 robot project to make it possible to assist music therapist in treating Autism Spectrum Disorder (ASD) subjects. One of the challenges faced by ASD subjects is social skills where tempo matching is an important factor when interacting with other people such as conversations and physical activities. This research aims to develop a system that trains the subject to match the music tempo played by WAS-5 with a feedback system. The system evaluates the tempo of the subject's movement and varies the tempo of the music in real-time to guide the subject in order to achieve tempo synchronization. Tempo has been successfully captured in this research through the use of Optical Flow with USB camera and achieved better accuracy using PID control. However, error is still present due to hardware limitations and human factors. Future works includes the fine tuning of the PID to lower error rate, hardware upgrade for better image acquisition, and preliminary experiments with a group of ASD subjects before implementation into actual therapy.

KW - autism

KW - child care

KW - correlation of action

KW - humanoid robot

KW - music robot

KW - music therapy

KW - social skill

UR - http://www.scopus.com/inward/record.url?scp=85057360426&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057360426&partnerID=8YFLogxK

U2 - 10.1109/ICAwST.2018.8517233

DO - 10.1109/ICAwST.2018.8517233

M3 - Conference contribution

AN - SCOPUS:85057360426

SP - 285

EP - 290

BT - 2018 9th International Conference on Awareness Science and Technology, iCAST 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -