Indonesian puppet theater robot with gamelan music emotion recognition

Tito Pradhono Tomo, Guillermo Enriquez, Shuji Hashimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

In this paper, we propose to protect wayang puppet theater, an intangible cultural heritage from Indonesia by turning a robot into a puppeteer successor. We developed a seven degrees-of-freedom manipulator to actuate sticks attached to the wayang puppet body and hands. We also developed a gamelan music emotion recognition so that the robot could control its movement based on the musical pattern. The robot could imitate some of the puppeteer's manipulations and correctly recognized by a human for around 80% in overall. The experiments also revealed that the algorithm had overall over than 90% recognition rate for identifying the delighted song, afraid song and noise.

Original languageEnglish
Title of host publication2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1177-1182
Number of pages6
ISBN (Print)9781467396745
DOIs
Publication statusPublished - 2016 Feb 24
EventIEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015 - Zhuhai, China
Duration: 2015 Dec 62015 Dec 9

Other

OtherIEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015
CountryChina
CityZhuhai
Period15/12/615/12/9

Fingerprint

Theaters
Robots
Manipulators
Experiments

ASJC Scopus subject areas

  • Artificial Intelligence
  • Hardware and Architecture
  • Control and Systems Engineering

Cite this

Tomo, T. P., Enriquez, G., & Hashimoto, S. (2016). Indonesian puppet theater robot with gamelan music emotion recognition. In 2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015 (pp. 1177-1182). [7418931] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ROBIO.2015.7418931

Indonesian puppet theater robot with gamelan music emotion recognition. / Tomo, Tito Pradhono; Enriquez, Guillermo; Hashimoto, Shuji.

2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015. Institute of Electrical and Electronics Engineers Inc., 2016. p. 1177-1182 7418931.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tomo, TP, Enriquez, G & Hashimoto, S 2016, Indonesian puppet theater robot with gamelan music emotion recognition. in 2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015., 7418931, Institute of Electrical and Electronics Engineers Inc., pp. 1177-1182, IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015, Zhuhai, China, 15/12/6. https://doi.org/10.1109/ROBIO.2015.7418931
Tomo TP, Enriquez G, Hashimoto S. Indonesian puppet theater robot with gamelan music emotion recognition. In 2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015. Institute of Electrical and Electronics Engineers Inc. 2016. p. 1177-1182. 7418931 https://doi.org/10.1109/ROBIO.2015.7418931
Tomo, Tito Pradhono ; Enriquez, Guillermo ; Hashimoto, Shuji. / Indonesian puppet theater robot with gamelan music emotion recognition. 2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 1177-1182
@inproceedings{5a671878736b471397f64e156a0d94c3,
title = "Indonesian puppet theater robot with gamelan music emotion recognition",
abstract = "In this paper, we propose to protect wayang puppet theater, an intangible cultural heritage from Indonesia by turning a robot into a puppeteer successor. We developed a seven degrees-of-freedom manipulator to actuate sticks attached to the wayang puppet body and hands. We also developed a gamelan music emotion recognition so that the robot could control its movement based on the musical pattern. The robot could imitate some of the puppeteer's manipulations and correctly recognized by a human for around 80{\%} in overall. The experiments also revealed that the algorithm had overall over than 90{\%} recognition rate for identifying the delighted song, afraid song and noise.",
author = "Tomo, {Tito Pradhono} and Guillermo Enriquez and Shuji Hashimoto",
year = "2016",
month = "2",
day = "24",
doi = "10.1109/ROBIO.2015.7418931",
language = "English",
isbn = "9781467396745",
pages = "1177--1182",
booktitle = "2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Indonesian puppet theater robot with gamelan music emotion recognition

AU - Tomo, Tito Pradhono

AU - Enriquez, Guillermo

AU - Hashimoto, Shuji

PY - 2016/2/24

Y1 - 2016/2/24

N2 - In this paper, we propose to protect wayang puppet theater, an intangible cultural heritage from Indonesia by turning a robot into a puppeteer successor. We developed a seven degrees-of-freedom manipulator to actuate sticks attached to the wayang puppet body and hands. We also developed a gamelan music emotion recognition so that the robot could control its movement based on the musical pattern. The robot could imitate some of the puppeteer's manipulations and correctly recognized by a human for around 80% in overall. The experiments also revealed that the algorithm had overall over than 90% recognition rate for identifying the delighted song, afraid song and noise.

AB - In this paper, we propose to protect wayang puppet theater, an intangible cultural heritage from Indonesia by turning a robot into a puppeteer successor. We developed a seven degrees-of-freedom manipulator to actuate sticks attached to the wayang puppet body and hands. We also developed a gamelan music emotion recognition so that the robot could control its movement based on the musical pattern. The robot could imitate some of the puppeteer's manipulations and correctly recognized by a human for around 80% in overall. The experiments also revealed that the algorithm had overall over than 90% recognition rate for identifying the delighted song, afraid song and noise.

UR - http://www.scopus.com/inward/record.url?scp=84964475876&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964475876&partnerID=8YFLogxK

U2 - 10.1109/ROBIO.2015.7418931

DO - 10.1109/ROBIO.2015.7418931

M3 - Conference contribution

SN - 9781467396745

SP - 1177

EP - 1182

BT - 2015 IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -