Wayang robot with gamelan music pattern recognition

Tito Pradhono Tomo, Alexander Schmitz, Guillermo Enriquez, Shuji Hashimoto, Shigeki Sugano

研究成果: Article

抄録

This paper proposes a way to protect endangered wayang puppet theater, an intangible cultural heritage from Indonesia, by turning a robot into a puppeteer successor. We developed a seven degrees-offreedom (DOF) manipulator to actuate the sticks attached to the wayang puppet body and hands. The robot can imitate 8 distinct human puppeteer’smanipulations. Furthermore, we developed a gamelan music pattern recognition, towards a robot that can perform based on the gamelan music. In the offline experiment, we extracted energy (time domain), spectral rolloff, 13 Mel-frequency cepstral coefficients (MFCCs), and the harmonic ratio from 5 s long clips, every 0.025 s, with a window length of 1 s, for a total of 2576 features. Two classifiers (3 layers feed-forward neural network (FNN) and multi-class Support Vector Machine (SVM)) were compared. The SVMclassifier outperformed the FNN classifier with a recognition rate of 96.4%for identifying the three different gamelan music patterns.

元の言語English
ページ(範囲)137-145
ページ数9
ジャーナルJournal of Robotics and Mechatronics
29
発行部数1
DOI
出版物ステータスPublished - 2017 2 1

Fingerprint

Computer music
Pattern recognition
Robots
Classifiers
Theaters
Feedforward neural networks
End effectors
Manipulators
Support vector machines
Neural networks
Experiments

ASJC Scopus subject areas

  • Computer Science(all)
  • Electrical and Electronic Engineering

これを引用

Wayang robot with gamelan music pattern recognition. / Tomo, Tito Pradhono; Schmitz, Alexander; Enriquez, Guillermo; Hashimoto, Shuji; Sugano, Shigeki.

:: Journal of Robotics and Mechatronics, 巻 29, 番号 1, 01.02.2017, p. 137-145.

研究成果: Article

@article{2626768e2d3048d78b2648023a3cf748,
title = "Wayang robot with gamelan music pattern recognition",
abstract = "This paper proposes a way to protect endangered wayang puppet theater, an intangible cultural heritage from Indonesia, by turning a robot into a puppeteer successor. We developed a seven degrees-offreedom (DOF) manipulator to actuate the sticks attached to the wayang puppet body and hands. The robot can imitate 8 distinct human puppeteer’smanipulations. Furthermore, we developed a gamelan music pattern recognition, towards a robot that can perform based on the gamelan music. In the offline experiment, we extracted energy (time domain), spectral rolloff, 13 Mel-frequency cepstral coefficients (MFCCs), and the harmonic ratio from 5 s long clips, every 0.025 s, with a window length of 1 s, for a total of 2576 features. Two classifiers (3 layers feed-forward neural network (FNN) and multi-class Support Vector Machine (SVM)) were compared. The SVMclassifier outperformed the FNN classifier with a recognition rate of 96.4{\%}for identifying the three different gamelan music patterns.",
keywords = "Intangible culture, Intelligent machine, Machine learning, Music information retrieval, Wayang kulit",
author = "Tomo, {Tito Pradhono} and Alexander Schmitz and Guillermo Enriquez and Shuji Hashimoto and Shigeki Sugano",
year = "2017",
month = "2",
day = "1",
doi = "10.20965/jrm.2017.p0137",
language = "English",
volume = "29",
pages = "137--145",
journal = "Journal of Robotics and Mechatronics",
issn = "0915-3942",
publisher = "Fuji Technology Press",
number = "1",

}

TY - JOUR

T1 - Wayang robot with gamelan music pattern recognition

AU - Tomo, Tito Pradhono

AU - Schmitz, Alexander

AU - Enriquez, Guillermo

AU - Hashimoto, Shuji

AU - Sugano, Shigeki

PY - 2017/2/1

Y1 - 2017/2/1

N2 - This paper proposes a way to protect endangered wayang puppet theater, an intangible cultural heritage from Indonesia, by turning a robot into a puppeteer successor. We developed a seven degrees-offreedom (DOF) manipulator to actuate the sticks attached to the wayang puppet body and hands. The robot can imitate 8 distinct human puppeteer’smanipulations. Furthermore, we developed a gamelan music pattern recognition, towards a robot that can perform based on the gamelan music. In the offline experiment, we extracted energy (time domain), spectral rolloff, 13 Mel-frequency cepstral coefficients (MFCCs), and the harmonic ratio from 5 s long clips, every 0.025 s, with a window length of 1 s, for a total of 2576 features. Two classifiers (3 layers feed-forward neural network (FNN) and multi-class Support Vector Machine (SVM)) were compared. The SVMclassifier outperformed the FNN classifier with a recognition rate of 96.4%for identifying the three different gamelan music patterns.

AB - This paper proposes a way to protect endangered wayang puppet theater, an intangible cultural heritage from Indonesia, by turning a robot into a puppeteer successor. We developed a seven degrees-offreedom (DOF) manipulator to actuate the sticks attached to the wayang puppet body and hands. The robot can imitate 8 distinct human puppeteer’smanipulations. Furthermore, we developed a gamelan music pattern recognition, towards a robot that can perform based on the gamelan music. In the offline experiment, we extracted energy (time domain), spectral rolloff, 13 Mel-frequency cepstral coefficients (MFCCs), and the harmonic ratio from 5 s long clips, every 0.025 s, with a window length of 1 s, for a total of 2576 features. Two classifiers (3 layers feed-forward neural network (FNN) and multi-class Support Vector Machine (SVM)) were compared. The SVMclassifier outperformed the FNN classifier with a recognition rate of 96.4%for identifying the three different gamelan music patterns.

KW - Intangible culture

KW - Intelligent machine

KW - Machine learning

KW - Music information retrieval

KW - Wayang kulit

UR - http://www.scopus.com/inward/record.url?scp=85013880391&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85013880391&partnerID=8YFLogxK

U2 - 10.20965/jrm.2017.p0137

DO - 10.20965/jrm.2017.p0137

M3 - Article

VL - 29

SP - 137

EP - 145

JO - Journal of Robotics and Mechatronics

JF - Journal of Robotics and Mechatronics

SN - 0915-3942

IS - 1

ER -