Making a robot dance to diverse musical genre in noisy environments

João Lobato Oliveira, Keisuke Nakamura, Thibault Langlois, Fabien Gouyon, Kazuhiro Nakadai, Angelica Lim, Luis Paulo Reis, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In this paper we address the problem of musical genre recognition for a dancing robot with embedded microphones capable of distinguishing the genre of a musical piece while moving in a real-world scenario. For this purpose, we assess and compare two state-of-the-art musical genre recognition systems, based on Support Vector Machines and Markov Models, in the context of different real-world acoustic environments. In addition, we compare different preprocessing robot audition variants (single channel and separated signal from multiple channels) and test different acoustic models, learned a priori, to tackle multiple noise conditions of increasing complexity in the presence of noises of different natures (e.g., robot motion, speech). The results with six different musical genres suggest improved results, in the order of 43.6pp for the most complex conditions, when recurring to Sound Source Separation and acoustic models trained in similar conditions to the testing scenarios. A robot dance demonstration session confirms the applicability of the proposed integration for genre-adaptive dancing robots in real-world noisy environments.

Original languageEnglish
Title of host publicationIEEE International Conference on Intelligent Robots and Systems
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1896-1901
Number of pages6
ISBN (Print)9781479969340
DOIs
Publication statusPublished - 2014 Oct 31
Externally publishedYes
Event2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014 - Chicago
Duration: 2014 Sep 142014 Sep 18

Other

Other2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014
CityChicago
Period14/9/1414/9/18

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Making a robot dance to diverse musical genre in noisy environments'. Together they form a unique fingerprint.

Cite this