Sound sources selection system by using onomatopoeic querries from multiple sound sources

Yusuke Yamamura, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Our motivation is to develop a robot that treats auditory information in real environment because auditory information is useful for animated communications or understanding our surroundings. Interactions by using sound information need an aquisition of it and a proper sound source reference between a user and a robot leads to it. Such sound source reference is difficult due to multiple sound sources generating in real environemnt, and we use onomatopoeic representations as a representation for the reference. This paper shows a system that selects a sound source specified by a user from multiple sound sources. Users use onomatopoeias in the specification, and our system separates a mixed sound and converts separated sounds into onomatopoeias for the selection. Onomatopoeais have the ambiguity that each user gives each expression to a certain sound and we create an original similarity based on Minimum Edit Distance and acoustic features for solving its problem. In experiments, our system receives a mixed sound consisting of three sounds and a user's query as inputs, and checks a count of a consistency of a sound source selected by a system and a sound source specified by a user in 100 tests. The result shows

Original languageEnglish
Title of host publication2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2012
Pages2364-2369
Number of pages6
DOIs
Publication statusPublished - 2012 Dec 1
Externally publishedYes
Event25th IEEE/RSJ International Conference on Robotics and Intelligent Systems, IROS 2012 - Vilamoura, Algarve, Portugal
Duration: 2012 Oct 72012 Oct 12

Publication series

NameIEEE International Conference on Intelligent Robots and Systems
ISSN (Print)2153-0858
ISSN (Electronic)2153-0866

Conference

Conference25th IEEE/RSJ International Conference on Robotics and Intelligent Systems, IROS 2012
CountryPortugal
CityVilamoura, Algarve
Period12/10/712/10/12

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Sound sources selection system by using onomatopoeic querries from multiple sound sources'. Together they form a unique fingerprint.

  • Cite this

    Yamamura, Y., Takahashi, T., Ogata, T., & Okuno, H. G. (2012). Sound sources selection system by using onomatopoeic querries from multiple sound sources. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2012 (pp. 2364-2369). [6385765] (IEEE International Conference on Intelligent Robots and Systems). https://doi.org/10.1109/IROS.2012.6385765