Robot audition: Missing feature theory approach and active audition

Hiroshi G. Okuno, Kazuhiro Nakadai, Hyun Don Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)

Abstract

Robot capability of listening to several things at once by its own ears, that is,robot audition, is important in improving interaction and symbiosis between humans and robots. The critical issue in robot audition is real-time processing and robustness against noisy environments with high flexibility to support various kinds of robots and hardware configurations. This paper presents two important aspects of robot audition; Missing-Feature-Theory (MFT) approach and active audition. HARK open-source robot audition incorporates MFT approach to recognize speech signals that are localized and separated from a mixture of sound captured by 8- channel microphone array. HARK is ported to four robots, Honda ASIMO, SIG2, Robovie-R2 and HRP-2, with different microphone configurations and recognizes three simultaneous utterances with 1.9 sec latency. In binaural hearing, the most famous problem is a front-back confusion of sound sources. Active binaural robot audition implemented on SIG2 disambiguates the problem well by rotating its head with pitting. This active audition improves the localization for the periphery.

Original languageEnglish
Title of host publicationSpringer Tracts in Advanced Robotics
Pages227-244
Number of pages18
Volume70
EditionSTAR
DOIs
Publication statusPublished - 2011
Externally publishedYes
Event14th International Symposium of Robotic Research, ISRR 2009 - Lucerne
Duration: 2009 Aug 312009 Sep 3

Publication series

NameSpringer Tracts in Advanced Robotics
NumberSTAR
Volume70
ISSN (Print)16107438
ISSN (Electronic)1610742X

Other

Other14th International Symposium of Robotic Research, ISRR 2009
CityLucerne
Period09/8/3109/9/3

Fingerprint

Audition
Robots
Microphones
Acoustic waves
Pitting
Hardware
Processing

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Artificial Intelligence

Cite this

Okuno, H. G., Nakadai, K., & Kim, H. D. (2011). Robot audition: Missing feature theory approach and active audition. In Springer Tracts in Advanced Robotics (STAR ed., Vol. 70, pp. 227-244). (Springer Tracts in Advanced Robotics; Vol. 70, No. STAR). https://doi.org/10.1007/978-3-642-19457-3_14

Robot audition : Missing feature theory approach and active audition. / Okuno, Hiroshi G.; Nakadai, Kazuhiro; Kim, Hyun Don.

Springer Tracts in Advanced Robotics. Vol. 70 STAR. ed. 2011. p. 227-244 (Springer Tracts in Advanced Robotics; Vol. 70, No. STAR).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Okuno, HG, Nakadai, K & Kim, HD 2011, Robot audition: Missing feature theory approach and active audition. in Springer Tracts in Advanced Robotics. STAR edn, vol. 70, Springer Tracts in Advanced Robotics, no. STAR, vol. 70, pp. 227-244, 14th International Symposium of Robotic Research, ISRR 2009, Lucerne, 09/8/31. https://doi.org/10.1007/978-3-642-19457-3_14
Okuno HG, Nakadai K, Kim HD. Robot audition: Missing feature theory approach and active audition. In Springer Tracts in Advanced Robotics. STAR ed. Vol. 70. 2011. p. 227-244. (Springer Tracts in Advanced Robotics; STAR). https://doi.org/10.1007/978-3-642-19457-3_14
Okuno, Hiroshi G. ; Nakadai, Kazuhiro ; Kim, Hyun Don. / Robot audition : Missing feature theory approach and active audition. Springer Tracts in Advanced Robotics. Vol. 70 STAR. ed. 2011. pp. 227-244 (Springer Tracts in Advanced Robotics; STAR).
@inproceedings{6720e0d1d0ae4993b75971ac0c6b2314,
title = "Robot audition: Missing feature theory approach and active audition",
abstract = "Robot capability of listening to several things at once by its own ears, that is,robot audition, is important in improving interaction and symbiosis between humans and robots. The critical issue in robot audition is real-time processing and robustness against noisy environments with high flexibility to support various kinds of robots and hardware configurations. This paper presents two important aspects of robot audition; Missing-Feature-Theory (MFT) approach and active audition. HARK open-source robot audition incorporates MFT approach to recognize speech signals that are localized and separated from a mixture of sound captured by 8- channel microphone array. HARK is ported to four robots, Honda ASIMO, SIG2, Robovie-R2 and HRP-2, with different microphone configurations and recognizes three simultaneous utterances with 1.9 sec latency. In binaural hearing, the most famous problem is a front-back confusion of sound sources. Active binaural robot audition implemented on SIG2 disambiguates the problem well by rotating its head with pitting. This active audition improves the localization for the periphery.",
author = "Okuno, {Hiroshi G.} and Kazuhiro Nakadai and Kim, {Hyun Don}",
year = "2011",
doi = "10.1007/978-3-642-19457-3_14",
language = "English",
isbn = "9783642194566",
volume = "70",
series = "Springer Tracts in Advanced Robotics",
number = "STAR",
pages = "227--244",
booktitle = "Springer Tracts in Advanced Robotics",
edition = "STAR",

}

TY - GEN

T1 - Robot audition

T2 - Missing feature theory approach and active audition

AU - Okuno, Hiroshi G.

AU - Nakadai, Kazuhiro

AU - Kim, Hyun Don

PY - 2011

Y1 - 2011

N2 - Robot capability of listening to several things at once by its own ears, that is,robot audition, is important in improving interaction and symbiosis between humans and robots. The critical issue in robot audition is real-time processing and robustness against noisy environments with high flexibility to support various kinds of robots and hardware configurations. This paper presents two important aspects of robot audition; Missing-Feature-Theory (MFT) approach and active audition. HARK open-source robot audition incorporates MFT approach to recognize speech signals that are localized and separated from a mixture of sound captured by 8- channel microphone array. HARK is ported to four robots, Honda ASIMO, SIG2, Robovie-R2 and HRP-2, with different microphone configurations and recognizes three simultaneous utterances with 1.9 sec latency. In binaural hearing, the most famous problem is a front-back confusion of sound sources. Active binaural robot audition implemented on SIG2 disambiguates the problem well by rotating its head with pitting. This active audition improves the localization for the periphery.

AB - Robot capability of listening to several things at once by its own ears, that is,robot audition, is important in improving interaction and symbiosis between humans and robots. The critical issue in robot audition is real-time processing and robustness against noisy environments with high flexibility to support various kinds of robots and hardware configurations. This paper presents two important aspects of robot audition; Missing-Feature-Theory (MFT) approach and active audition. HARK open-source robot audition incorporates MFT approach to recognize speech signals that are localized and separated from a mixture of sound captured by 8- channel microphone array. HARK is ported to four robots, Honda ASIMO, SIG2, Robovie-R2 and HRP-2, with different microphone configurations and recognizes three simultaneous utterances with 1.9 sec latency. In binaural hearing, the most famous problem is a front-back confusion of sound sources. Active binaural robot audition implemented on SIG2 disambiguates the problem well by rotating its head with pitting. This active audition improves the localization for the periphery.

UR - http://www.scopus.com/inward/record.url?scp=79957972796&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79957972796&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-19457-3_14

DO - 10.1007/978-3-642-19457-3_14

M3 - Conference contribution

AN - SCOPUS:79957972796

SN - 9783642194566

VL - 70

T3 - Springer Tracts in Advanced Robotics

SP - 227

EP - 244

BT - Springer Tracts in Advanced Robotics

ER -