Multiple moving speaker tracking by microphone array on mobile robot

Masamitsu Murase, Shunichi Yamamoto, Jean Marc Valin, Kazuhiro Nakadai, Kentaro Yamada, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Contribution to conferencePaper

15 Citations (Scopus)

Abstract

Real-world applications often require tracking multiple moving speakers for improving human-robot interactions and/or sound source separation. This paper presents multiple moving speaker tracking using an 8ch microphone array system installed on a mobile robot. This problem is difficult because the system does not assume that sound sources and/or the microphone array are fixed. Our solutions consist of two key ideas - time delay of arrival estimation, and multiple Kalman filters. The former localizes multiple sound sources based on beamforming in real time. Non-linear movements are tracked by using a set of Kalman filters with different history lengths in order to reduce errors in tracking multiple moving speakers under noisy and echoic environments. For quantitative evaluation of the tracking, motion references of sound sources and a mobile robot, called SIG2, were measured accurately by ultrasonic 3D tag sensors. As a result, we showed that the system tracked three simultaneous sound sources even when SIG2 moved in a room with large reverberation due to glass walls.

Original languageEnglish
Pages249-252
Number of pages4
Publication statusPublished - 2005 Dec 1
Event9th European Conference on Speech Communication and Technology - Lisbon, Portugal
Duration: 2005 Sep 42005 Sep 8

Conference

Conference9th European Conference on Speech Communication and Technology
CountryPortugal
CityLisbon
Period05/9/405/9/8

    Fingerprint

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Murase, M., Yamamoto, S., Valin, J. M., Nakadai, K., Yamada, K., Komatani, K., Ogata, T., & Okuno, H. G. (2005). Multiple moving speaker tracking by microphone array on mobile robot. 249-252. Paper presented at 9th European Conference on Speech Communication and Technology, Lisbon, Portugal.