Abstract
This paper presents an interactive humanoid robot that can moderate a multi-player fastest-voice-first-type quiz game by leveraging state-of-the-art robot audition techniques such as sound source localization and separation and speech recognition. In this game, a player who says 'Yes' first gets a right to answer a question, and players are allowed to barge in a questionary utterance of the quizmaster. The robot needs to identify which player says 'Yes' first, even if multiple players respond at almost exactly the same time, and must judge the correctness of the answer given by the player. To enable natural human-robot interaction, we believe that the robot should use its own microphones (i.e., ears) embedded in the head, rather than having pin microphones attached to individual players. In this paper we use a robot audition system called HARK for separating the mixture of audio signals recorded by the ears into multiple source signals (i.e., almost the simultaneous utterances of 'Yes' and the questionary utterance) and estimating the direction of each source. To judge the correctness of an answer, we use a speech recognizer called Julius. Experimental results showed that our robot can correctly identify which player spoke first when the players' utterances differed by 60 msec.
| Original language | English |
|---|---|
| Title of host publication | IEEE-RAS International Conference on Humanoid Robots |
| Publisher | IEEE Computer Society |
| Pages | 967-972 |
| Number of pages | 6 |
| Volume | 2015-February |
| ISBN (Print) | 9781479971749 |
| DOIs | |
| Publication status | Published - 2015 Feb 12 |
| Event | 2014 14th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2014 - Madrid, Spain Duration: 2014 Nov 18 → 2014 Nov 20 |
Other
| Other | 2014 14th IEEE-RAS International Conference on Humanoid Robots, Humanoids 2014 |
|---|---|
| Country | Spain |
| City | Madrid |
| Period | 14/11/18 → 14/11/20 |
Fingerprint
ASJC Scopus subject areas
- Artificial Intelligence
- Computer Vision and Pattern Recognition
- Hardware and Architecture
- Human-Computer Interaction
- Electrical and Electronic Engineering
Cite this
A robot quizmaster that can localize, separate, and recognize simultaneous utterances for a fastest-voice-first quiz game. / Nishimuta, Izaya; Hirayama, Naoki; Yoshii, Kazuyoshi; Itoyama, Katsutoshi; Okuno, Hiroshi G.
IEEE-RAS International Conference on Humanoid Robots. Vol. 2015-February IEEE Computer Society, 2015. p. 967-972 7041480.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - A robot quizmaster that can localize, separate, and recognize simultaneous utterances for a fastest-voice-first quiz game
AU - Nishimuta, Izaya
AU - Hirayama, Naoki
AU - Yoshii, Kazuyoshi
AU - Itoyama, Katsutoshi
AU - Okuno, Hiroshi G.
PY - 2015/2/12
Y1 - 2015/2/12
N2 - This paper presents an interactive humanoid robot that can moderate a multi-player fastest-voice-first-type quiz game by leveraging state-of-the-art robot audition techniques such as sound source localization and separation and speech recognition. In this game, a player who says 'Yes' first gets a right to answer a question, and players are allowed to barge in a questionary utterance of the quizmaster. The robot needs to identify which player says 'Yes' first, even if multiple players respond at almost exactly the same time, and must judge the correctness of the answer given by the player. To enable natural human-robot interaction, we believe that the robot should use its own microphones (i.e., ears) embedded in the head, rather than having pin microphones attached to individual players. In this paper we use a robot audition system called HARK for separating the mixture of audio signals recorded by the ears into multiple source signals (i.e., almost the simultaneous utterances of 'Yes' and the questionary utterance) and estimating the direction of each source. To judge the correctness of an answer, we use a speech recognizer called Julius. Experimental results showed that our robot can correctly identify which player spoke first when the players' utterances differed by 60 msec.
AB - This paper presents an interactive humanoid robot that can moderate a multi-player fastest-voice-first-type quiz game by leveraging state-of-the-art robot audition techniques such as sound source localization and separation and speech recognition. In this game, a player who says 'Yes' first gets a right to answer a question, and players are allowed to barge in a questionary utterance of the quizmaster. The robot needs to identify which player says 'Yes' first, even if multiple players respond at almost exactly the same time, and must judge the correctness of the answer given by the player. To enable natural human-robot interaction, we believe that the robot should use its own microphones (i.e., ears) embedded in the head, rather than having pin microphones attached to individual players. In this paper we use a robot audition system called HARK for separating the mixture of audio signals recorded by the ears into multiple source signals (i.e., almost the simultaneous utterances of 'Yes' and the questionary utterance) and estimating the direction of each source. To judge the correctness of an answer, we use a speech recognizer called Julius. Experimental results showed that our robot can correctly identify which player spoke first when the players' utterances differed by 60 msec.
UR - http://www.scopus.com/inward/record.url?scp=84945177299&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84945177299&partnerID=8YFLogxK
U2 - 10.1109/HUMANOIDS.2014.7041480
DO - 10.1109/HUMANOIDS.2014.7041480
M3 - Conference contribution
AN - SCOPUS:84945177299
SN - 9781479971749
VL - 2015-February
SP - 967
EP - 972
BT - IEEE-RAS International Conference on Humanoid Robots
PB - IEEE Computer Society
ER -