Conversation robot with the function of gaze recognition

Shinya Fujie, Toshihiko Yamahata, Tetsunori Kobayashi

研究成果: Conference contribution

5 引用 (Scopus)

抜粋

Gaze recognition for conversation robot is realized and its effectiveness is confirmed. In human conversation, in addition to speech information, visual information plays important role. Particularly, gaze direction is a very useful prompt for turntaking. In the case that the speaker finish his utterance, for example, if he looks at the listener, then he expect the listener to speak. On the other hand, if the speaker does not look at the listener, he tries to keep his turn. Most conventional spoken dialogue systems detect the finish of user's turn only by speech recognition. These systems cannot understand the user tries to keep his turn, and they wrongly begin the utterance and block the user's remaining utterance. In this study, we implement the gaze recognition using the user's image captured by the camera mounted on the eye of the robot and apply the recognition results to decide who should speak next. For gaze recognition, we introduce the sub-image of user's eye region extracted with the Active Appearance Model as the feature. Recognition with subspace method using this feature achieved 70% in recognition rate. Finally, the effectiveness of the gaze recognition is confirmed through the subjective experiment. The experiment is performed by the actual conversation between the conversation robot and the subject.

元の言語English
ホスト出版物のタイトルProceedings of the 2006 6th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS
ページ364-369
ページ数6
DOI
出版物ステータスPublished - 2006 12 1
イベント2006 6th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS - Genoa, Italy
継続期間: 2006 12 42006 12 6

出版物シリーズ

名前Proceedings of the 2006 6th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS

Conference

Conference2006 6th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS
Italy
Genoa
期間06/12/406/12/6

    フィンガープリント

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Electrical and Electronic Engineering

これを引用

Fujie, S., Yamahata, T., & Kobayashi, T. (2006). Conversation robot with the function of gaze recognition. : Proceedings of the 2006 6th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS (pp. 364-369). [4115628] (Proceedings of the 2006 6th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS). https://doi.org/10.1109/ICHR.2006.321298