Auditory and visual integration based localization and tracking of humans in daily-life environments

Hyun Don Kim, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

研究成果: Conference contribution

16 引用 (Scopus)

抜粋

The purpose of this research is to develop techniques that enable robots to choose and track a desired person for interaction in daily-life environments. Therefore, localizing multiple moving sounds and human faces is necessary so that robots can locate a desired person. For sound source localization, we used a cross-power spectrum phase analysis (CSP) method and showed that CSP can localize sound sources only using two microphones and does not need impulse response data. An expectation-maximization (EM) algorithm was shown to enable a robot to cope with multiple moving sound sources. For face localization, we developed a method that can reliably detect several faces using the skin color classification obtained by using the EM algorithm. To deal with a change in color state according to illumination condition and various skin colors, the robot can obtain new skin color features of faces detected by OpenCV, an open vision library, for detecting human faces. Finally, we developed a probability based method to integrate auditory and visual information and to produce a reliable tracking path in real time. Furthermore, the developed system chose and tracked people while dealing with various background noises that are considered loud, even in the daily-life environments.

元の言語English
ホスト出版物のタイトルProceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2007
ページ2021-2027
ページ数7
DOI
出版物ステータスPublished - 2007 12 1
外部発表Yes
イベント2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2007 - San Diego, CA, United States
継続期間: 2007 10 292007 11 2

出版物シリーズ

名前IEEE International Conference on Intelligent Robots and Systems

Conference

Conference2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2007
United States
San Diego, CA
期間07/10/2907/11/2

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Software
  • Computer Vision and Pattern Recognition
  • Computer Science Applications

フィンガープリント Auditory and visual integration based localization and tracking of humans in daily-life environments' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Kim, H. D., Komatani, K., Ogata, T., & Okuno, H. G. (2007). Auditory and visual integration based localization and tracking of humans in daily-life environments. : Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2007 (pp. 2021-2027). [4399331] (IEEE International Conference on Intelligent Robots and Systems). https://doi.org/10.1109/IROS.2007.4399331