Study of recognizing multiple persons' complicated hand gestures from the video sequence acquired by a moving camera

Luo Dan*, Jun Ohya

*この研究の対応する著者

研究成果: Conference contribution

抄録

Recognizing hand gestures from the video sequence acquired by a dynamic camera could be a useful interface between humans and mobile robots. We develop a state based approach to extract and recognize hand gestures from moving camera images. We improved Human-Following Local Coordinate (HFLC) System, a very simple and stable method for extracting hand motion trajectories, which is obtained from the located human face, body part and hand blob changing factor. Condensation algorithm and PCA-based algorithm was performed to recognize extracted hand trajectories. In last research, this Condensation Algorithm based method only applied for one person's hand gestures. In this paper, we propose a principal component analysis (PCA) based approach to improve the recognition accuracy. For further improvement, temporal changes in the observed hand area changing factor are utilized as new image features to be stored in the database after being analyzed by PCA. Every hand gesture trajectory in the database is classified into either one hand gesture categories, two hand gesture categories, or temporal changes in hand blob changes. We demonstrate the effectiveness of the proposed method by conducting experiments on 45 kinds of sign language based Japanese and American Sign Language gestures obtained from 5 people. Our experimental recognition results show better performance is obtained by PCA based approach than the Condensation algorithm based method.

本文言語English
ホスト出版物のタイトルProceedings of SPIE-IS and T Electronic Imaging - Human Vision and Electronic Imaging XV
DOI
出版ステータスPublished - 2010 3 22
イベントHuman Vision and Electronic Imaging XV - San Jose, CA, United States
継続期間: 2010 1 182010 1 21

出版物シリーズ

名前Proceedings of SPIE - The International Society for Optical Engineering
7527
ISSN(印刷版)0277-786X

Conference

ConferenceHuman Vision and Electronic Imaging XV
国/地域United States
CitySan Jose, CA
Period10/1/1810/1/21

ASJC Scopus subject areas

  • 電子材料、光学材料、および磁性材料
  • 凝縮系物理学
  • コンピュータ サイエンスの応用
  • 応用数学
  • 電子工学および電気工学

フィンガープリント

「Study of recognizing multiple persons' complicated hand gestures from the video sequence acquired by a moving camera」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル