Real-time gesture recognition with finger naming by RGB camera and IR depth sensor

Phonpatchara Chochai, Thanapat Mekrungroj, Takafumi Matsumaru

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This paper introduces the real-time fingers naming method then illustrates how hand languages could be recognized by hand gesture and relation between fingertips. Moreover, this paper provides information on how to calculate and name each finger then using arm for dynamically adjust and improve the stability while the hand is moving. Supported by the study of relation between fingertips, palms, and arms, this proposed method can recognize hand gesture and translate these signs into numbers according to the standard sign language. The approach using in this paper relies on the image depth and the RGB image to identify hands, arms and fingertips. Then, the relation between each part is used to recognize a finger name regardless of the different direction of movement. Also, this report describes how to implement the proposed method into the ASUS Xtion as a sensor.

Original languageEnglish
Title of host publication2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages931-936
Number of pages6
ISBN (Print)9781479973965
DOIs
Publication statusPublished - 2014 Apr 20
Externally publishedYes
Event2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014 - Bali, Indonesia
Duration: 2014 Dec 52014 Dec 10

Other

Other2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014
CountryIndonesia
CityBali
Period14/12/514/12/10

    Fingerprint

ASJC Scopus subject areas

  • Biotechnology
  • Artificial Intelligence
  • Human-Computer Interaction

Cite this

Chochai, P., Mekrungroj, T., & Matsumaru, T. (2014). Real-time gesture recognition with finger naming by RGB camera and IR depth sensor. In 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014 (pp. 931-936). [7090452] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ROBIO.2014.7090452