A depth camera-based system to enable touch-less interaction using hand gestures

R. Damindarov, C. A. Fam, R. A. Boby, M. Fahim, A. Klimchik, T. Matsumaru

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Touch-less interaction is an active area of research due to its numerous applications ranging from medical systems to gaming. In this paper we propose a novel interactive system based on RealSense camera to track the pose of hand and to recognize gestures. Our approach is based on MediaPipe model introduced by Google to detect the landmarks of the hand. The system utilizes the camera calibration information and user actions to get the geometry of the deployed environment, which shows high accuracy in measurement of hand position. The touch-less interaction is demonstrated using a graphical user interface for painting.

Original languageEnglish
Title of host publication2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665424066
DOIs
Publication statusPublished - 2021
Event2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021 - Innopolis, Russian Federation
Duration: 2021 Aug 262021 Aug 29

Publication series

Name2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021

Conference

Conference2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021
Country/TerritoryRussian Federation
CityInnopolis
Period21/8/2621/8/29

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Human-Computer Interaction
  • Mechanical Engineering
  • Control and Optimization

Fingerprint

Dive into the research topics of 'A depth camera-based system to enable touch-less interaction using hand gestures'. Together they form a unique fingerprint.

Cite this