A depth camera-based system to enable touch-less interaction using hand gestures

R. Damindarov; C. A. Fam; R. A. Boby; M. Fahim; A. Klimchik; T. Matsumaru

doi:10.1109/NIR52917.2021.9666090

A depth camera-based system to enable touch-less interaction using hand gestures

R. Damindarov, C. A. Fam, R. A. Boby, M. Fahim, A. Klimchik, T. Matsumaru

Graduate School of Information, Production and Systems

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

4 Citations (Scopus)

Abstract

Touch-less interaction is an active area of research due to its numerous applications ranging from medical systems to gaming. In this paper we propose a novel interactive system based on RealSense camera to track the pose of hand and to recognize gestures. Our approach is based on MediaPipe model introduced by Google to detect the landmarks of the hand. The system utilizes the camera calibration information and user actions to get the geometry of the deployed environment, which shows high accuracy in measurement of hand position. The touch-less interaction is demonstrated using a graphical user interface for painting.

Original language	English
Title of host publication	2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781665424066
DOIs	https://doi.org/10.1109/NIR52917.2021.9666090
Publication status	Published - 2021
Event	2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021 - Innopolis, Russian Federation Duration: 2021 Aug 26 → 2021 Aug 29

Publication series

Name	2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021

Conference

Conference	2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021
Country/Territory	Russian Federation
City	Innopolis
Period	21/8/26 → 21/8/29

ASJC Scopus subject areas

Artificial Intelligence
Computer Science Applications
Human-Computer Interaction
Mechanical Engineering
Control and Optimization

Access to Document

10.1109/NIR52917.2021.9666090

Cite this

Damindarov, R., Fam, C. A., Boby, R. A., Fahim, M., Klimchik, A., & Matsumaru, T. (2021). A depth camera-based system to enable touch-less interaction using hand gestures. In 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021 (2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/NIR52917.2021.9666090

A depth camera-based system to enable touch-less interaction using hand gestures. / Damindarov, R.; Fam, C. A.; Boby, R. A. et al.

2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021. Institute of Electrical and Electronics Engineers Inc., 2021. (2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Damindarov, R, Fam, CA, Boby, RA, Fahim, M, Klimchik, A & Matsumaru, T 2021, A depth camera-based system to enable touch-less interaction using hand gestures. in 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021. 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021, Institute of Electrical and Electronics Engineers Inc., 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021, Innopolis, Russian Federation, 21/8/26. https://doi.org/10.1109/NIR52917.2021.9666090

Damindarov R, Fam CA, Boby RA, Fahim M, Klimchik A, Matsumaru T. A depth camera-based system to enable touch-less interaction using hand gestures. In 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021. Institute of Electrical and Electronics Engineers Inc. 2021. (2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021). doi: 10.1109/NIR52917.2021.9666090

@inproceedings{ceb066d6d9ee45b991ba31c74f6fd5f6,

title = "A depth camera-based system to enable touch-less interaction using hand gestures",

abstract = "Touch-less interaction is an active area of research due to its numerous applications ranging from medical systems to gaming. In this paper we propose a novel interactive system based on RealSense camera to track the pose of hand and to recognize gestures. Our approach is based on MediaPipe model introduced by Google to detect the landmarks of the hand. The system utilizes the camera calibration information and user actions to get the geometry of the deployed environment, which shows high accuracy in measurement of hand position. The touch-less interaction is demonstrated using a graphical user interface for painting. ",

author = "R. Damindarov and Fam, {C. A.} and Boby, {R. A.} and M. Fahim and A. Klimchik and T. Matsumaru",

note = "Publisher Copyright: {\textcopyright} 2021 IEEE.; 2021 International Conference {"}Nonlinearity, Information and Robotics{"}, NIR 2021 ; Conference date: 26-08-2021 Through 29-08-2021",

year = "2021",

doi = "10.1109/NIR52917.2021.9666090",

language = "English",

series = "2021 International Conference {"}Nonlinearity, Information and Robotics{"}, NIR 2021",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2021 International Conference {"}Nonlinearity, Information and Robotics{"}, NIR 2021",

}

TY - GEN

T1 - A depth camera-based system to enable touch-less interaction using hand gestures

AU - Damindarov, R.

AU - Fam, C. A.

AU - Boby, R. A.

AU - Fahim, M.

AU - Klimchik, A.

AU - Matsumaru, T.

PY - 2021

Y1 - 2021

N2 - Touch-less interaction is an active area of research due to its numerous applications ranging from medical systems to gaming. In this paper we propose a novel interactive system based on RealSense camera to track the pose of hand and to recognize gestures. Our approach is based on MediaPipe model introduced by Google to detect the landmarks of the hand. The system utilizes the camera calibration information and user actions to get the geometry of the deployed environment, which shows high accuracy in measurement of hand position. The touch-less interaction is demonstrated using a graphical user interface for painting.

AB - Touch-less interaction is an active area of research due to its numerous applications ranging from medical systems to gaming. In this paper we propose a novel interactive system based on RealSense camera to track the pose of hand and to recognize gestures. Our approach is based on MediaPipe model introduced by Google to detect the landmarks of the hand. The system utilizes the camera calibration information and user actions to get the geometry of the deployed environment, which shows high accuracy in measurement of hand position. The touch-less interaction is demonstrated using a graphical user interface for painting.

UR - http://www.scopus.com/inward/record.url?scp=85123538675&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85123538675&partnerID=8YFLogxK

U2 - 10.1109/NIR52917.2021.9666090

DO - 10.1109/NIR52917.2021.9666090

M3 - Conference contribution

AN - SCOPUS:85123538675

T3 - 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021

BT - 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021

Y2 - 26 August 2021 through 29 August 2021

ER -

A depth camera-based system to enable touch-less interaction using hand gestures

Abstract

Publication series

Conference

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this