Short Range Fingertip Pointing Operation Interface by Depth Camera

K. Horiuchi, Takafumi Matsumaru

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this research, we proposed and implemented a finger pointing detection system with a short-range type depth camera. The most widely used pointing device for a computer interface is a mouse, and as an alternative there is a depth sensor to detect hand and finger movement. However, in the present literature, since the user must operate the cursor at a relatively large distance from the detection device, the user needs to raise his arm and make wide movements, which is inconvenient over long periods of time. To solve such usability problem, we proposed a comfortable and easy to use method by narrowing the distance between the keyboard and the pointing device. Next, we compared various depth sensors and selected one that can recognize even small movements Additionally, we proposed a mapping method between the users perceived cursor position and the real one pointed by the index finger direction. Furthermore, we compared our pointing method with a mouse and touch pad for the usability, accuracy and working speed. The results showed that it has users have better performance on continuous operation of character input from the keyboard and cursor pointing.

Original languageEnglish
Title of host publication2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages132-137
Number of pages6
ISBN (Electronic)9781728103761
DOIs
Publication statusPublished - 2019 Mar 11
Event2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018 - Kuala Lumpur, Malaysia
Duration: 2018 Dec 122018 Dec 15

Publication series

Name2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018

Conference

Conference2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018
CountryMalaysia
CityKuala Lumpur
Period18/12/1218/12/15

Fingerprint

Fingers
Cameras
Equipment and Supplies
Sensors
Interfaces (computer)
Touch
Arm
Hand
Research
Direction compound

ASJC Scopus subject areas

  • Biotechnology
  • Artificial Intelligence
  • Human-Computer Interaction

Cite this

Horiuchi, K., & Matsumaru, T. (2019). Short Range Fingertip Pointing Operation Interface by Depth Camera. In 2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018 (pp. 132-137). [8665254] (2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ROBIO.2018.8665254

Short Range Fingertip Pointing Operation Interface by Depth Camera. / Horiuchi, K.; Matsumaru, Takafumi.

2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018. Institute of Electrical and Electronics Engineers Inc., 2019. p. 132-137 8665254 (2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Horiuchi, K & Matsumaru, T 2019, Short Range Fingertip Pointing Operation Interface by Depth Camera. in 2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018., 8665254, 2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018, Institute of Electrical and Electronics Engineers Inc., pp. 132-137, 2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018, Kuala Lumpur, Malaysia, 18/12/12. https://doi.org/10.1109/ROBIO.2018.8665254
Horiuchi K, Matsumaru T. Short Range Fingertip Pointing Operation Interface by Depth Camera. In 2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018. Institute of Electrical and Electronics Engineers Inc. 2019. p. 132-137. 8665254. (2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018). https://doi.org/10.1109/ROBIO.2018.8665254
Horiuchi, K. ; Matsumaru, Takafumi. / Short Range Fingertip Pointing Operation Interface by Depth Camera. 2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 132-137 (2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018).
@inproceedings{b4aca4ec4e8a41fa936a541bdccf7080,
title = "Short Range Fingertip Pointing Operation Interface by Depth Camera",
abstract = "In this research, we proposed and implemented a finger pointing detection system with a short-range type depth camera. The most widely used pointing device for a computer interface is a mouse, and as an alternative there is a depth sensor to detect hand and finger movement. However, in the present literature, since the user must operate the cursor at a relatively large distance from the detection device, the user needs to raise his arm and make wide movements, which is inconvenient over long periods of time. To solve such usability problem, we proposed a comfortable and easy to use method by narrowing the distance between the keyboard and the pointing device. Next, we compared various depth sensors and selected one that can recognize even small movements Additionally, we proposed a mapping method between the users perceived cursor position and the real one pointed by the index finger direction. Furthermore, we compared our pointing method with a mouse and touch pad for the usability, accuracy and working speed. The results showed that it has users have better performance on continuous operation of character input from the keyboard and cursor pointing.",
author = "K. Horiuchi and Takafumi Matsumaru",
year = "2019",
month = "3",
day = "11",
doi = "10.1109/ROBIO.2018.8665254",
language = "English",
series = "2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "132--137",
booktitle = "2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018",

}

TY - GEN

T1 - Short Range Fingertip Pointing Operation Interface by Depth Camera

AU - Horiuchi, K.

AU - Matsumaru, Takafumi

PY - 2019/3/11

Y1 - 2019/3/11

N2 - In this research, we proposed and implemented a finger pointing detection system with a short-range type depth camera. The most widely used pointing device for a computer interface is a mouse, and as an alternative there is a depth sensor to detect hand and finger movement. However, in the present literature, since the user must operate the cursor at a relatively large distance from the detection device, the user needs to raise his arm and make wide movements, which is inconvenient over long periods of time. To solve such usability problem, we proposed a comfortable and easy to use method by narrowing the distance between the keyboard and the pointing device. Next, we compared various depth sensors and selected one that can recognize even small movements Additionally, we proposed a mapping method between the users perceived cursor position and the real one pointed by the index finger direction. Furthermore, we compared our pointing method with a mouse and touch pad for the usability, accuracy and working speed. The results showed that it has users have better performance on continuous operation of character input from the keyboard and cursor pointing.

AB - In this research, we proposed and implemented a finger pointing detection system with a short-range type depth camera. The most widely used pointing device for a computer interface is a mouse, and as an alternative there is a depth sensor to detect hand and finger movement. However, in the present literature, since the user must operate the cursor at a relatively large distance from the detection device, the user needs to raise his arm and make wide movements, which is inconvenient over long periods of time. To solve such usability problem, we proposed a comfortable and easy to use method by narrowing the distance between the keyboard and the pointing device. Next, we compared various depth sensors and selected one that can recognize even small movements Additionally, we proposed a mapping method between the users perceived cursor position and the real one pointed by the index finger direction. Furthermore, we compared our pointing method with a mouse and touch pad for the usability, accuracy and working speed. The results showed that it has users have better performance on continuous operation of character input from the keyboard and cursor pointing.

UR - http://www.scopus.com/inward/record.url?scp=85064118789&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064118789&partnerID=8YFLogxK

U2 - 10.1109/ROBIO.2018.8665254

DO - 10.1109/ROBIO.2018.8665254

M3 - Conference contribution

T3 - 2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018

SP - 132

EP - 137

BT - 2018 IEEE International Conference on Robotics and Biomimetics, ROBIO 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -