“Real-time Both Hands Tracking Using Feature Point Gathering by KLT Tracker for Man-Machine Interface”

Ryosuke Araki, Takeshi Ikenaga

Research output: Contribution to journalArticle

Abstract

Intuitive man-machine interface based on a gesture with a touchpad device is becoming common. In the near future, the importance of gesture recognition using input from a video camera is expected to be high in order to widen applicable information terminals and their applications. Conventional works, however, use a complex input device combining plural cameras and sensors. Moreover, since most of their algorithms need high computational complexity and is good for images with a simple background, it's difficult to apply practical systems. This paper proposes a real-time single-input object tracking algorithm which can trace both hands precisely under a complex background. It makes it possible to attain both high accuracy and low complexity by applying a technique combining frame difference and color and decision of feature point gathering into the KLT (Kanade-Lucas-Tomasi) tracker, a kind of an optical flow. Software based evaluation results using a wide variety of test sequences (e.g. complex background and object shape change) show that the proposed algorithm achieves higher tracking accuracy compared with conventional ones. Furthermore, a processing performance is 13-16 frame per second, which means both hands can be tracked in real-time.

Original languageEnglish
Pages (from-to)833-841
Number of pages9
JournalJournal of the Institute of Image Electronics Engineers of Japan
Volume40
Issue number5
DOIs
Publication statusPublished - 2011

Fingerprint

Gesture recognition
Optical flows
Video cameras
Computational complexity
Cameras
Color
Sensors
Processing

Keywords

  • KLT Tracker
  • man-machine interface
  • object tracking
  • optical flow

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Electrical and Electronic Engineering

Cite this

@article{8f49525a36634b3e8ff05a1c06e4916c,
title = "“Real-time Both Hands Tracking Using Feature Point Gathering by KLT Tracker for Man-Machine Interface”",
abstract = "Intuitive man-machine interface based on a gesture with a touchpad device is becoming common. In the near future, the importance of gesture recognition using input from a video camera is expected to be high in order to widen applicable information terminals and their applications. Conventional works, however, use a complex input device combining plural cameras and sensors. Moreover, since most of their algorithms need high computational complexity and is good for images with a simple background, it's difficult to apply practical systems. This paper proposes a real-time single-input object tracking algorithm which can trace both hands precisely under a complex background. It makes it possible to attain both high accuracy and low complexity by applying a technique combining frame difference and color and decision of feature point gathering into the KLT (Kanade-Lucas-Tomasi) tracker, a kind of an optical flow. Software based evaluation results using a wide variety of test sequences (e.g. complex background and object shape change) show that the proposed algorithm achieves higher tracking accuracy compared with conventional ones. Furthermore, a processing performance is 13-16 frame per second, which means both hands can be tracked in real-time.",
keywords = "KLT Tracker, man-machine interface, object tracking, optical flow",
author = "Ryosuke Araki and Takeshi Ikenaga",
year = "2011",
doi = "10.11371/iieej.40.833",
language = "English",
volume = "40",
pages = "833--841",
journal = "Journal of the Institute of Image Electronics Engineers of Japan",
issn = "0285-9831",
publisher = "Institute of Image Electronics Engineers of Japan",
number = "5",

}

TY - JOUR

T1 - “Real-time Both Hands Tracking Using Feature Point Gathering by KLT Tracker for Man-Machine Interface”

AU - Araki, Ryosuke

AU - Ikenaga, Takeshi

PY - 2011

Y1 - 2011

N2 - Intuitive man-machine interface based on a gesture with a touchpad device is becoming common. In the near future, the importance of gesture recognition using input from a video camera is expected to be high in order to widen applicable information terminals and their applications. Conventional works, however, use a complex input device combining plural cameras and sensors. Moreover, since most of their algorithms need high computational complexity and is good for images with a simple background, it's difficult to apply practical systems. This paper proposes a real-time single-input object tracking algorithm which can trace both hands precisely under a complex background. It makes it possible to attain both high accuracy and low complexity by applying a technique combining frame difference and color and decision of feature point gathering into the KLT (Kanade-Lucas-Tomasi) tracker, a kind of an optical flow. Software based evaluation results using a wide variety of test sequences (e.g. complex background and object shape change) show that the proposed algorithm achieves higher tracking accuracy compared with conventional ones. Furthermore, a processing performance is 13-16 frame per second, which means both hands can be tracked in real-time.

AB - Intuitive man-machine interface based on a gesture with a touchpad device is becoming common. In the near future, the importance of gesture recognition using input from a video camera is expected to be high in order to widen applicable information terminals and their applications. Conventional works, however, use a complex input device combining plural cameras and sensors. Moreover, since most of their algorithms need high computational complexity and is good for images with a simple background, it's difficult to apply practical systems. This paper proposes a real-time single-input object tracking algorithm which can trace both hands precisely under a complex background. It makes it possible to attain both high accuracy and low complexity by applying a technique combining frame difference and color and decision of feature point gathering into the KLT (Kanade-Lucas-Tomasi) tracker, a kind of an optical flow. Software based evaluation results using a wide variety of test sequences (e.g. complex background and object shape change) show that the proposed algorithm achieves higher tracking accuracy compared with conventional ones. Furthermore, a processing performance is 13-16 frame per second, which means both hands can be tracked in real-time.

KW - KLT Tracker

KW - man-machine interface

KW - object tracking

KW - optical flow

UR - http://www.scopus.com/inward/record.url?scp=85024745155&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85024745155&partnerID=8YFLogxK

U2 - 10.11371/iieej.40.833

DO - 10.11371/iieej.40.833

M3 - Article

AN - SCOPUS:85024745155

VL - 40

SP - 833

EP - 841

JO - Journal of the Institute of Image Electronics Engineers of Japan

JF - Journal of the Institute of Image Electronics Engineers of Japan

SN - 0285-9831

IS - 5

ER -