Multiple-hand-gesture tracking using multiple cameras

Akira Utsumi, Jun Ohya

Research output: Chapter in Book/Report/Conference proceedingChapter

72 Citations (Scopus)

Abstract

We propose a method of tracking 3D position, posture, and shapes of human hands from multiple-viewpoint images. Self-occlusion and hand-hand occlusion are serious problems in the vision-based hand tracking. Our system employs multiple-viewpoint and viewpoint selection mechanism to reduce these problems. Each hand position is tracked with a Kalman filter and the motion vectors are updated with image features in selected images that do not include hand-hand occlusion. 3D hand postures are estimated with a small number of reliable image features. These features are extracted based on distance transformation, and they are robust against changes in hand shape and self-occlusion. Finally, a `best view' image is selected for each hand for shape recognition. The shape recognition process is based on a Fourier descriptor. Our system can be used as a user interface device in a virtual environment, replacing glove-type devices and overcoming most of the disadvantages of contact-type devices.

Original languageEnglish
Title of host publicationProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
PublisherIEEE
Pages473-478
Number of pages6
Volume1
Publication statusPublished - 1999
Externally publishedYes
EventProceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'99) - Fort Collins, CO, USA
Duration: 1999 Jun 231999 Jun 25

Other

OtherProceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'99)
CityFort Collins, CO, USA
Period99/6/2399/6/25

Fingerprint

Kalman filters
Virtual reality
User interfaces
Cameras

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Software
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Utsumi, A., & Ohya, J. (1999). Multiple-hand-gesture tracking using multiple cameras. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Vol. 1, pp. 473-478). IEEE.

Multiple-hand-gesture tracking using multiple cameras. / Utsumi, Akira; Ohya, Jun.

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Vol. 1 IEEE, 1999. p. 473-478.

Research output: Chapter in Book/Report/Conference proceedingChapter

Utsumi, A & Ohya, J 1999, Multiple-hand-gesture tracking using multiple cameras. in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. vol. 1, IEEE, pp. 473-478, Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'99), Fort Collins, CO, USA, 99/6/23.
Utsumi A, Ohya J. Multiple-hand-gesture tracking using multiple cameras. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Vol. 1. IEEE. 1999. p. 473-478
Utsumi, Akira ; Ohya, Jun. / Multiple-hand-gesture tracking using multiple cameras. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Vol. 1 IEEE, 1999. pp. 473-478
@inbook{d8ecc23dfbb945629ba08fb6c7529af6,
title = "Multiple-hand-gesture tracking using multiple cameras",
abstract = "We propose a method of tracking 3D position, posture, and shapes of human hands from multiple-viewpoint images. Self-occlusion and hand-hand occlusion are serious problems in the vision-based hand tracking. Our system employs multiple-viewpoint and viewpoint selection mechanism to reduce these problems. Each hand position is tracked with a Kalman filter and the motion vectors are updated with image features in selected images that do not include hand-hand occlusion. 3D hand postures are estimated with a small number of reliable image features. These features are extracted based on distance transformation, and they are robust against changes in hand shape and self-occlusion. Finally, a `best view' image is selected for each hand for shape recognition. The shape recognition process is based on a Fourier descriptor. Our system can be used as a user interface device in a virtual environment, replacing glove-type devices and overcoming most of the disadvantages of contact-type devices.",
author = "Akira Utsumi and Jun Ohya",
year = "1999",
language = "English",
volume = "1",
pages = "473--478",
booktitle = "Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition",
publisher = "IEEE",

}

TY - CHAP

T1 - Multiple-hand-gesture tracking using multiple cameras

AU - Utsumi, Akira

AU - Ohya, Jun

PY - 1999

Y1 - 1999

N2 - We propose a method of tracking 3D position, posture, and shapes of human hands from multiple-viewpoint images. Self-occlusion and hand-hand occlusion are serious problems in the vision-based hand tracking. Our system employs multiple-viewpoint and viewpoint selection mechanism to reduce these problems. Each hand position is tracked with a Kalman filter and the motion vectors are updated with image features in selected images that do not include hand-hand occlusion. 3D hand postures are estimated with a small number of reliable image features. These features are extracted based on distance transformation, and they are robust against changes in hand shape and self-occlusion. Finally, a `best view' image is selected for each hand for shape recognition. The shape recognition process is based on a Fourier descriptor. Our system can be used as a user interface device in a virtual environment, replacing glove-type devices and overcoming most of the disadvantages of contact-type devices.

AB - We propose a method of tracking 3D position, posture, and shapes of human hands from multiple-viewpoint images. Self-occlusion and hand-hand occlusion are serious problems in the vision-based hand tracking. Our system employs multiple-viewpoint and viewpoint selection mechanism to reduce these problems. Each hand position is tracked with a Kalman filter and the motion vectors are updated with image features in selected images that do not include hand-hand occlusion. 3D hand postures are estimated with a small number of reliable image features. These features are extracted based on distance transformation, and they are robust against changes in hand shape and self-occlusion. Finally, a `best view' image is selected for each hand for shape recognition. The shape recognition process is based on a Fourier descriptor. Our system can be used as a user interface device in a virtual environment, replacing glove-type devices and overcoming most of the disadvantages of contact-type devices.

UR - http://www.scopus.com/inward/record.url?scp=0032655039&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032655039&partnerID=8YFLogxK

M3 - Chapter

VL - 1

SP - 473

EP - 478

BT - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

PB - IEEE

ER -