Resolving occlusion for 3D object manipulation with hands in mixed reality

Qi Feng, Hubert P.H. Shum, Shigeo Morishima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Due to the need to interact with virtual objects, the hand-object interaction has become an important element in mixed reality (MR) applications. In this paper, we propose a novel approach to handle the occlusion of augmented 3D object manipulation with hands by exploiting the nature of hand poses combined with tracking-based and model-based methods, to achieve a complete mixed reality experience without necessities of heavy computations, complex manual segmentation processes or wearing special gloves. The experimental results show a frame rate faster than real-time and a great accuracy of rendered virtual appearances, and a user study verifies a more immersive experience compared to past approaches. We believe that the proposed method can improve a wide range of mixed reality applications that involve hand-object interactions.

Original languageEnglish
Title of host publicationProceedings - VRST 2018
Subtitle of host publication24th ACM Symposium on Virtual Reality Software and Technology
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450360869
DOIs
Publication statusPublished - 2018 Nov 28
Event24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018 - Tokyo, Japan
Duration: 2018 Nov 282018 Dec 1

Publication series

NameProceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST

Other

Other24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018
CountryJapan
CityTokyo
Period18/11/2818/12/1

Keywords

  • Hand tracking
  • Mixed Reality
  • Occlusion

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Resolving occlusion for 3D object manipulation with hands in mixed reality'. Together they form a unique fingerprint.

Cite this