Resolving occlusion for 3D object manipulation with hands in mixed reality

Qi Feng, Hubert P.H. Shum, Shigeo Morishima

    研究成果: Conference contribution

    抜粋

    Due to the need to interact with virtual objects, the hand-object interaction has become an important element in mixed reality (MR) applications. In this paper, we propose a novel approach to handle the occlusion of augmented 3D object manipulation with hands by exploiting the nature of hand poses combined with tracking-based and model-based methods, to achieve a complete mixed reality experience without necessities of heavy computations, complex manual segmentation processes or wearing special gloves. The experimental results show a frame rate faster than real-time and a great accuracy of rendered virtual appearances, and a user study verifies a more immersive experience compared to past approaches. We believe that the proposed method can improve a wide range of mixed reality applications that involve hand-object interactions.

    元の言語English
    ホスト出版物のタイトルProceedings - VRST 2018
    ホスト出版物のサブタイトル24th ACM Symposium on Virtual Reality Software and Technology
    編集者Stephen N. Spencer
    出版者Association for Computing Machinery
    ISBN(電子版)9781450360869
    DOI
    出版物ステータスPublished - 2018 11 28
    イベント24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018 - Tokyo, Japan
    継続期間: 2018 11 282018 12 1

    Other

    Other24th ACM Symposium on Virtual Reality Software and Technology, VRST 2018
    Japan
    Tokyo
    期間18/11/2818/12/1

    ASJC Scopus subject areas

    • Software

    フィンガープリント Resolving occlusion for 3D object manipulation with hands in mixed reality' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Feng, Q., Shum, H. P. H., & Morishima, S. (2018). Resolving occlusion for 3D object manipulation with hands in mixed reality. : S. N. Spencer (版), Proceedings - VRST 2018: 24th ACM Symposium on Virtual Reality Software and Technology [3283390] Association for Computing Machinery. https://doi.org/10.1145/3281505.3283390