Gesture-based mobile communication system providing side-by-side shopping feeling

Minghao Cai, Soh Masuko, Jiro Tanaka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This demo is a gesture-based communication framework designed for an immersive joint shopping scenario. It focuses on enhancing the mobile human-to-human interaction between two geographically separated users: an in-house user and an in-store user. By exploring the uses of depth-based tracking techniques and the integration of head-mounted displays and the spherical camera, we (1) construct an immersive virtual shopping environment for the in-house user remaining in a house and (2) offer a novel way for the users to achieve a real-time gestural communication in the physical shopping environment which the in-store user stays in, while (3) the latter gets an augmented reality experience. Through this demo, both users could share a feeling that they go for shopping side by side in the same place.

Original languageEnglish
Title of host publicationIUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450355711
DOIs
Publication statusPublished - 2018 Mar 5
Event23rd International Conference on Intelligent User Interfaces, IUI 2018 - Tokyo, Japan
Duration: 2018 Mar 72018 Mar 11

Other

Other23rd International Conference on Intelligent User Interfaces, IUI 2018
CountryJapan
CityTokyo
Period18/3/718/3/11

    Fingerprint

Keywords

  • Gesture communication
  • Immersive shopping
  • Remote collaboration

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Cite this

Cai, M., Masuko, S., & Tanaka, J. (2018). Gesture-based mobile communication system providing side-by-side shopping feeling. In IUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces [a2] Association for Computing Machinery. https://doi.org/10.1145/3180308.3180310