Gesture-based mobile communication system providing side-by-side shopping feeling

Minghao Cai, Soh Masuko, Jiro Tanaka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This demo is a gesture-based communication framework designed for an immersive joint shopping scenario. It focuses on enhancing the mobile human-to-human interaction between two geographically separated users: an in-house user and an in-store user. By exploring the uses of depth-based tracking techniques and the integration of head-mounted displays and the spherical camera, we (1) construct an immersive virtual shopping environment for the in-house user remaining in a house and (2) offer a novel way for the users to achieve a real-time gestural communication in the physical shopping environment which the in-store user stays in, while (3) the latter gets an augmented reality experience. Through this demo, both users could share a feeling that they go for shopping side by side in the same place.

Original languageEnglish
Title of host publicationIUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450355711
DOIs
Publication statusPublished - 2018 Mar 5
Event23rd International Conference on Intelligent User Interfaces, IUI 2018 - Tokyo, Japan
Duration: 2018 Mar 72018 Mar 11

Other

Other23rd International Conference on Intelligent User Interfaces, IUI 2018
CountryJapan
CityTokyo
Period18/3/718/3/11

Fingerprint

Mobile telecommunication systems
Augmented reality
Communication
Cameras
Display devices

Keywords

  • Gesture communication
  • Immersive shopping
  • Remote collaboration

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Cite this

Cai, M., Masuko, S., & Tanaka, J. (2018). Gesture-based mobile communication system providing side-by-side shopping feeling. In IUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces [a2] Association for Computing Machinery. https://doi.org/10.1145/3180308.3180310

Gesture-based mobile communication system providing side-by-side shopping feeling. / Cai, Minghao; Masuko, Soh; Tanaka, Jiro.

IUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces. Association for Computing Machinery, 2018. a2.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cai, M, Masuko, S & Tanaka, J 2018, Gesture-based mobile communication system providing side-by-side shopping feeling. in IUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces., a2, Association for Computing Machinery, 23rd International Conference on Intelligent User Interfaces, IUI 2018, Tokyo, Japan, 18/3/7. https://doi.org/10.1145/3180308.3180310
Cai M, Masuko S, Tanaka J. Gesture-based mobile communication system providing side-by-side shopping feeling. In IUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces. Association for Computing Machinery. 2018. a2 https://doi.org/10.1145/3180308.3180310
Cai, Minghao ; Masuko, Soh ; Tanaka, Jiro. / Gesture-based mobile communication system providing side-by-side shopping feeling. IUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces. Association for Computing Machinery, 2018.
@inproceedings{a198f385046e44ad8f90a0a0ffb7d650,
title = "Gesture-based mobile communication system providing side-by-side shopping feeling",
abstract = "This demo is a gesture-based communication framework designed for an immersive joint shopping scenario. It focuses on enhancing the mobile human-to-human interaction between two geographically separated users: an in-house user and an in-store user. By exploring the uses of depth-based tracking techniques and the integration of head-mounted displays and the spherical camera, we (1) construct an immersive virtual shopping environment for the in-house user remaining in a house and (2) offer a novel way for the users to achieve a real-time gestural communication in the physical shopping environment which the in-store user stays in, while (3) the latter gets an augmented reality experience. Through this demo, both users could share a feeling that they go for shopping side by side in the same place.",
keywords = "Gesture communication, Immersive shopping, Remote collaboration",
author = "Minghao Cai and Soh Masuko and Jiro Tanaka",
year = "2018",
month = "3",
day = "5",
doi = "10.1145/3180308.3180310",
language = "English",
booktitle = "IUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Gesture-based mobile communication system providing side-by-side shopping feeling

AU - Cai, Minghao

AU - Masuko, Soh

AU - Tanaka, Jiro

PY - 2018/3/5

Y1 - 2018/3/5

N2 - This demo is a gesture-based communication framework designed for an immersive joint shopping scenario. It focuses on enhancing the mobile human-to-human interaction between two geographically separated users: an in-house user and an in-store user. By exploring the uses of depth-based tracking techniques and the integration of head-mounted displays and the spherical camera, we (1) construct an immersive virtual shopping environment for the in-house user remaining in a house and (2) offer a novel way for the users to achieve a real-time gestural communication in the physical shopping environment which the in-store user stays in, while (3) the latter gets an augmented reality experience. Through this demo, both users could share a feeling that they go for shopping side by side in the same place.

AB - This demo is a gesture-based communication framework designed for an immersive joint shopping scenario. It focuses on enhancing the mobile human-to-human interaction between two geographically separated users: an in-house user and an in-store user. By exploring the uses of depth-based tracking techniques and the integration of head-mounted displays and the spherical camera, we (1) construct an immersive virtual shopping environment for the in-house user remaining in a house and (2) offer a novel way for the users to achieve a real-time gestural communication in the physical shopping environment which the in-store user stays in, while (3) the latter gets an augmented reality experience. Through this demo, both users could share a feeling that they go for shopping side by side in the same place.

KW - Gesture communication

KW - Immersive shopping

KW - Remote collaboration

UR - http://www.scopus.com/inward/record.url?scp=85045141112&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045141112&partnerID=8YFLogxK

U2 - 10.1145/3180308.3180310

DO - 10.1145/3180308.3180310

M3 - Conference contribution

BT - IUI 2018 - Companion of the 23rd International Conference on Intelligent User Interfaces

PB - Association for Computing Machinery

ER -