A location-sensitive visual interface on the palm: interacting with common objects in an augmented space

Seokhwan Kim, Shin Takahashi, Jiro Tanaka

Research output: Contribution to journalArticle


We have created a visual interface using the human palm that is location sensitive and always available. To accomplish this, we constructed an augmented space in an actual workspace by installing several depth cameras. To manage and connect the multiple depth cameras, we constructed a distributed system based on scalable client––server architecture. By merging depth images from different cameras, the distributed system can track the locations of users within their area of coverage. The system also has a convenient feature that allows users to collect the locations of objects while visualizing the objects via images from the depth cameras. Consequently, the locations of both users and objects are available to the system, thus providing a location-based context for determining which user is close to which object. As a result, the visual interface on the palm becomes location sensitive, which could lead to various applications in daily life. In this paper, we describe the implementation of the aforementioned system and demonstrate its potential applicability.

Original languageEnglish
Pages (from-to)175-187
Number of pages13
JournalPersonal and Ubiquitous Computing
Issue number1
Publication statusPublished - 2015 Jan 1
Externally publishedYes



  • Augmented reality
  • Interaction
  • Interface on body
  • Location awareness
  • System
  • Ubiquitous

ASJC Scopus subject areas

  • Hardware and Architecture
  • Computer Science Applications
  • Management Science and Operations Research

Cite this