Three-dimensional aerial image interface, 3DAII

Takafumi Matsumaru, Asyifa Imanda Septiana, Kazuki Horiuchi

Research output: Contribution to journalArticle

Abstract

In this paper, we introduce the three-dimensional aerial image interface, 3DAII. This interface reconstructs and aerially projects a three-dimensional object image, which can be simultaneously observed from various viewpoints or by multiple users with the naked eye. A pyramid reflector is used to reconstruct the object image, and a pair of parabolic mirrors is used to aerially project the image. A user can directly manipulate the three-dimensional object image by superimposing a user’s hand-finger or a rod on the image. A motion capture sensor detects the user’s hand-finger that manipulates the projected image, and the system immediately exhibits some reaction such as deformation, displacement, and discoloration of the object image, including sound effects. A performance test is executed to confirm the functions of 3DAII. The execution time of the end-tip positioning of a robotic arm has been compared among four operating devices: touchscreen, gamepad, joystick, and 3DAII. The results exhibit the advantages of 3DAII; we can directly instruct the movement direction and movement speed of the end-tip of the robotic arm, using the three-dimensional Euclidean vector outputs of 3DAII in which we can intuitively make the end-tip of the robotic arm move in three-dimensional space. Therefore, 3DAII would be one important alternative to an intuitive spatial user interface, e.g., an operation device of aerial robots, a center console of automobiles, and a 3D modelling system. A survey has been conducted to evaluate comfort and fatigue based on ISO/TS 9241-411 and ease of learning and satisfaction based on the USE questionnaire. We have identified several challenges related to visibility, workspace, and sensory feedback to users that we would like to address in the future.

Original languageEnglish
Pages (from-to)657-670
Number of pages14
JournalJournal of Robotics and Mechatronics
Volume31
Issue number5
DOIs
Publication statusPublished - 2019 Oct

Fingerprint

Robotic arms
Antennas
Sensory feedback
Discoloration
Touch screens
Visibility
User interfaces
Automobiles
Acoustic waves
Fatigue of materials
Robots
Sensors

Keywords

  • Aerial projection display
  • Direct interaction interface
  • Parabolic mirrors
  • Pyramid reflector
  • Three-dimensional object image

ASJC Scopus subject areas

  • Computer Science(all)
  • Electrical and Electronic Engineering

Cite this

Three-dimensional aerial image interface, 3DAII. / Matsumaru, Takafumi; Septiana, Asyifa Imanda; Horiuchi, Kazuki.

In: Journal of Robotics and Mechatronics, Vol. 31, No. 5, 10.2019, p. 657-670.

Research output: Contribution to journalArticle

Matsumaru, Takafumi ; Septiana, Asyifa Imanda ; Horiuchi, Kazuki. / Three-dimensional aerial image interface, 3DAII. In: Journal of Robotics and Mechatronics. 2019 ; Vol. 31, No. 5. pp. 657-670.
@article{5c72d1c147ae437ca2255400608927ae,
title = "Three-dimensional aerial image interface, 3DAII",
abstract = "In this paper, we introduce the three-dimensional aerial image interface, 3DAII. This interface reconstructs and aerially projects a three-dimensional object image, which can be simultaneously observed from various viewpoints or by multiple users with the naked eye. A pyramid reflector is used to reconstruct the object image, and a pair of parabolic mirrors is used to aerially project the image. A user can directly manipulate the three-dimensional object image by superimposing a user’s hand-finger or a rod on the image. A motion capture sensor detects the user’s hand-finger that manipulates the projected image, and the system immediately exhibits some reaction such as deformation, displacement, and discoloration of the object image, including sound effects. A performance test is executed to confirm the functions of 3DAII. The execution time of the end-tip positioning of a robotic arm has been compared among four operating devices: touchscreen, gamepad, joystick, and 3DAII. The results exhibit the advantages of 3DAII; we can directly instruct the movement direction and movement speed of the end-tip of the robotic arm, using the three-dimensional Euclidean vector outputs of 3DAII in which we can intuitively make the end-tip of the robotic arm move in three-dimensional space. Therefore, 3DAII would be one important alternative to an intuitive spatial user interface, e.g., an operation device of aerial robots, a center console of automobiles, and a 3D modelling system. A survey has been conducted to evaluate comfort and fatigue based on ISO/TS 9241-411 and ease of learning and satisfaction based on the USE questionnaire. We have identified several challenges related to visibility, workspace, and sensory feedback to users that we would like to address in the future.",
keywords = "Aerial projection display, Direct interaction interface, Parabolic mirrors, Pyramid reflector, Three-dimensional object image",
author = "Takafumi Matsumaru and Septiana, {Asyifa Imanda} and Kazuki Horiuchi",
year = "2019",
month = "10",
doi = "10.20965/jrm.2019.p0657",
language = "English",
volume = "31",
pages = "657--670",
journal = "Journal of Robotics and Mechatronics",
issn = "0915-3942",
publisher = "Fuji Technology Press",
number = "5",

}

TY - JOUR

T1 - Three-dimensional aerial image interface, 3DAII

AU - Matsumaru, Takafumi

AU - Septiana, Asyifa Imanda

AU - Horiuchi, Kazuki

PY - 2019/10

Y1 - 2019/10

N2 - In this paper, we introduce the three-dimensional aerial image interface, 3DAII. This interface reconstructs and aerially projects a three-dimensional object image, which can be simultaneously observed from various viewpoints or by multiple users with the naked eye. A pyramid reflector is used to reconstruct the object image, and a pair of parabolic mirrors is used to aerially project the image. A user can directly manipulate the three-dimensional object image by superimposing a user’s hand-finger or a rod on the image. A motion capture sensor detects the user’s hand-finger that manipulates the projected image, and the system immediately exhibits some reaction such as deformation, displacement, and discoloration of the object image, including sound effects. A performance test is executed to confirm the functions of 3DAII. The execution time of the end-tip positioning of a robotic arm has been compared among four operating devices: touchscreen, gamepad, joystick, and 3DAII. The results exhibit the advantages of 3DAII; we can directly instruct the movement direction and movement speed of the end-tip of the robotic arm, using the three-dimensional Euclidean vector outputs of 3DAII in which we can intuitively make the end-tip of the robotic arm move in three-dimensional space. Therefore, 3DAII would be one important alternative to an intuitive spatial user interface, e.g., an operation device of aerial robots, a center console of automobiles, and a 3D modelling system. A survey has been conducted to evaluate comfort and fatigue based on ISO/TS 9241-411 and ease of learning and satisfaction based on the USE questionnaire. We have identified several challenges related to visibility, workspace, and sensory feedback to users that we would like to address in the future.

AB - In this paper, we introduce the three-dimensional aerial image interface, 3DAII. This interface reconstructs and aerially projects a three-dimensional object image, which can be simultaneously observed from various viewpoints or by multiple users with the naked eye. A pyramid reflector is used to reconstruct the object image, and a pair of parabolic mirrors is used to aerially project the image. A user can directly manipulate the three-dimensional object image by superimposing a user’s hand-finger or a rod on the image. A motion capture sensor detects the user’s hand-finger that manipulates the projected image, and the system immediately exhibits some reaction such as deformation, displacement, and discoloration of the object image, including sound effects. A performance test is executed to confirm the functions of 3DAII. The execution time of the end-tip positioning of a robotic arm has been compared among four operating devices: touchscreen, gamepad, joystick, and 3DAII. The results exhibit the advantages of 3DAII; we can directly instruct the movement direction and movement speed of the end-tip of the robotic arm, using the three-dimensional Euclidean vector outputs of 3DAII in which we can intuitively make the end-tip of the robotic arm move in three-dimensional space. Therefore, 3DAII would be one important alternative to an intuitive spatial user interface, e.g., an operation device of aerial robots, a center console of automobiles, and a 3D modelling system. A survey has been conducted to evaluate comfort and fatigue based on ISO/TS 9241-411 and ease of learning and satisfaction based on the USE questionnaire. We have identified several challenges related to visibility, workspace, and sensory feedback to users that we would like to address in the future.

KW - Aerial projection display

KW - Direct interaction interface

KW - Parabolic mirrors

KW - Pyramid reflector

KW - Three-dimensional object image

UR - http://www.scopus.com/inward/record.url?scp=85074235205&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074235205&partnerID=8YFLogxK

U2 - 10.20965/jrm.2019.p0657

DO - 10.20965/jrm.2019.p0657

M3 - Article

AN - SCOPUS:85074235205

VL - 31

SP - 657

EP - 670

JO - Journal of Robotics and Mechatronics

JF - Journal of Robotics and Mechatronics

SN - 0915-3942

IS - 5

ER -