Facial tracking-assisted hand pointing technique for wall-sized displays

Haokan Cheng, Takahashi Shin, Jiro Tanaka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we propose a novel pointing technique leveraging the user’s body motion to achieve smooth, efficient user experiences on wall-sized displays. Our proposal substantially consists of two parts: a graphical cursor controlled by the user’s hand motions, and mechanisms to assist the cursor manipulation by tracking the user’s face orientation. By interaction design associating the user’s face and hand motions to different aspects of the cursor’s movement, we aimed to bring swiftness to the interaction in large-display environments with necessary precision. A prototype was built to instantiate the concept, and two comparative experiments were conducted to evaluate the effectiveness of the proposal.

Original languageEnglish
Title of host publicationDistributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings
PublisherSpringer Verlag
Pages191-201
Number of pages11
Volume9749
ISBN (Print)9783319398617
DOIs
Publication statusPublished - 2016
Externally publishedYes
Event18th International Conference on Human-Computer Interaction, HCI International 2016 - Toronto, Canada
Duration: 2016 Jul 172016 Jul 22

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9749
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other18th International Conference on Human-Computer Interaction, HCI International 2016
CountryCanada
CityToronto
Period16/7/1716/7/22

Fingerprint

Display
Display devices
Motion
Face
Interaction Design
User Experience
Manipulation
Experiments
Prototype
Necessary
Evaluate
Interaction
Experiment

Keywords

  • Facial tracking
  • Input method
  • Pointing technique
  • Wall-sized display

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Cheng, H., Shin, T., & Tanaka, J. (2016). Facial tracking-assisted hand pointing technique for wall-sized displays. In Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings (Vol. 9749, pp. 191-201). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9749). Springer Verlag. https://doi.org/10.1007/978-3-319-39862-4_18

Facial tracking-assisted hand pointing technique for wall-sized displays. / Cheng, Haokan; Shin, Takahashi; Tanaka, Jiro.

Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings. Vol. 9749 Springer Verlag, 2016. p. 191-201 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9749).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cheng, H, Shin, T & Tanaka, J 2016, Facial tracking-assisted hand pointing technique for wall-sized displays. in Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings. vol. 9749, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9749, Springer Verlag, pp. 191-201, 18th International Conference on Human-Computer Interaction, HCI International 2016, Toronto, Canada, 16/7/17. https://doi.org/10.1007/978-3-319-39862-4_18
Cheng H, Shin T, Tanaka J. Facial tracking-assisted hand pointing technique for wall-sized displays. In Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings. Vol. 9749. Springer Verlag. 2016. p. 191-201. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-39862-4_18
Cheng, Haokan ; Shin, Takahashi ; Tanaka, Jiro. / Facial tracking-assisted hand pointing technique for wall-sized displays. Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings. Vol. 9749 Springer Verlag, 2016. pp. 191-201 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{6a89e80d8eb44381afc0b11d67951ce9,
title = "Facial tracking-assisted hand pointing technique for wall-sized displays",
abstract = "In this paper we propose a novel pointing technique leveraging the user’s body motion to achieve smooth, efficient user experiences on wall-sized displays. Our proposal substantially consists of two parts: a graphical cursor controlled by the user’s hand motions, and mechanisms to assist the cursor manipulation by tracking the user’s face orientation. By interaction design associating the user’s face and hand motions to different aspects of the cursor’s movement, we aimed to bring swiftness to the interaction in large-display environments with necessary precision. A prototype was built to instantiate the concept, and two comparative experiments were conducted to evaluate the effectiveness of the proposal.",
keywords = "Facial tracking, Input method, Pointing technique, Wall-sized display",
author = "Haokan Cheng and Takahashi Shin and Jiro Tanaka",
year = "2016",
doi = "10.1007/978-3-319-39862-4_18",
language = "English",
isbn = "9783319398617",
volume = "9749",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "191--201",
booktitle = "Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings",
address = "Germany",

}

TY - GEN

T1 - Facial tracking-assisted hand pointing technique for wall-sized displays

AU - Cheng, Haokan

AU - Shin, Takahashi

AU - Tanaka, Jiro

PY - 2016

Y1 - 2016

N2 - In this paper we propose a novel pointing technique leveraging the user’s body motion to achieve smooth, efficient user experiences on wall-sized displays. Our proposal substantially consists of two parts: a graphical cursor controlled by the user’s hand motions, and mechanisms to assist the cursor manipulation by tracking the user’s face orientation. By interaction design associating the user’s face and hand motions to different aspects of the cursor’s movement, we aimed to bring swiftness to the interaction in large-display environments with necessary precision. A prototype was built to instantiate the concept, and two comparative experiments were conducted to evaluate the effectiveness of the proposal.

AB - In this paper we propose a novel pointing technique leveraging the user’s body motion to achieve smooth, efficient user experiences on wall-sized displays. Our proposal substantially consists of two parts: a graphical cursor controlled by the user’s hand motions, and mechanisms to assist the cursor manipulation by tracking the user’s face orientation. By interaction design associating the user’s face and hand motions to different aspects of the cursor’s movement, we aimed to bring swiftness to the interaction in large-display environments with necessary precision. A prototype was built to instantiate the concept, and two comparative experiments were conducted to evaluate the effectiveness of the proposal.

KW - Facial tracking

KW - Input method

KW - Pointing technique

KW - Wall-sized display

UR - http://www.scopus.com/inward/record.url?scp=84978803903&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84978803903&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-39862-4_18

DO - 10.1007/978-3-319-39862-4_18

M3 - Conference contribution

AN - SCOPUS:84978803903

SN - 9783319398617

VL - 9749

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 191

EP - 201

BT - Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings

PB - Springer Verlag

ER -