Facial tracking-assisted hand pointing technique for wall-sized displays

Haokan Cheng; Takahashi Shin; Jiro Tanaka

doi:10.1007/978-3-319-39862-4_18

Facial tracking-assisted hand pointing technique for wall-sized displays

Haokan Cheng, Takahashi Shin, Jiro Tanaka

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this paper we propose a novel pointing technique leveraging the user’s body motion to achieve smooth, efficient user experiences on wall-sized displays. Our proposal substantially consists of two parts: a graphical cursor controlled by the user’s hand motions, and mechanisms to assist the cursor manipulation by tracking the user’s face orientation. By interaction design associating the user’s face and hand motions to different aspects of the cursor’s movement, we aimed to bring swiftness to the interaction in large-display environments with necessary precision. A prototype was built to instantiate the concept, and two comparative experiments were conducted to evaluate the effectiveness of the proposal.

Original language	English
Title of host publication	Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings
Publisher	Springer Verlag
Pages	191-201
Number of pages	11
Volume	9749
ISBN (Print)	9783319398617
DOIs	https://doi.org/10.1007/978-3-319-39862-4_18
Publication status	Published - 2016
Externally published	Yes
Event	18th International Conference on Human-Computer Interaction, HCI International 2016 - Toronto, Canada Duration: 2016 Jul 17 → 2016 Jul 22

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9749
ISSN (Print)	03029743
ISSN (Electronic)	16113349

Other

Other	18th International Conference on Human-Computer Interaction, HCI International 2016
Country	Canada
City	Toronto
Period	16/7/17 → 16/7/22

Fingerprint

Keywords

Facial tracking
Input method
Pointing technique
Wall-sized display

ASJC Scopus subject areas

Computer Science(all)
Theoretical Computer Science

Cite this

Cheng, H., Shin, T., & Tanaka, J. (2016). Facial tracking-assisted hand pointing technique for wall-sized displays. In Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings (Vol. 9749, pp. 191-201). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9749). Springer Verlag. https://doi.org/10.1007/978-3-319-39862-4_18

Facial tracking-assisted hand pointing technique for wall-sized displays. / Cheng, Haokan; Shin, Takahashi; Tanaka, Jiro.

Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings. Vol. 9749 Springer Verlag, 2016. p. 191-201 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9749).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Cheng, H, Shin, T & Tanaka, J 2016, Facial tracking-assisted hand pointing technique for wall-sized displays. in Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings. vol. 9749, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9749, Springer Verlag, pp. 191-201, 18th International Conference on Human-Computer Interaction, HCI International 2016, Toronto, Canada, 16/7/17. https://doi.org/10.1007/978-3-319-39862-4_18

Cheng H, Shin T, Tanaka J. Facial tracking-assisted hand pointing technique for wall-sized displays. In Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings. Vol. 9749. Springer Verlag. 2016. p. 191-201. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-39862-4_18

Cheng, Haokan ; Shin, Takahashi ; Tanaka, Jiro. / Facial tracking-assisted hand pointing technique for wall-sized displays. Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings. Vol. 9749 Springer Verlag, 2016. pp. 191-201 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{6a89e80d8eb44381afc0b11d67951ce9,

title = "Facial tracking-assisted hand pointing technique for wall-sized displays",

abstract = "In this paper we propose a novel pointing technique leveraging the user{\textquoteright}s body motion to achieve smooth, efficient user experiences on wall-sized displays. Our proposal substantially consists of two parts: a graphical cursor controlled by the user{\textquoteright}s hand motions, and mechanisms to assist the cursor manipulation by tracking the user{\textquoteright}s face orientation. By interaction design associating the user{\textquoteright}s face and hand motions to different aspects of the cursor{\textquoteright}s movement, we aimed to bring swiftness to the interaction in large-display environments with necessary precision. A prototype was built to instantiate the concept, and two comparative experiments were conducted to evaluate the effectiveness of the proposal.",

keywords = "Facial tracking, Input method, Pointing technique, Wall-sized display",

author = "Haokan Cheng and Takahashi Shin and Jiro Tanaka",

year = "2016",

doi = "10.1007/978-3-319-39862-4_18",

language = "English",

isbn = "9783319398617",

volume = "9749",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "191--201",

booktitle = "Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings",

address = "Germany",

note = "18th International Conference on Human-Computer Interaction, HCI International 2016 ; Conference date: 17-07-2016 Through 22-07-2016",

}

TY - GEN

T1 - Facial tracking-assisted hand pointing technique for wall-sized displays

AU - Cheng, Haokan

AU - Shin, Takahashi

AU - Tanaka, Jiro

PY - 2016

Y1 - 2016

N2 - In this paper we propose a novel pointing technique leveraging the user’s body motion to achieve smooth, efficient user experiences on wall-sized displays. Our proposal substantially consists of two parts: a graphical cursor controlled by the user’s hand motions, and mechanisms to assist the cursor manipulation by tracking the user’s face orientation. By interaction design associating the user’s face and hand motions to different aspects of the cursor’s movement, we aimed to bring swiftness to the interaction in large-display environments with necessary precision. A prototype was built to instantiate the concept, and two comparative experiments were conducted to evaluate the effectiveness of the proposal.

AB - In this paper we propose a novel pointing technique leveraging the user’s body motion to achieve smooth, efficient user experiences on wall-sized displays. Our proposal substantially consists of two parts: a graphical cursor controlled by the user’s hand motions, and mechanisms to assist the cursor manipulation by tracking the user’s face orientation. By interaction design associating the user’s face and hand motions to different aspects of the cursor’s movement, we aimed to bring swiftness to the interaction in large-display environments with necessary precision. A prototype was built to instantiate the concept, and two comparative experiments were conducted to evaluate the effectiveness of the proposal.

KW - Facial tracking

KW - Input method

KW - Pointing technique

KW - Wall-sized display

UR - http://www.scopus.com/inward/record.url?scp=84978803903&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84978803903&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-39862-4_18

DO - 10.1007/978-3-319-39862-4_18

M3 - Conference contribution

AN - SCOPUS:84978803903

SN - 9783319398617

VL - 9749

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 191

EP - 201

BT - Distributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings

PB - Springer Verlag

T2 - 18th International Conference on Human-Computer Interaction, HCI International 2016

Y2 - 17 July 2016 through 22 July 2016

ER -

Access to Document

10.1007/978-3-319-39862-4_18