AutoSelect: What you want is what you get: Real-time processing of visual attention and affect

Nikolaus Bee; Helmut Prendinger; Arturo Nakasone; Elisabeth André; Mitsuru Ishizuka

doi:10.1007/11768029_5

AutoSelect: What you want is what you get: Real-time processing of visual attention and affect

Nikolaus Bee^*, Helmut Prendinger, Arturo Nakasone, Elisabeth André, Mitsuru Ishizuka

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

41 Citations (Scopus)

Abstract

While objects of our focus of attention ("where we are looking at") and accompanying affective responses to those objects is part of our daily experience, little research exists on investigating the relation between attention and positive affective evaluation. The purpose of our research is to process users' emotion and attention in real-time, with the goal of designing systems that may recognize a user's affective response to a particular visually presented stimulus in the presence of other stimuli, and respond accordingly. In this paper, we introduce the AutoSelect system that automatically detects a user's preference based on eye movement data and physiological signals in a two-alternative forced choice task. In an exploratory study involving the selection of neckties, the system could correctly classify subjects' choice of in 81%. In this instance of AutoSelect, the gaze 'cascade effect' played a dominant role, whereas pupil size could not be shown as a reliable predictor of preference.

Original language	English
Title of host publication	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages	40-52
Number of pages	13
Volume	4021 LNAI
DOIs	https://doi.org/10.1007/11768029_5
Publication status	Published - 2006
Externally published	Yes
Event	International Tutorial and Research Workshop on Perception and Interactive Technologies, PIT 2006 - Kloster Irsee Duration: 2006 Jun 19 → 2006 Jun 21

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	4021 LNAI
ISSN (Print)	03029743
ISSN (Electronic)	16113349

Other

Other	International Tutorial and Research Workshop on Perception and Interactive Technologies, PIT 2006
City	Kloster Irsee
Period	06/6/19 → 06/6/21

ASJC Scopus subject areas

Computer Science(all)
Biochemistry, Genetics and Molecular Biology(all)
Theoretical Computer Science

Access to Document

10.1007/11768029_5

Cite this

Bee, N., Prendinger, H., Nakasone, A., André, E., & Ishizuka, M. (2006). AutoSelect: What you want is what you get: Real-time processing of visual attention and affect. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4021 LNAI, pp. 40-52). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4021 LNAI). https://doi.org/10.1007/11768029_5

AutoSelect : What you want is what you get: Real-time processing of visual attention and affect. / Bee, Nikolaus; Prendinger, Helmut; Nakasone, Arturo et al.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4021 LNAI 2006. p. 40-52 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4021 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Bee, N, Prendinger, H, Nakasone, A, André, E & Ishizuka, M 2006, AutoSelect: What you want is what you get: Real-time processing of visual attention and affect. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 4021 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4021 LNAI, pp. 40-52, International Tutorial and Research Workshop on Perception and Interactive Technologies, PIT 2006, Kloster Irsee, 06/6/19. https://doi.org/10.1007/11768029_5

Bee N, Prendinger H, Nakasone A, André E, Ishizuka M. AutoSelect: What you want is what you get: Real-time processing of visual attention and affect. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4021 LNAI. 2006. p. 40-52. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/11768029_5

Bee, Nikolaus ; Prendinger, Helmut ; Nakasone, Arturo et al. / AutoSelect : What you want is what you get: Real-time processing of visual attention and affect. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4021 LNAI 2006. pp. 40-52 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{a768cef3525f431392c7f7cab9379d81,

title = "AutoSelect: What you want is what you get: Real-time processing of visual attention and affect",

abstract = "While objects of our focus of attention ({"}where we are looking at{"}) and accompanying affective responses to those objects is part of our daily experience, little research exists on investigating the relation between attention and positive affective evaluation. The purpose of our research is to process users' emotion and attention in real-time, with the goal of designing systems that may recognize a user's affective response to a particular visually presented stimulus in the presence of other stimuli, and respond accordingly. In this paper, we introduce the AutoSelect system that automatically detects a user's preference based on eye movement data and physiological signals in a two-alternative forced choice task. In an exploratory study involving the selection of neckties, the system could correctly classify subjects' choice of in 81%. In this instance of AutoSelect, the gaze 'cascade effect' played a dominant role, whereas pupil size could not be shown as a reliable predictor of preference.",

author = "Nikolaus Bee and Helmut Prendinger and Arturo Nakasone and Elisabeth Andr{\'e} and Mitsuru Ishizuka",

year = "2006",

doi = "10.1007/11768029_5",

language = "English",

isbn = "3540347437",

volume = "4021 LNAI",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "40--52",

booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

note = "International Tutorial and Research Workshop on Perception and Interactive Technologies, PIT 2006 ; Conference date: 19-06-2006 Through 21-06-2006",

}

TY - GEN

T1 - AutoSelect

T2 - International Tutorial and Research Workshop on Perception and Interactive Technologies, PIT 2006

AU - Bee, Nikolaus

AU - Prendinger, Helmut

AU - Nakasone, Arturo

AU - André, Elisabeth

AU - Ishizuka, Mitsuru

PY - 2006

Y1 - 2006

N2 - While objects of our focus of attention ("where we are looking at") and accompanying affective responses to those objects is part of our daily experience, little research exists on investigating the relation between attention and positive affective evaluation. The purpose of our research is to process users' emotion and attention in real-time, with the goal of designing systems that may recognize a user's affective response to a particular visually presented stimulus in the presence of other stimuli, and respond accordingly. In this paper, we introduce the AutoSelect system that automatically detects a user's preference based on eye movement data and physiological signals in a two-alternative forced choice task. In an exploratory study involving the selection of neckties, the system could correctly classify subjects' choice of in 81%. In this instance of AutoSelect, the gaze 'cascade effect' played a dominant role, whereas pupil size could not be shown as a reliable predictor of preference.

AB - While objects of our focus of attention ("where we are looking at") and accompanying affective responses to those objects is part of our daily experience, little research exists on investigating the relation between attention and positive affective evaluation. The purpose of our research is to process users' emotion and attention in real-time, with the goal of designing systems that may recognize a user's affective response to a particular visually presented stimulus in the presence of other stimuli, and respond accordingly. In this paper, we introduce the AutoSelect system that automatically detects a user's preference based on eye movement data and physiological signals in a two-alternative forced choice task. In an exploratory study involving the selection of neckties, the system could correctly classify subjects' choice of in 81%. In this instance of AutoSelect, the gaze 'cascade effect' played a dominant role, whereas pupil size could not be shown as a reliable predictor of preference.

UR - http://www.scopus.com/inward/record.url?scp=33746042547&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33746042547&partnerID=8YFLogxK

U2 - 10.1007/11768029_5

DO - 10.1007/11768029_5

M3 - Conference contribution

AN - SCOPUS:33746042547

SN - 3540347437

SN - 9783540347439

VL - 4021 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 40

EP - 52

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Y2 - 19 June 2006 through 21 June 2006

ER -

AutoSelect: What you want is what you get: Real-time processing of visual attention and affect

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this