Highly realistic 3D presentation agents with visual attention capability

Arjen Hoekstra, Helmut Prendinger, Nikolaus Bee, Dirk Heylen, Mitsuru Ishizuka

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

This research proposes 3D graphical agents in the role of virtual presenters with a new type of functionality - the capability to process and respond to visual attention of users communicated by their eye movements. Eye gaze is an excellent clue to users' attention, visual interest, and visual preference. Using state-of-the-art non-contact eye tracking technology, eye movements can be assessed in a unobtrusive way. By analyzing and interpreting eye behavior in real-time, our proposed system can adapt to the current (visual) interest state of the user, and thus provide a more personalized, context-aware, and 'attentive' experience of the presentation. The system implements a virtual presentation room, where research content of our institute is presented by a team of two highly realistic 3D agents in a dynamic and interactive way. A small preliminary study was conducted to investigate users' gaze behavior with a non-interactive version of the system. A demo video based on our system was awarded as the best application of life-like agents at the GALA event in 20061.

Original languageEnglish
Pages (from-to)73-84
Number of pages12
JournalLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4569 LNCS
Publication statusPublished - 2007
Externally publishedYes

Fingerprint

Visual Attention
Eye movements
Eye Movements
Jurisprudence
Research
Eye Tracking
User Behavior
Non-contact
Context-aware
Technology
Real-time
Presentation
Vision

ASJC Scopus subject areas

  • Computer Science(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Theoretical Computer Science

Cite this

Highly realistic 3D presentation agents with visual attention capability. / Hoekstra, Arjen; Prendinger, Helmut; Bee, Nikolaus; Heylen, Dirk; Ishizuka, Mitsuru.

In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 4569 LNCS, 2007, p. 73-84.

Research output: Contribution to journalArticle

@article{7d8131337aae43e1a9ac5fbfde9e16d2,
title = "Highly realistic 3D presentation agents with visual attention capability",
abstract = "This research proposes 3D graphical agents in the role of virtual presenters with a new type of functionality - the capability to process and respond to visual attention of users communicated by their eye movements. Eye gaze is an excellent clue to users' attention, visual interest, and visual preference. Using state-of-the-art non-contact eye tracking technology, eye movements can be assessed in a unobtrusive way. By analyzing and interpreting eye behavior in real-time, our proposed system can adapt to the current (visual) interest state of the user, and thus provide a more personalized, context-aware, and 'attentive' experience of the presentation. The system implements a virtual presentation room, where research content of our institute is presented by a team of two highly realistic 3D agents in a dynamic and interactive way. A small preliminary study was conducted to investigate users' gaze behavior with a non-interactive version of the system. A demo video based on our system was awarded as the best application of life-like agents at the GALA event in 20061.",
author = "Arjen Hoekstra and Helmut Prendinger and Nikolaus Bee and Dirk Heylen and Mitsuru Ishizuka",
year = "2007",
language = "English",
volume = "4569 LNCS",
pages = "73--84",
journal = "Lecture Notes in Computer Science",
issn = "0302-9743",
publisher = "Springer Verlag",

}

TY - JOUR

T1 - Highly realistic 3D presentation agents with visual attention capability

AU - Hoekstra, Arjen

AU - Prendinger, Helmut

AU - Bee, Nikolaus

AU - Heylen, Dirk

AU - Ishizuka, Mitsuru

PY - 2007

Y1 - 2007

N2 - This research proposes 3D graphical agents in the role of virtual presenters with a new type of functionality - the capability to process and respond to visual attention of users communicated by their eye movements. Eye gaze is an excellent clue to users' attention, visual interest, and visual preference. Using state-of-the-art non-contact eye tracking technology, eye movements can be assessed in a unobtrusive way. By analyzing and interpreting eye behavior in real-time, our proposed system can adapt to the current (visual) interest state of the user, and thus provide a more personalized, context-aware, and 'attentive' experience of the presentation. The system implements a virtual presentation room, where research content of our institute is presented by a team of two highly realistic 3D agents in a dynamic and interactive way. A small preliminary study was conducted to investigate users' gaze behavior with a non-interactive version of the system. A demo video based on our system was awarded as the best application of life-like agents at the GALA event in 20061.

AB - This research proposes 3D graphical agents in the role of virtual presenters with a new type of functionality - the capability to process and respond to visual attention of users communicated by their eye movements. Eye gaze is an excellent clue to users' attention, visual interest, and visual preference. Using state-of-the-art non-contact eye tracking technology, eye movements can be assessed in a unobtrusive way. By analyzing and interpreting eye behavior in real-time, our proposed system can adapt to the current (visual) interest state of the user, and thus provide a more personalized, context-aware, and 'attentive' experience of the presentation. The system implements a virtual presentation room, where research content of our institute is presented by a team of two highly realistic 3D agents in a dynamic and interactive way. A small preliminary study was conducted to investigate users' gaze behavior with a non-interactive version of the system. A demo video based on our system was awarded as the best application of life-like agents at the GALA event in 20061.

UR - http://www.scopus.com/inward/record.url?scp=37249072934&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=37249072934&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:37249072934

VL - 4569 LNCS

SP - 73

EP - 84

JO - Lecture Notes in Computer Science

JF - Lecture Notes in Computer Science

SN - 0302-9743

ER -