Dynamic Bayesian network based interest estimation for visual attentive presentation agents

Boris Brandherm, Helmut Prendinger, Mitsuru Ishizuka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In this paper, we report on an interactive system and the results ofa formal user study that was carried out with the aim of comparing two approaches to estimating users' interest in a multimodal presentation based on their eye gaze. The scenario consists of a virtual showroom where two 3D agents present product items in an entertaining way, and adapt their performance according to users' (in)attentiveness. In order to infer users' attention and visual interest with regard to interface objects, our system analyzes eye movements in real-time. Interest detection algorithms used in previous research determine an object of interest based on the time that eye gaze dwells on that object. However, this kind of algorithm does not seem to be well suited for dynamic presentations where the goal is to assess the user's focus of attention with regard to a dynamically changing presentation. Here, the current context of the object of interest has to be considered, i. e., whether the visual object is part of (or contributes to) the current presentation content or not. Therefore, we propose to estimate the interest (or non-interest) of a user by means of dynamic Bayesian networks that may take into account the current context of the attention receiving object. In this way, the presentation agents can provide timely and appropriate response. The benefits of our approach will be demonstrated both theoretically and empirically.

Original languageEnglish
Title of host publicationProceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS
PublisherInternational Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)
Pages190-197
Number of pages8
Volume1
ISBN (Print)9781605604701
Publication statusPublished - 2008
Externally publishedYes
Event7th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2008 - Estoril
Duration: 2008 May 122008 May 16

Other

Other7th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2008
CityEstoril
Period08/5/1208/5/16

Fingerprint

Bayesian networks
Eye movements

Keywords

  • Human factors

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software
  • Control and Systems Engineering

Cite this

Brandherm, B., Prendinger, H., & Ishizuka, M. (2008). Dynamic Bayesian network based interest estimation for visual attentive presentation agents. In Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS (Vol. 1, pp. 190-197). International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).

Dynamic Bayesian network based interest estimation for visual attentive presentation agents. / Brandherm, Boris; Prendinger, Helmut; Ishizuka, Mitsuru.

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS. Vol. 1 International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS), 2008. p. 190-197.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Brandherm, B, Prendinger, H & Ishizuka, M 2008, Dynamic Bayesian network based interest estimation for visual attentive presentation agents. in Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS. vol. 1, International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS), pp. 190-197, 7th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2008, Estoril, 08/5/12.
Brandherm B, Prendinger H, Ishizuka M. Dynamic Bayesian network based interest estimation for visual attentive presentation agents. In Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS. Vol. 1. International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS). 2008. p. 190-197
Brandherm, Boris ; Prendinger, Helmut ; Ishizuka, Mitsuru. / Dynamic Bayesian network based interest estimation for visual attentive presentation agents. Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS. Vol. 1 International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS), 2008. pp. 190-197
@inproceedings{d274445f01024bf6aae2567bac3e2d9e,
title = "Dynamic Bayesian network based interest estimation for visual attentive presentation agents",
abstract = "In this paper, we report on an interactive system and the results ofa formal user study that was carried out with the aim of comparing two approaches to estimating users' interest in a multimodal presentation based on their eye gaze. The scenario consists of a virtual showroom where two 3D agents present product items in an entertaining way, and adapt their performance according to users' (in)attentiveness. In order to infer users' attention and visual interest with regard to interface objects, our system analyzes eye movements in real-time. Interest detection algorithms used in previous research determine an object of interest based on the time that eye gaze dwells on that object. However, this kind of algorithm does not seem to be well suited for dynamic presentations where the goal is to assess the user's focus of attention with regard to a dynamically changing presentation. Here, the current context of the object of interest has to be considered, i. e., whether the visual object is part of (or contributes to) the current presentation content or not. Therefore, we propose to estimate the interest (or non-interest) of a user by means of dynamic Bayesian networks that may take into account the current context of the attention receiving object. In this way, the presentation agents can provide timely and appropriate response. The benefits of our approach will be demonstrated both theoretically and empirically.",
keywords = "Human factors",
author = "Boris Brandherm and Helmut Prendinger and Mitsuru Ishizuka",
year = "2008",
language = "English",
isbn = "9781605604701",
volume = "1",
pages = "190--197",
booktitle = "Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS",
publisher = "International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)",

}

TY - GEN

T1 - Dynamic Bayesian network based interest estimation for visual attentive presentation agents

AU - Brandherm, Boris

AU - Prendinger, Helmut

AU - Ishizuka, Mitsuru

PY - 2008

Y1 - 2008

N2 - In this paper, we report on an interactive system and the results ofa formal user study that was carried out with the aim of comparing two approaches to estimating users' interest in a multimodal presentation based on their eye gaze. The scenario consists of a virtual showroom where two 3D agents present product items in an entertaining way, and adapt their performance according to users' (in)attentiveness. In order to infer users' attention and visual interest with regard to interface objects, our system analyzes eye movements in real-time. Interest detection algorithms used in previous research determine an object of interest based on the time that eye gaze dwells on that object. However, this kind of algorithm does not seem to be well suited for dynamic presentations where the goal is to assess the user's focus of attention with regard to a dynamically changing presentation. Here, the current context of the object of interest has to be considered, i. e., whether the visual object is part of (or contributes to) the current presentation content or not. Therefore, we propose to estimate the interest (or non-interest) of a user by means of dynamic Bayesian networks that may take into account the current context of the attention receiving object. In this way, the presentation agents can provide timely and appropriate response. The benefits of our approach will be demonstrated both theoretically and empirically.

AB - In this paper, we report on an interactive system and the results ofa formal user study that was carried out with the aim of comparing two approaches to estimating users' interest in a multimodal presentation based on their eye gaze. The scenario consists of a virtual showroom where two 3D agents present product items in an entertaining way, and adapt their performance according to users' (in)attentiveness. In order to infer users' attention and visual interest with regard to interface objects, our system analyzes eye movements in real-time. Interest detection algorithms used in previous research determine an object of interest based on the time that eye gaze dwells on that object. However, this kind of algorithm does not seem to be well suited for dynamic presentations where the goal is to assess the user's focus of attention with regard to a dynamically changing presentation. Here, the current context of the object of interest has to be considered, i. e., whether the visual object is part of (or contributes to) the current presentation content or not. Therefore, we propose to estimate the interest (or non-interest) of a user by means of dynamic Bayesian networks that may take into account the current context of the attention receiving object. In this way, the presentation agents can provide timely and appropriate response. The benefits of our approach will be demonstrated both theoretically and empirically.

KW - Human factors

UR - http://www.scopus.com/inward/record.url?scp=84899903414&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84899903414&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84899903414

SN - 9781605604701

VL - 1

SP - 190

EP - 197

BT - Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

PB - International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)

ER -