Video digest based on heart rate

Satoshi Toyosawa, Takashi Kawai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In video digesting, not only features and keywords extracted from a content itself but viewer's input are essential to incorporate subjective impressions and perceived importance. The present study aims at providing heart rate based arousal level as weights for determining shots that are deemed impressive and consuming. Heart rate is suitable for video content analysis, as it can be measured without being obtrusive and can be the source of different types of psychophysiological indices. Based on the findings that heart rate decelerates when emotionally arousing images are shown, we had investigated the fidelity of heart rate in detecting impressive shots. Three video contents with different valence/arousal levels were presented to the subjects, and the heart rate based "best shot" selections were compared against subjects-selected shots. The resulting hit ratio was 37% (the probability of random guessing is 17%). This result is about the same as other physiology-based affect recognition mechanisms with one class of input. We can expect this fidelity to be improved further by combining other heart rate based measures such as heart rate variability.

Original languageEnglish
Title of host publicationProceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007
Pages15-20
Number of pages6
Publication statusPublished - 2007 Dec 1
Event7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007 - Palma de Mallorca, Spain
Duration: 2007 Aug 292007 Aug 31

Publication series

NameProceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007

Conference

Conference7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007
CountrySpain
CityPalma de Mallorca
Period07/8/2907/8/31

Keywords

  • Affect
  • Emotion
  • Heart rate
  • Psychophysiology
  • Video analysis
  • Video digest

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Video digest based on heart rate'. Together they form a unique fingerprint.

  • Cite this

    Toyosawa, S., & Kawai, T. (2007). Video digest based on heart rate. In Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007 (pp. 15-20). (Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007).