Video digest based on heart rate

Satoshi Toyosawa, Takashi Kawai

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2 Citations (Scopus)

    Abstract

    In video digesting, not only features and keywords extracted from a content itself but viewer's input are essential to incorporate subjective impressions and perceived importance. The present study aims at providing heart rate based arousal level as weights for determining shots that are deemed impressive and consuming. Heart rate is suitable for video content analysis, as it can be measured without being obtrusive and can be the source of different types of psychophysiological indices. Based on the findings that heart rate decelerates when emotionally arousing images are shown, we had investigated the fidelity of heart rate in detecting impressive shots. Three video contents with different valence/arousal levels were presented to the subjects, and the heart rate based "best shot" selections were compared against subjects-selected shots. The resulting hit ratio was 37% (the probability of random guessing is 17%). This result is about the same as other physiology-based affect recognition mechanisms with one class of input. We can expect this fidelity to be improved further by combining other heart rate based measures such as heart rate variability.

    Original languageEnglish
    Title of host publicationProceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007
    Pages15-20
    Number of pages6
    Publication statusPublished - 2007
    Event7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007 - Palma de Mallorca
    Duration: 2007 Aug 292007 Aug 31

    Other

    Other7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007
    CityPalma de Mallorca
    Period07/8/2907/8/31

    Fingerprint

    Physiology

    Keywords

    • Affect
    • Emotion
    • Heart rate
    • Psychophysiology
    • Video analysis
    • Video digest

    ASJC Scopus subject areas

    • Computer Graphics and Computer-Aided Design
    • Computer Vision and Pattern Recognition

    Cite this

    Toyosawa, S., & Kawai, T. (2007). Video digest based on heart rate. In Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007 (pp. 15-20)

    Video digest based on heart rate. / Toyosawa, Satoshi; Kawai, Takashi.

    Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007. 2007. p. 15-20.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Toyosawa, S & Kawai, T 2007, Video digest based on heart rate. in Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007. pp. 15-20, 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007, Palma de Mallorca, 07/8/29.
    Toyosawa S, Kawai T. Video digest based on heart rate. In Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007. 2007. p. 15-20
    Toyosawa, Satoshi ; Kawai, Takashi. / Video digest based on heart rate. Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007. 2007. pp. 15-20
    @inproceedings{15f7e94db75e40d59a2dea47af605ed0,
    title = "Video digest based on heart rate",
    abstract = "In video digesting, not only features and keywords extracted from a content itself but viewer's input are essential to incorporate subjective impressions and perceived importance. The present study aims at providing heart rate based arousal level as weights for determining shots that are deemed impressive and consuming. Heart rate is suitable for video content analysis, as it can be measured without being obtrusive and can be the source of different types of psychophysiological indices. Based on the findings that heart rate decelerates when emotionally arousing images are shown, we had investigated the fidelity of heart rate in detecting impressive shots. Three video contents with different valence/arousal levels were presented to the subjects, and the heart rate based {"}best shot{"} selections were compared against subjects-selected shots. The resulting hit ratio was 37{\%} (the probability of random guessing is 17{\%}). This result is about the same as other physiology-based affect recognition mechanisms with one class of input. We can expect this fidelity to be improved further by combining other heart rate based measures such as heart rate variability.",
    keywords = "Affect, Emotion, Heart rate, Psychophysiology, Video analysis, Video digest",
    author = "Satoshi Toyosawa and Takashi Kawai",
    year = "2007",
    language = "English",
    isbn = "9780889866911",
    pages = "15--20",
    booktitle = "Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007",

    }

    TY - GEN

    T1 - Video digest based on heart rate

    AU - Toyosawa, Satoshi

    AU - Kawai, Takashi

    PY - 2007

    Y1 - 2007

    N2 - In video digesting, not only features and keywords extracted from a content itself but viewer's input are essential to incorporate subjective impressions and perceived importance. The present study aims at providing heart rate based arousal level as weights for determining shots that are deemed impressive and consuming. Heart rate is suitable for video content analysis, as it can be measured without being obtrusive and can be the source of different types of psychophysiological indices. Based on the findings that heart rate decelerates when emotionally arousing images are shown, we had investigated the fidelity of heart rate in detecting impressive shots. Three video contents with different valence/arousal levels were presented to the subjects, and the heart rate based "best shot" selections were compared against subjects-selected shots. The resulting hit ratio was 37% (the probability of random guessing is 17%). This result is about the same as other physiology-based affect recognition mechanisms with one class of input. We can expect this fidelity to be improved further by combining other heart rate based measures such as heart rate variability.

    AB - In video digesting, not only features and keywords extracted from a content itself but viewer's input are essential to incorporate subjective impressions and perceived importance. The present study aims at providing heart rate based arousal level as weights for determining shots that are deemed impressive and consuming. Heart rate is suitable for video content analysis, as it can be measured without being obtrusive and can be the source of different types of psychophysiological indices. Based on the findings that heart rate decelerates when emotionally arousing images are shown, we had investigated the fidelity of heart rate in detecting impressive shots. Three video contents with different valence/arousal levels were presented to the subjects, and the heart rate based "best shot" selections were compared against subjects-selected shots. The resulting hit ratio was 37% (the probability of random guessing is 17%). This result is about the same as other physiology-based affect recognition mechanisms with one class of input. We can expect this fidelity to be improved further by combining other heart rate based measures such as heart rate variability.

    KW - Affect

    KW - Emotion

    KW - Heart rate

    KW - Psychophysiology

    KW - Video analysis

    KW - Video digest

    UR - http://www.scopus.com/inward/record.url?scp=56549086542&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=56549086542&partnerID=8YFLogxK

    M3 - Conference contribution

    SN - 9780889866911

    SP - 15

    EP - 20

    BT - Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing, VIIP 2007

    ER -