A video abstraction method based on viewer's heart activity and its evaluations

Satoshi Toyosawa, Takashi Kawai

    Research output: Contribution to journalArticle

    3 Citations (Scopus)

    Abstract

    In video abstraction, viewer's emotional reactions to original video play an important role because people often choose what to watch based on the emotional context. We have devised a method for incorporating viewer's perceived impressions in video abstraction. The impression level is measured by the degree of arousal, based on two measures of heart activity: deceleration of heart rate and activation of the higher frequency component of the heart rate variability. For an evaluation of our method, we performed two sets of experiments comparing the abstracts generated by our method against subjective selections. Three short videos with different arousal levels (two arousing and one calm) were used. In Experiment 1, shot matching between two abstracts was examined: the arousing videos showed a 50% match, while the calm one showed a 30% match. In Experiment 2, the abstracts were displayed to the subjects, which they evaluated subjectively: our method generated good results in the arousing/pleasant video.

    Original languageEnglish
    Pages (from-to)86-94
    Number of pages9
    JournalKyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers
    Volume63
    Issue number1
    Publication statusPublished - 2009 Jan

    Fingerprint

    Experiments
    Deceleration
    Chemical activation

    ASJC Scopus subject areas

    • Electrical and Electronic Engineering
    • Media Technology
    • Computer Science Applications

    Cite this

    @article{8d24cdde08f84d61b15e028f32ae7328,
    title = "A video abstraction method based on viewer's heart activity and its evaluations",
    abstract = "In video abstraction, viewer's emotional reactions to original video play an important role because people often choose what to watch based on the emotional context. We have devised a method for incorporating viewer's perceived impressions in video abstraction. The impression level is measured by the degree of arousal, based on two measures of heart activity: deceleration of heart rate and activation of the higher frequency component of the heart rate variability. For an evaluation of our method, we performed two sets of experiments comparing the abstracts generated by our method against subjective selections. Three short videos with different arousal levels (two arousing and one calm) were used. In Experiment 1, shot matching between two abstracts was examined: the arousing videos showed a 50{\%} match, while the calm one showed a 30{\%} match. In Experiment 2, the abstracts were displayed to the subjects, which they evaluated subjectively: our method generated good results in the arousing/pleasant video.",
    author = "Satoshi Toyosawa and Takashi Kawai",
    year = "2009",
    month = "1",
    language = "English",
    volume = "63",
    pages = "86--94",
    journal = "Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers",
    issn = "1342-6907",
    publisher = "Institute of Image Information and Television Engineers",
    number = "1",

    }

    TY - JOUR

    T1 - A video abstraction method based on viewer's heart activity and its evaluations

    AU - Toyosawa, Satoshi

    AU - Kawai, Takashi

    PY - 2009/1

    Y1 - 2009/1

    N2 - In video abstraction, viewer's emotional reactions to original video play an important role because people often choose what to watch based on the emotional context. We have devised a method for incorporating viewer's perceived impressions in video abstraction. The impression level is measured by the degree of arousal, based on two measures of heart activity: deceleration of heart rate and activation of the higher frequency component of the heart rate variability. For an evaluation of our method, we performed two sets of experiments comparing the abstracts generated by our method against subjective selections. Three short videos with different arousal levels (two arousing and one calm) were used. In Experiment 1, shot matching between two abstracts was examined: the arousing videos showed a 50% match, while the calm one showed a 30% match. In Experiment 2, the abstracts were displayed to the subjects, which they evaluated subjectively: our method generated good results in the arousing/pleasant video.

    AB - In video abstraction, viewer's emotional reactions to original video play an important role because people often choose what to watch based on the emotional context. We have devised a method for incorporating viewer's perceived impressions in video abstraction. The impression level is measured by the degree of arousal, based on two measures of heart activity: deceleration of heart rate and activation of the higher frequency component of the heart rate variability. For an evaluation of our method, we performed two sets of experiments comparing the abstracts generated by our method against subjective selections. Three short videos with different arousal levels (two arousing and one calm) were used. In Experiment 1, shot matching between two abstracts was examined: the arousing videos showed a 50% match, while the calm one showed a 30% match. In Experiment 2, the abstracts were displayed to the subjects, which they evaluated subjectively: our method generated good results in the arousing/pleasant video.

    UR - http://www.scopus.com/inward/record.url?scp=62349098018&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=62349098018&partnerID=8YFLogxK

    M3 - Article

    AN - SCOPUS:62349098018

    VL - 63

    SP - 86

    EP - 94

    JO - Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers

    JF - Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers

    SN - 1342-6907

    IS - 1

    ER -