Region-of-interest-based subtitle placement using eye-tracking data of multiple viewers

Wataru Akahori, Shigeo Morishima, Tatsunori Hirai, Shunya Kawamura

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    4 Citations (Scopus)

    Abstract

    We present a subtitle-placement method that reduces viewer's eye movement without interfering with the target region of interest (ROI) in a video scene. Subtitles help viewers understand foreign-language videos. However, subtitles tend to attract viewers' line of sight, which cause viewers to lose focus on the video content. To address this problem, previous studies have attempted to improve viewer experiences by dynamically shifting subtitle positions. Nevertheless, in their user studies, some participants felt that the visual appearance of such subtitles was unnatural and caused them fatigue. We propose a method that places subtitles below the ROI, which is calculated by eye-tracking data from multiple viewers. Two experiments were conducted to evaluate viewer impression and compare line of sight for videos with subtitles placed by the proposed and previous methods.

    Original languageEnglish
    Title of host publicationTVX 2016 - Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video
    PublisherAssociation for Computing Machinery, Inc
    Pages123-128
    Number of pages6
    ISBN (Electronic)9781450340670
    DOIs
    Publication statusPublished - 2016 Jun 17
    Event3rd ACM International Conference on Interactive Experiences for TV and Online Video, TVX 2016 - Chicago, United States
    Duration: 2016 Jun 222016 Jun 24

    Other

    Other3rd ACM International Conference on Interactive Experiences for TV and Online Video, TVX 2016
    CountryUnited States
    CityChicago
    Period16/6/2216/6/24

    Fingerprint

    Eye movements
    Fatigue of materials
    Experiments

    Keywords

    • Accessibility
    • Dynamic subtitles
    • Eye-tracking
    • Region of interest
    • User experience

    ASJC Scopus subject areas

    • Computer Science(all)

    Cite this

    Akahori, W., Morishima, S., Hirai, T., & Kawamura, S. (2016). Region-of-interest-based subtitle placement using eye-tracking data of multiple viewers. In TVX 2016 - Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (pp. 123-128). Association for Computing Machinery, Inc. https://doi.org/10.1145/2932206.2933558

    Region-of-interest-based subtitle placement using eye-tracking data of multiple viewers. / Akahori, Wataru; Morishima, Shigeo; Hirai, Tatsunori; Kawamura, Shunya.

    TVX 2016 - Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video. Association for Computing Machinery, Inc, 2016. p. 123-128.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Akahori, W, Morishima, S, Hirai, T & Kawamura, S 2016, Region-of-interest-based subtitle placement using eye-tracking data of multiple viewers. in TVX 2016 - Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video. Association for Computing Machinery, Inc, pp. 123-128, 3rd ACM International Conference on Interactive Experiences for TV and Online Video, TVX 2016, Chicago, United States, 16/6/22. https://doi.org/10.1145/2932206.2933558
    Akahori W, Morishima S, Hirai T, Kawamura S. Region-of-interest-based subtitle placement using eye-tracking data of multiple viewers. In TVX 2016 - Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video. Association for Computing Machinery, Inc. 2016. p. 123-128 https://doi.org/10.1145/2932206.2933558
    Akahori, Wataru ; Morishima, Shigeo ; Hirai, Tatsunori ; Kawamura, Shunya. / Region-of-interest-based subtitle placement using eye-tracking data of multiple viewers. TVX 2016 - Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video. Association for Computing Machinery, Inc, 2016. pp. 123-128
    @inproceedings{a058ec5dff4e47618f9a54731f2fb600,
    title = "Region-of-interest-based subtitle placement using eye-tracking data of multiple viewers",
    abstract = "We present a subtitle-placement method that reduces viewer's eye movement without interfering with the target region of interest (ROI) in a video scene. Subtitles help viewers understand foreign-language videos. However, subtitles tend to attract viewers' line of sight, which cause viewers to lose focus on the video content. To address this problem, previous studies have attempted to improve viewer experiences by dynamically shifting subtitle positions. Nevertheless, in their user studies, some participants felt that the visual appearance of such subtitles was unnatural and caused them fatigue. We propose a method that places subtitles below the ROI, which is calculated by eye-tracking data from multiple viewers. Two experiments were conducted to evaluate viewer impression and compare line of sight for videos with subtitles placed by the proposed and previous methods.",
    keywords = "Accessibility, Dynamic subtitles, Eye-tracking, Region of interest, User experience",
    author = "Wataru Akahori and Shigeo Morishima and Tatsunori Hirai and Shunya Kawamura",
    year = "2016",
    month = "6",
    day = "17",
    doi = "10.1145/2932206.2933558",
    language = "English",
    pages = "123--128",
    booktitle = "TVX 2016 - Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video",
    publisher = "Association for Computing Machinery, Inc",

    }

    TY - GEN

    T1 - Region-of-interest-based subtitle placement using eye-tracking data of multiple viewers

    AU - Akahori, Wataru

    AU - Morishima, Shigeo

    AU - Hirai, Tatsunori

    AU - Kawamura, Shunya

    PY - 2016/6/17

    Y1 - 2016/6/17

    N2 - We present a subtitle-placement method that reduces viewer's eye movement without interfering with the target region of interest (ROI) in a video scene. Subtitles help viewers understand foreign-language videos. However, subtitles tend to attract viewers' line of sight, which cause viewers to lose focus on the video content. To address this problem, previous studies have attempted to improve viewer experiences by dynamically shifting subtitle positions. Nevertheless, in their user studies, some participants felt that the visual appearance of such subtitles was unnatural and caused them fatigue. We propose a method that places subtitles below the ROI, which is calculated by eye-tracking data from multiple viewers. Two experiments were conducted to evaluate viewer impression and compare line of sight for videos with subtitles placed by the proposed and previous methods.

    AB - We present a subtitle-placement method that reduces viewer's eye movement without interfering with the target region of interest (ROI) in a video scene. Subtitles help viewers understand foreign-language videos. However, subtitles tend to attract viewers' line of sight, which cause viewers to lose focus on the video content. To address this problem, previous studies have attempted to improve viewer experiences by dynamically shifting subtitle positions. Nevertheless, in their user studies, some participants felt that the visual appearance of such subtitles was unnatural and caused them fatigue. We propose a method that places subtitles below the ROI, which is calculated by eye-tracking data from multiple viewers. Two experiments were conducted to evaluate viewer impression and compare line of sight for videos with subtitles placed by the proposed and previous methods.

    KW - Accessibility

    KW - Dynamic subtitles

    KW - Eye-tracking

    KW - Region of interest

    KW - User experience

    UR - http://www.scopus.com/inward/record.url?scp=84979991973&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84979991973&partnerID=8YFLogxK

    U2 - 10.1145/2932206.2933558

    DO - 10.1145/2932206.2933558

    M3 - Conference contribution

    SP - 123

    EP - 128

    BT - TVX 2016 - Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video

    PB - Association for Computing Machinery, Inc

    ER -