Computational cartoonist: A comic-style video summarization system for anime films

Tsukasa Fukusato, Tatsunori Hirai, Shunya Kawamura, Shigeo Morishima

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2 Citations (Scopus)

    Abstract

    This paper presents Computational Cartoonist, a comicstyle anime summarization system that detects key frame and generates comic layout automatically. In contract to previous studies, we define evaluation criteria based on the correspondence between anime films and original comics to determine whether the result of comic-style summarization is relevant. To detect key frame detection for anime films, the proposed system segments the input video into a series of basic temporal units, and computes frame importance using image characteristics such as motion. Subsequently, comic-style layouts are decided on the basis of pre-defined templates stored in a database. Several results demonstrate the efficiency of our key frame detection over previous methods by evaluating the matching accuracy between key frames and original comic panels.

    Original languageEnglish
    Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    PublisherSpringer Verlag
    Pages42-50
    Number of pages9
    Volume9516
    ISBN (Print)9783319276700
    DOIs
    Publication statusPublished - 2016
    Event22nd International Conference on MultiMedia Modeling, MMM 2016 - Miami, United States
    Duration: 2016 Jan 42016 Jan 6

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume9516
    ISSN (Print)03029743
    ISSN (Electronic)16113349

    Other

    Other22nd International Conference on MultiMedia Modeling, MMM 2016
    CountryUnited States
    CityMiami
    Period16/1/416/1/6

    Fingerprint

    Video Summarization
    Summarization
    Layout
    Template
    Correspondence
    Style
    Unit
    Series
    Motion
    Evaluation
    Demonstrate

    Keywords

    • Comic generation
    • Shot boundary detection
    • Shot clustering

    ASJC Scopus subject areas

    • Computer Science(all)
    • Theoretical Computer Science

    Cite this

    Fukusato, T., Hirai, T., Kawamura, S., & Morishima, S. (2016). Computational cartoonist: A comic-style video summarization system for anime films. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 9516, pp. 42-50). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9516). Springer Verlag. https://doi.org/10.1007/978-3-319-27671-7_4

    Computational cartoonist : A comic-style video summarization system for anime films. / Fukusato, Tsukasa; Hirai, Tatsunori; Kawamura, Shunya; Morishima, Shigeo.

    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 9516 Springer Verlag, 2016. p. 42-50 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9516).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Fukusato, T, Hirai, T, Kawamura, S & Morishima, S 2016, Computational cartoonist: A comic-style video summarization system for anime films. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 9516, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9516, Springer Verlag, pp. 42-50, 22nd International Conference on MultiMedia Modeling, MMM 2016, Miami, United States, 16/1/4. https://doi.org/10.1007/978-3-319-27671-7_4
    Fukusato T, Hirai T, Kawamura S, Morishima S. Computational cartoonist: A comic-style video summarization system for anime films. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 9516. Springer Verlag. 2016. p. 42-50. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-27671-7_4
    Fukusato, Tsukasa ; Hirai, Tatsunori ; Kawamura, Shunya ; Morishima, Shigeo. / Computational cartoonist : A comic-style video summarization system for anime films. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 9516 Springer Verlag, 2016. pp. 42-50 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
    @inproceedings{dac5d85da6f74667a2c7ea5f82e27515,
    title = "Computational cartoonist: A comic-style video summarization system for anime films",
    abstract = "This paper presents Computational Cartoonist, a comicstyle anime summarization system that detects key frame and generates comic layout automatically. In contract to previous studies, we define evaluation criteria based on the correspondence between anime films and original comics to determine whether the result of comic-style summarization is relevant. To detect key frame detection for anime films, the proposed system segments the input video into a series of basic temporal units, and computes frame importance using image characteristics such as motion. Subsequently, comic-style layouts are decided on the basis of pre-defined templates stored in a database. Several results demonstrate the efficiency of our key frame detection over previous methods by evaluating the matching accuracy between key frames and original comic panels.",
    keywords = "Comic generation, Shot boundary detection, Shot clustering",
    author = "Tsukasa Fukusato and Tatsunori Hirai and Shunya Kawamura and Shigeo Morishima",
    year = "2016",
    doi = "10.1007/978-3-319-27671-7_4",
    language = "English",
    isbn = "9783319276700",
    volume = "9516",
    series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    publisher = "Springer Verlag",
    pages = "42--50",
    booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

    }

    TY - GEN

    T1 - Computational cartoonist

    T2 - A comic-style video summarization system for anime films

    AU - Fukusato, Tsukasa

    AU - Hirai, Tatsunori

    AU - Kawamura, Shunya

    AU - Morishima, Shigeo

    PY - 2016

    Y1 - 2016

    N2 - This paper presents Computational Cartoonist, a comicstyle anime summarization system that detects key frame and generates comic layout automatically. In contract to previous studies, we define evaluation criteria based on the correspondence between anime films and original comics to determine whether the result of comic-style summarization is relevant. To detect key frame detection for anime films, the proposed system segments the input video into a series of basic temporal units, and computes frame importance using image characteristics such as motion. Subsequently, comic-style layouts are decided on the basis of pre-defined templates stored in a database. Several results demonstrate the efficiency of our key frame detection over previous methods by evaluating the matching accuracy between key frames and original comic panels.

    AB - This paper presents Computational Cartoonist, a comicstyle anime summarization system that detects key frame and generates comic layout automatically. In contract to previous studies, we define evaluation criteria based on the correspondence between anime films and original comics to determine whether the result of comic-style summarization is relevant. To detect key frame detection for anime films, the proposed system segments the input video into a series of basic temporal units, and computes frame importance using image characteristics such as motion. Subsequently, comic-style layouts are decided on the basis of pre-defined templates stored in a database. Several results demonstrate the efficiency of our key frame detection over previous methods by evaluating the matching accuracy between key frames and original comic panels.

    KW - Comic generation

    KW - Shot boundary detection

    KW - Shot clustering

    UR - http://www.scopus.com/inward/record.url?scp=84955264520&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84955264520&partnerID=8YFLogxK

    U2 - 10.1007/978-3-319-27671-7_4

    DO - 10.1007/978-3-319-27671-7_4

    M3 - Conference contribution

    AN - SCOPUS:84955264520

    SN - 9783319276700

    VL - 9516

    T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    SP - 42

    EP - 50

    BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    PB - Springer Verlag

    ER -