Computational cartoonist: A comic-style video summarization system for anime films

Tsukasa Fukusato, Tatsunori Hirai, Shunya Kawamura, Shigeo Morishima

    研究成果: Conference contribution

    2 引用 (Scopus)

    抄録

    This paper presents Computational Cartoonist, a comicstyle anime summarization system that detects key frame and generates comic layout automatically. In contract to previous studies, we define evaluation criteria based on the correspondence between anime films and original comics to determine whether the result of comic-style summarization is relevant. To detect key frame detection for anime films, the proposed system segments the input video into a series of basic temporal units, and computes frame importance using image characteristics such as motion. Subsequently, comic-style layouts are decided on the basis of pre-defined templates stored in a database. Several results demonstrate the efficiency of our key frame detection over previous methods by evaluating the matching accuracy between key frames and original comic panels.

    元の言語English
    ホスト出版物のタイトルLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    出版者Springer Verlag
    ページ42-50
    ページ数9
    9516
    ISBN(印刷物)9783319276700
    DOI
    出版物ステータスPublished - 2016
    イベント22nd International Conference on MultiMedia Modeling, MMM 2016 - Miami, United States
    継続期間: 2016 1 42016 1 6

    出版物シリーズ

    名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    9516
    ISSN(印刷物)03029743
    ISSN(電子版)16113349

    Other

    Other22nd International Conference on MultiMedia Modeling, MMM 2016
    United States
    Miami
    期間16/1/416/1/6

    Fingerprint

    Video Summarization
    Summarization
    Layout
    Template
    Correspondence
    Style
    Unit
    Series
    Motion
    Evaluation
    Demonstrate

    ASJC Scopus subject areas

    • Computer Science(all)
    • Theoretical Computer Science

    これを引用

    Fukusato, T., Hirai, T., Kawamura, S., & Morishima, S. (2016). Computational cartoonist: A comic-style video summarization system for anime films. : Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (巻 9516, pp. 42-50). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻数 9516). Springer Verlag. https://doi.org/10.1007/978-3-319-27671-7_4

    Computational cartoonist : A comic-style video summarization system for anime films. / Fukusato, Tsukasa; Hirai, Tatsunori; Kawamura, Shunya; Morishima, Shigeo.

    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 巻 9516 Springer Verlag, 2016. p. 42-50 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻 9516).

    研究成果: Conference contribution

    Fukusato, T, Hirai, T, Kawamura, S & Morishima, S 2016, Computational cartoonist: A comic-style video summarization system for anime films. : Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 巻. 9516, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 巻. 9516, Springer Verlag, pp. 42-50, 22nd International Conference on MultiMedia Modeling, MMM 2016, Miami, United States, 16/1/4. https://doi.org/10.1007/978-3-319-27671-7_4
    Fukusato T, Hirai T, Kawamura S, Morishima S. Computational cartoonist: A comic-style video summarization system for anime films. : Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 巻 9516. Springer Verlag. 2016. p. 42-50. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-27671-7_4
    Fukusato, Tsukasa ; Hirai, Tatsunori ; Kawamura, Shunya ; Morishima, Shigeo. / Computational cartoonist : A comic-style video summarization system for anime films. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 巻 9516 Springer Verlag, 2016. pp. 42-50 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
    @inproceedings{dac5d85da6f74667a2c7ea5f82e27515,
    title = "Computational cartoonist: A comic-style video summarization system for anime films",
    abstract = "This paper presents Computational Cartoonist, a comicstyle anime summarization system that detects key frame and generates comic layout automatically. In contract to previous studies, we define evaluation criteria based on the correspondence between anime films and original comics to determine whether the result of comic-style summarization is relevant. To detect key frame detection for anime films, the proposed system segments the input video into a series of basic temporal units, and computes frame importance using image characteristics such as motion. Subsequently, comic-style layouts are decided on the basis of pre-defined templates stored in a database. Several results demonstrate the efficiency of our key frame detection over previous methods by evaluating the matching accuracy between key frames and original comic panels.",
    keywords = "Comic generation, Shot boundary detection, Shot clustering",
    author = "Tsukasa Fukusato and Tatsunori Hirai and Shunya Kawamura and Shigeo Morishima",
    year = "2016",
    doi = "10.1007/978-3-319-27671-7_4",
    language = "English",
    isbn = "9783319276700",
    volume = "9516",
    series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
    publisher = "Springer Verlag",
    pages = "42--50",
    booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

    }

    TY - GEN

    T1 - Computational cartoonist

    T2 - A comic-style video summarization system for anime films

    AU - Fukusato, Tsukasa

    AU - Hirai, Tatsunori

    AU - Kawamura, Shunya

    AU - Morishima, Shigeo

    PY - 2016

    Y1 - 2016

    N2 - This paper presents Computational Cartoonist, a comicstyle anime summarization system that detects key frame and generates comic layout automatically. In contract to previous studies, we define evaluation criteria based on the correspondence between anime films and original comics to determine whether the result of comic-style summarization is relevant. To detect key frame detection for anime films, the proposed system segments the input video into a series of basic temporal units, and computes frame importance using image characteristics such as motion. Subsequently, comic-style layouts are decided on the basis of pre-defined templates stored in a database. Several results demonstrate the efficiency of our key frame detection over previous methods by evaluating the matching accuracy between key frames and original comic panels.

    AB - This paper presents Computational Cartoonist, a comicstyle anime summarization system that detects key frame and generates comic layout automatically. In contract to previous studies, we define evaluation criteria based on the correspondence between anime films and original comics to determine whether the result of comic-style summarization is relevant. To detect key frame detection for anime films, the proposed system segments the input video into a series of basic temporal units, and computes frame importance using image characteristics such as motion. Subsequently, comic-style layouts are decided on the basis of pre-defined templates stored in a database. Several results demonstrate the efficiency of our key frame detection over previous methods by evaluating the matching accuracy between key frames and original comic panels.

    KW - Comic generation

    KW - Shot boundary detection

    KW - Shot clustering

    UR - http://www.scopus.com/inward/record.url?scp=84955264520&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84955264520&partnerID=8YFLogxK

    U2 - 10.1007/978-3-319-27671-7_4

    DO - 10.1007/978-3-319-27671-7_4

    M3 - Conference contribution

    AN - SCOPUS:84955264520

    SN - 9783319276700

    VL - 9516

    T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    SP - 42

    EP - 50

    BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

    PB - Springer Verlag

    ER -