Order-aware exemplars for structuring video sets: Clustering, aligned matching and retrieval by similarity

Yasuo Matsuyama, Akihiro Shikano, Hiromichi Iwase, Teruki Horie

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    1 Citation (Scopus)

    Abstract

    Video data captured and uploaded under volatile conditions is accumulating into a flood of unstructured content that is hard to manage. In this paper, we present a set of algorithms that generate numeric or soft labels to structure automatically and produce video similarity rankings. Exemplar frames are extracted from each video during the labeling process. We propose five types of learning algorithms based on the following three classes: affinity propagation, k-means or harmonic competition, and pairwise nearest-neighbor. For redundancy reduction, we also provide an algorithm that prunes excessive exemplars. The five learning algorithms produced creditable order-aware exemplar sets for the target videos. Because the content and lengths of the videos differ in terms of temporal order, we provide new methods to analyze the similarities between exemplar sets. The m-distance similarity measure is the core concept used for the global and local alignments performed on the obtained exemplar sets. Based on this comparison mechanism, we identified high-precision recall curves for all five methods. In terms of learning speed, the k-means and pairwise nearest-neighbor classes are recommendable. To facilitate similar-video retrieval, we developed a graphical user interface that accepts videos downloaded from the Web. By replacing a procedure in the software, the proposed similar-video retrieval system can accommodate more elaborate frame comparison features.

    Original languageEnglish
    Title of host publicationProceedings of the International Joint Conference on Neural Networks
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Volume2015-September
    ISBN (Print)9781479919604, 9781479919604, 9781479919604, 9781479919604
    DOIs
    Publication statusPublished - 2015 Sep 28
    EventInternational Joint Conference on Neural Networks, IJCNN 2015 - Killarney, Ireland
    Duration: 2015 Jul 122015 Jul 17

    Other

    OtherInternational Joint Conference on Neural Networks, IJCNN 2015
    CountryIreland
    CityKillarney
    Period15/7/1215/7/17

    Fingerprint

    Learning algorithms
    Graphical user interfaces
    Labeling
    Redundancy
    Labels

    Keywords

    • frame exemplar
    • m-distance
    • numeric label
    • similar-video retrieval

    ASJC Scopus subject areas

    • Software
    • Artificial Intelligence

    Cite this

    Matsuyama, Y., Shikano, A., Iwase, H., & Horie, T. (2015). Order-aware exemplars for structuring video sets: Clustering, aligned matching and retrieval by similarity. In Proceedings of the International Joint Conference on Neural Networks (Vol. 2015-September). [7280423] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IJCNN.2015.7280423

    Order-aware exemplars for structuring video sets : Clustering, aligned matching and retrieval by similarity. / Matsuyama, Yasuo; Shikano, Akihiro; Iwase, Hiromichi; Horie, Teruki.

    Proceedings of the International Joint Conference on Neural Networks. Vol. 2015-September Institute of Electrical and Electronics Engineers Inc., 2015. 7280423.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Matsuyama, Y, Shikano, A, Iwase, H & Horie, T 2015, Order-aware exemplars for structuring video sets: Clustering, aligned matching and retrieval by similarity. in Proceedings of the International Joint Conference on Neural Networks. vol. 2015-September, 7280423, Institute of Electrical and Electronics Engineers Inc., International Joint Conference on Neural Networks, IJCNN 2015, Killarney, Ireland, 15/7/12. https://doi.org/10.1109/IJCNN.2015.7280423
    Matsuyama Y, Shikano A, Iwase H, Horie T. Order-aware exemplars for structuring video sets: Clustering, aligned matching and retrieval by similarity. In Proceedings of the International Joint Conference on Neural Networks. Vol. 2015-September. Institute of Electrical and Electronics Engineers Inc. 2015. 7280423 https://doi.org/10.1109/IJCNN.2015.7280423
    Matsuyama, Yasuo ; Shikano, Akihiro ; Iwase, Hiromichi ; Horie, Teruki. / Order-aware exemplars for structuring video sets : Clustering, aligned matching and retrieval by similarity. Proceedings of the International Joint Conference on Neural Networks. Vol. 2015-September Institute of Electrical and Electronics Engineers Inc., 2015.
    @inproceedings{0db0b4f593d04457a880d04cacd9a857,
    title = "Order-aware exemplars for structuring video sets: Clustering, aligned matching and retrieval by similarity",
    abstract = "Video data captured and uploaded under volatile conditions is accumulating into a flood of unstructured content that is hard to manage. In this paper, we present a set of algorithms that generate numeric or soft labels to structure automatically and produce video similarity rankings. Exemplar frames are extracted from each video during the labeling process. We propose five types of learning algorithms based on the following three classes: affinity propagation, k-means or harmonic competition, and pairwise nearest-neighbor. For redundancy reduction, we also provide an algorithm that prunes excessive exemplars. The five learning algorithms produced creditable order-aware exemplar sets for the target videos. Because the content and lengths of the videos differ in terms of temporal order, we provide new methods to analyze the similarities between exemplar sets. The m-distance similarity measure is the core concept used for the global and local alignments performed on the obtained exemplar sets. Based on this comparison mechanism, we identified high-precision recall curves for all five methods. In terms of learning speed, the k-means and pairwise nearest-neighbor classes are recommendable. To facilitate similar-video retrieval, we developed a graphical user interface that accepts videos downloaded from the Web. By replacing a procedure in the software, the proposed similar-video retrieval system can accommodate more elaborate frame comparison features.",
    keywords = "frame exemplar, m-distance, numeric label, similar-video retrieval",
    author = "Yasuo Matsuyama and Akihiro Shikano and Hiromichi Iwase and Teruki Horie",
    year = "2015",
    month = "9",
    day = "28",
    doi = "10.1109/IJCNN.2015.7280423",
    language = "English",
    isbn = "9781479919604",
    volume = "2015-September",
    booktitle = "Proceedings of the International Joint Conference on Neural Networks",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",

    }

    TY - GEN

    T1 - Order-aware exemplars for structuring video sets

    T2 - Clustering, aligned matching and retrieval by similarity

    AU - Matsuyama, Yasuo

    AU - Shikano, Akihiro

    AU - Iwase, Hiromichi

    AU - Horie, Teruki

    PY - 2015/9/28

    Y1 - 2015/9/28

    N2 - Video data captured and uploaded under volatile conditions is accumulating into a flood of unstructured content that is hard to manage. In this paper, we present a set of algorithms that generate numeric or soft labels to structure automatically and produce video similarity rankings. Exemplar frames are extracted from each video during the labeling process. We propose five types of learning algorithms based on the following three classes: affinity propagation, k-means or harmonic competition, and pairwise nearest-neighbor. For redundancy reduction, we also provide an algorithm that prunes excessive exemplars. The five learning algorithms produced creditable order-aware exemplar sets for the target videos. Because the content and lengths of the videos differ in terms of temporal order, we provide new methods to analyze the similarities between exemplar sets. The m-distance similarity measure is the core concept used for the global and local alignments performed on the obtained exemplar sets. Based on this comparison mechanism, we identified high-precision recall curves for all five methods. In terms of learning speed, the k-means and pairwise nearest-neighbor classes are recommendable. To facilitate similar-video retrieval, we developed a graphical user interface that accepts videos downloaded from the Web. By replacing a procedure in the software, the proposed similar-video retrieval system can accommodate more elaborate frame comparison features.

    AB - Video data captured and uploaded under volatile conditions is accumulating into a flood of unstructured content that is hard to manage. In this paper, we present a set of algorithms that generate numeric or soft labels to structure automatically and produce video similarity rankings. Exemplar frames are extracted from each video during the labeling process. We propose five types of learning algorithms based on the following three classes: affinity propagation, k-means or harmonic competition, and pairwise nearest-neighbor. For redundancy reduction, we also provide an algorithm that prunes excessive exemplars. The five learning algorithms produced creditable order-aware exemplar sets for the target videos. Because the content and lengths of the videos differ in terms of temporal order, we provide new methods to analyze the similarities between exemplar sets. The m-distance similarity measure is the core concept used for the global and local alignments performed on the obtained exemplar sets. Based on this comparison mechanism, we identified high-precision recall curves for all five methods. In terms of learning speed, the k-means and pairwise nearest-neighbor classes are recommendable. To facilitate similar-video retrieval, we developed a graphical user interface that accepts videos downloaded from the Web. By replacing a procedure in the software, the proposed similar-video retrieval system can accommodate more elaborate frame comparison features.

    KW - frame exemplar

    KW - m-distance

    KW - numeric label

    KW - similar-video retrieval

    UR - http://www.scopus.com/inward/record.url?scp=84951060719&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84951060719&partnerID=8YFLogxK

    U2 - 10.1109/IJCNN.2015.7280423

    DO - 10.1109/IJCNN.2015.7280423

    M3 - Conference contribution

    AN - SCOPUS:84951060719

    SN - 9781479919604

    SN - 9781479919604

    SN - 9781479919604

    SN - 9781479919604

    VL - 2015-September

    BT - Proceedings of the International Joint Conference on Neural Networks

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -