A soundtrack generation system to synchronize the climax of a video clip with music

Haruki Sato, Tatsunori Hirai, Tomoyasu Nakano, Masataka Goto, Shigeo Morishima

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2 Citations (Scopus)

    Abstract

    In this paper, we present a soundtrack generation system that can automatically add a soundtrack with the length and climax points aligned to those of a video clip. Adding a soundtrack to a video clip is an important process in video editing. Editors tend to add chorus sections to the climax points of the video clip by replacing and concatenating musical segments. However, this process is time-consuming. Our system automatically detects climaxes of both the video clips and music based on feature extraction and analysis. This enables the system to add a soundtrack in which the climax is synchronized to the climax of the video clip. We evaluated the generated soundtracks through a subjective evaluation.

    Original languageEnglish
    Title of host publication2016 IEEE International Conference on Multimedia and Expo, ICME 2016
    PublisherIEEE Computer Society
    Volume2016-August
    ISBN (Electronic)9781467372589
    DOIs
    Publication statusPublished - 2016 Aug 25
    Event2016 IEEE International Conference on Multimedia and Expo, ICME 2016 - Seattle, United States
    Duration: 2016 Jul 112016 Jul 15

    Other

    Other2016 IEEE International Conference on Multimedia and Expo, ICME 2016
    CountryUnited States
    CitySeattle
    Period16/7/1116/7/15

    Keywords

    • audio-visual feature extraction
    • climax synchronization
    • soundtrack generation

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Computer Science Applications

    Fingerprint Dive into the research topics of 'A soundtrack generation system to synchronize the climax of a video clip with music'. Together they form a unique fingerprint.

  • Cite this

    Sato, H., Hirai, T., Nakano, T., Goto, M., & Morishima, S. (2016). A soundtrack generation system to synchronize the climax of a video clip with music. In 2016 IEEE International Conference on Multimedia and Expo, ICME 2016 (Vol. 2016-August). [7552868] IEEE Computer Society. https://doi.org/10.1109/ICME.2016.7552868