Audio-based automatic generation of a piano reduction score by considering the musical structure

Hirofumi Takamori, Takayuki Nakatsuka, Satoru Fukayama, Masataka Goto, Shigeo Morishima

研究成果: Conference contribution

抜粋

This study describes a method that automatically generates a piano reduction score from the audio recordings of popular music while considering the musical structure. The generated score comprises both right- and left-hand piano parts, which reflect the melodies, chords, and rhythms extracted from the original audio signals. Generating such a reduction score from an audio recording is challenging because automatic music transcription is still considered to be inefficient when the input contains sounds from various instruments. Reflecting the long-term correlation structure behind similar repetitive bars is also challenging; further, previous methods have independently generated each bar. Our approach addresses the aforementioned issues by integrating musical analysis, especially structural analysis, with music generation. Our method extracts rhythmic features as well as melodies and chords from the input audio recording and reflects them in the score. To consider the long-term correlation between bars, we use similarity matrices, created for several acoustical features, as constraints. We further conduct a multivariate regression analysis to determine the acoustical features that represent the most valuable constraints for generating a musical structure. We have generated piano scores using our method and have observed that we can produce scores that differently balance between the ability to achieve rhythmic characteristics and the ability to obtain musical structures.

元の言語English
ホスト出版物のタイトルMultiMedia Modeling - 25th International Conference, MMM 2019, Proceedings
編集者Benoit Huet, Ioannis Kompatsiaris, Stefanos Vrochidis, Vasileios Mezaris, Wen-Huang Cheng, Cathal Gurrin
出版者Springer-Verlag
ページ169-181
ページ数13
ISBN(印刷物)9783030057152
DOI
出版物ステータスPublished - 2019 1 1
イベント25th International Conference on MultiMedia Modeling, MMM 2019 - Thessaloniki, Greece
継続期間: 2019 1 82019 1 11

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
11296 LNCS
ISSN(印刷物)0302-9743
ISSN(電子版)1611-3349

Other

Other25th International Conference on MultiMedia Modeling, MMM 2019
Greece
Thessaloniki
期間19/1/819/1/11

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

フィンガープリント Audio-based automatic generation of a piano reduction score by considering the musical structure' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Takamori, H., Nakatsuka, T., Fukayama, S., Goto, M., & Morishima, S. (2019). Audio-based automatic generation of a piano reduction score by considering the musical structure. : B. Huet, I. Kompatsiaris, S. Vrochidis, V. Mezaris, W-H. Cheng, & C. Gurrin (版), MultiMedia Modeling - 25th International Conference, MMM 2019, Proceedings (pp. 169-181). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 巻数 11296 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-030-05716-9_14