Audio-based automatic generation of a piano reduction score by considering the musical structure

Hirofumi Takamori*, Takayuki Nakatsuka, Satoru Fukayama, Masataka Goto, Shigeo Morishima


研究成果: Conference contribution

3 被引用数 (Scopus)


This study describes a method that automatically generates a piano reduction score from the audio recordings of popular music while considering the musical structure. The generated score comprises both right- and left-hand piano parts, which reflect the melodies, chords, and rhythms extracted from the original audio signals. Generating such a reduction score from an audio recording is challenging because automatic music transcription is still considered to be inefficient when the input contains sounds from various instruments. Reflecting the long-term correlation structure behind similar repetitive bars is also challenging; further, previous methods have independently generated each bar. Our approach addresses the aforementioned issues by integrating musical analysis, especially structural analysis, with music generation. Our method extracts rhythmic features as well as melodies and chords from the input audio recording and reflects them in the score. To consider the long-term correlation between bars, we use similarity matrices, created for several acoustical features, as constraints. We further conduct a multivariate regression analysis to determine the acoustical features that represent the most valuable constraints for generating a musical structure. We have generated piano scores using our method and have observed that we can produce scores that differently balance between the ability to achieve rhythmic characteristics and the ability to obtain musical structures.

ホスト出版物のタイトルMultiMedia Modeling - 25th International Conference, MMM 2019, Proceedings
編集者Benoit Huet, Ioannis Kompatsiaris, Stefanos Vrochidis, Vasileios Mezaris, Wen-Huang Cheng, Cathal Gurrin
出版社Springer Verlag
出版ステータスPublished - 2019
イベント25th International Conference on MultiMedia Modeling, MMM 2019 - Thessaloniki, Greece
継続期間: 2019 1月 82019 1月 11


名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
11296 LNCS


Other25th International Conference on MultiMedia Modeling, MMM 2019

ASJC Scopus subject areas

  • 理論的コンピュータサイエンス
  • コンピュータ サイエンス(全般)


「Audio-based automatic generation of a piano reduction score by considering the musical structure」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。