Modal decomposition of musical instrument sounds via optimization-based non-linear filtering

Yoshiki Masuyama, Tsubasa Kusano, Kohei Yatabe, Yasuhiro Oikawa

Research output: Contribution to journalArticle

Abstract

For musical instrument sounds containing partials, which are referred to as modes, the decaying processes of the modes significantly affect the timbre of musical instruments and characterize the sounds. However, their accurate decomposition around the onset is not an easy task, especially when the sounds have sharp onsets and contain the non-modal percussive components such as the attack. This is because the sharp onsets of modes comprise peaky but broad spectra, which makes it difficult to get rid of the attack component. In this paper, an optimization-based method of modal decomposition is proposed to overcome it. The proposed method is formulated as a constrained optimization problem to enforce the perfect reconstruction property which is important for accurate decomposition and causality of modes. Three numerical simulations and application to the real piano sounds confirm the performance of the proposed method.

Original languageEnglish
Pages (from-to)186-197
Number of pages12
JournalAcoustical Science and Technology
Volume40
Issue number3
DOIs
Publication statusPublished - 2019 Jan 1

Fingerprint

decomposition
optimization
acoustics
attack
simulation

Keywords

  • Alternating direction method of multipliers (ADMM)
  • Causality
  • Convex optimization
  • Perfect reconstruction
  • Pianos

ASJC Scopus subject areas

  • Acoustics and Ultrasonics

Cite this

Modal decomposition of musical instrument sounds via optimization-based non-linear filtering. / Masuyama, Yoshiki; Kusano, Tsubasa; Yatabe, Kohei; Oikawa, Yasuhiro.

In: Acoustical Science and Technology, Vol. 40, No. 3, 01.01.2019, p. 186-197.

Research output: Contribution to journalArticle

@article{3239780fa1ce4b968981f05d3ea9dbca,
title = "Modal decomposition of musical instrument sounds via optimization-based non-linear filtering",
abstract = "For musical instrument sounds containing partials, which are referred to as modes, the decaying processes of the modes significantly affect the timbre of musical instruments and characterize the sounds. However, their accurate decomposition around the onset is not an easy task, especially when the sounds have sharp onsets and contain the non-modal percussive components such as the attack. This is because the sharp onsets of modes comprise peaky but broad spectra, which makes it difficult to get rid of the attack component. In this paper, an optimization-based method of modal decomposition is proposed to overcome it. The proposed method is formulated as a constrained optimization problem to enforce the perfect reconstruction property which is important for accurate decomposition and causality of modes. Three numerical simulations and application to the real piano sounds confirm the performance of the proposed method.",
keywords = "Alternating direction method of multipliers (ADMM), Causality, Convex optimization, Perfect reconstruction, Pianos",
author = "Yoshiki Masuyama and Tsubasa Kusano and Kohei Yatabe and Yasuhiro Oikawa",
year = "2019",
month = "1",
day = "1",
doi = "10.1250/ast.40.186",
language = "English",
volume = "40",
pages = "186--197",
journal = "Acoustical Science and Technology",
issn = "1346-3969",
publisher = "Acoustical Society of Japan",
number = "3",

}

TY - JOUR

T1 - Modal decomposition of musical instrument sounds via optimization-based non-linear filtering

AU - Masuyama, Yoshiki

AU - Kusano, Tsubasa

AU - Yatabe, Kohei

AU - Oikawa, Yasuhiro

PY - 2019/1/1

Y1 - 2019/1/1

N2 - For musical instrument sounds containing partials, which are referred to as modes, the decaying processes of the modes significantly affect the timbre of musical instruments and characterize the sounds. However, their accurate decomposition around the onset is not an easy task, especially when the sounds have sharp onsets and contain the non-modal percussive components such as the attack. This is because the sharp onsets of modes comprise peaky but broad spectra, which makes it difficult to get rid of the attack component. In this paper, an optimization-based method of modal decomposition is proposed to overcome it. The proposed method is formulated as a constrained optimization problem to enforce the perfect reconstruction property which is important for accurate decomposition and causality of modes. Three numerical simulations and application to the real piano sounds confirm the performance of the proposed method.

AB - For musical instrument sounds containing partials, which are referred to as modes, the decaying processes of the modes significantly affect the timbre of musical instruments and characterize the sounds. However, their accurate decomposition around the onset is not an easy task, especially when the sounds have sharp onsets and contain the non-modal percussive components such as the attack. This is because the sharp onsets of modes comprise peaky but broad spectra, which makes it difficult to get rid of the attack component. In this paper, an optimization-based method of modal decomposition is proposed to overcome it. The proposed method is formulated as a constrained optimization problem to enforce the perfect reconstruction property which is important for accurate decomposition and causality of modes. Three numerical simulations and application to the real piano sounds confirm the performance of the proposed method.

KW - Alternating direction method of multipliers (ADMM)

KW - Causality

KW - Convex optimization

KW - Perfect reconstruction

KW - Pianos

UR - http://www.scopus.com/inward/record.url?scp=85069965874&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069965874&partnerID=8YFLogxK

U2 - 10.1250/ast.40.186

DO - 10.1250/ast.40.186

M3 - Article

AN - SCOPUS:85069965874

VL - 40

SP - 186

EP - 197

JO - Acoustical Science and Technology

JF - Acoustical Science and Technology

SN - 1346-3969

IS - 3

ER -