Development of anthropomorphic musical performance robots: From understanding the nature of music performance to its application to entertainment robotics

Jorge Solis, Klaus Petersen, Takeshi Ninomiya, Masaki Takeuchi, Atsuo Takanishi

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    9 Citations (Scopus)

    Abstract

    During several decades, the research at Waseda University has been focused on developing anthropomorphic robots able of performing musical instruments. More recently, the authors have succeeded in developing a human-like robot able of playing the alto saxophone. As a result of our research efforts, the Waseda Flutist Robot WF-4RIV and the Waseda Saxophonist Robot WAS-1 have been designed to reproduce the human player performance. Therefore, as a long-term goal, we are proposing to enable the interaction between musical performance robots (i.e. robots orchestra). Such approach may enable us not only to propose new ways of musical expression, but also we may contribute to the better understanding of some of the mechanisms that enable the communication of humans in musical terms. In general terms, the communication of humans within an orchestra is a special case of conventional human social behavior. Rhythm, harmony and timbre of the music played represent the emotional states of the musicians. Of course, we are not considering a musical performance robot (MPR) just as a mere sophisticated MIDI instrument. Instead, its human-like design and the integration of perceptual capabilities may enable to act on its own autonomous initiative based on models which consider its own physical constrains. Due to the complexity of our long-term goal, in this paper, we are presenting our first steps towards enabling the interaction between musical performance robots. In particular, the details of the musical performance control systems are detailed. Thanks to the use of MIDI data, we performed preliminary experiments to enable a duet performance between the WF-4RIV and the WAS-1. We expect in the future; as a result of our research, we may enable a single anthropomorphic robot to perform different kinds of woodwind instruments as well as enable to interact at with level of perceptual capabilities (like human does).

    Original languageEnglish
    Title of host publication2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009
    Pages2309-2314
    Number of pages6
    DOIs
    Publication statusPublished - 2009 Dec 11
    Event2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009 - St. Louis, MO
    Duration: 2009 Oct 112009 Oct 15

    Other

    Other2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009
    CitySt. Louis, MO
    Period09/10/1109/10/15

    Fingerprint

    Robotics
    Robots
    Anthropomorphic robots
    Musical instruments
    Communication
    Control systems
    Experiments

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Vision and Pattern Recognition
    • Human-Computer Interaction
    • Control and Systems Engineering

    Cite this

    Solis, J., Petersen, K., Ninomiya, T., Takeuchi, M., & Takanishi, A. (2009). Development of anthropomorphic musical performance robots: From understanding the nature of music performance to its application to entertainment robotics. In 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009 (pp. 2309-2314). [5354547] https://doi.org/10.1109/IROS.2009.5354547

    Development of anthropomorphic musical performance robots : From understanding the nature of music performance to its application to entertainment robotics. / Solis, Jorge; Petersen, Klaus; Ninomiya, Takeshi; Takeuchi, Masaki; Takanishi, Atsuo.

    2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009. 2009. p. 2309-2314 5354547.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Solis, J, Petersen, K, Ninomiya, T, Takeuchi, M & Takanishi, A 2009, Development of anthropomorphic musical performance robots: From understanding the nature of music performance to its application to entertainment robotics. in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009., 5354547, pp. 2309-2314, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009, St. Louis, MO, 09/10/11. https://doi.org/10.1109/IROS.2009.5354547
    Solis J, Petersen K, Ninomiya T, Takeuchi M, Takanishi A. Development of anthropomorphic musical performance robots: From understanding the nature of music performance to its application to entertainment robotics. In 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009. 2009. p. 2309-2314. 5354547 https://doi.org/10.1109/IROS.2009.5354547
    Solis, Jorge ; Petersen, Klaus ; Ninomiya, Takeshi ; Takeuchi, Masaki ; Takanishi, Atsuo. / Development of anthropomorphic musical performance robots : From understanding the nature of music performance to its application to entertainment robotics. 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009. 2009. pp. 2309-2314
    @inproceedings{e4f1afbb7da542f5913faaae769ea697,
    title = "Development of anthropomorphic musical performance robots: From understanding the nature of music performance to its application to entertainment robotics",
    abstract = "During several decades, the research at Waseda University has been focused on developing anthropomorphic robots able of performing musical instruments. More recently, the authors have succeeded in developing a human-like robot able of playing the alto saxophone. As a result of our research efforts, the Waseda Flutist Robot WF-4RIV and the Waseda Saxophonist Robot WAS-1 have been designed to reproduce the human player performance. Therefore, as a long-term goal, we are proposing to enable the interaction between musical performance robots (i.e. robots orchestra). Such approach may enable us not only to propose new ways of musical expression, but also we may contribute to the better understanding of some of the mechanisms that enable the communication of humans in musical terms. In general terms, the communication of humans within an orchestra is a special case of conventional human social behavior. Rhythm, harmony and timbre of the music played represent the emotional states of the musicians. Of course, we are not considering a musical performance robot (MPR) just as a mere sophisticated MIDI instrument. Instead, its human-like design and the integration of perceptual capabilities may enable to act on its own autonomous initiative based on models which consider its own physical constrains. Due to the complexity of our long-term goal, in this paper, we are presenting our first steps towards enabling the interaction between musical performance robots. In particular, the details of the musical performance control systems are detailed. Thanks to the use of MIDI data, we performed preliminary experiments to enable a duet performance between the WF-4RIV and the WAS-1. We expect in the future; as a result of our research, we may enable a single anthropomorphic robot to perform different kinds of woodwind instruments as well as enable to interact at with level of perceptual capabilities (like human does).",
    author = "Jorge Solis and Klaus Petersen and Takeshi Ninomiya and Masaki Takeuchi and Atsuo Takanishi",
    year = "2009",
    month = "12",
    day = "11",
    doi = "10.1109/IROS.2009.5354547",
    language = "English",
    isbn = "9781424438044",
    pages = "2309--2314",
    booktitle = "2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009",

    }

    TY - GEN

    T1 - Development of anthropomorphic musical performance robots

    T2 - From understanding the nature of music performance to its application to entertainment robotics

    AU - Solis, Jorge

    AU - Petersen, Klaus

    AU - Ninomiya, Takeshi

    AU - Takeuchi, Masaki

    AU - Takanishi, Atsuo

    PY - 2009/12/11

    Y1 - 2009/12/11

    N2 - During several decades, the research at Waseda University has been focused on developing anthropomorphic robots able of performing musical instruments. More recently, the authors have succeeded in developing a human-like robot able of playing the alto saxophone. As a result of our research efforts, the Waseda Flutist Robot WF-4RIV and the Waseda Saxophonist Robot WAS-1 have been designed to reproduce the human player performance. Therefore, as a long-term goal, we are proposing to enable the interaction between musical performance robots (i.e. robots orchestra). Such approach may enable us not only to propose new ways of musical expression, but also we may contribute to the better understanding of some of the mechanisms that enable the communication of humans in musical terms. In general terms, the communication of humans within an orchestra is a special case of conventional human social behavior. Rhythm, harmony and timbre of the music played represent the emotional states of the musicians. Of course, we are not considering a musical performance robot (MPR) just as a mere sophisticated MIDI instrument. Instead, its human-like design and the integration of perceptual capabilities may enable to act on its own autonomous initiative based on models which consider its own physical constrains. Due to the complexity of our long-term goal, in this paper, we are presenting our first steps towards enabling the interaction between musical performance robots. In particular, the details of the musical performance control systems are detailed. Thanks to the use of MIDI data, we performed preliminary experiments to enable a duet performance between the WF-4RIV and the WAS-1. We expect in the future; as a result of our research, we may enable a single anthropomorphic robot to perform different kinds of woodwind instruments as well as enable to interact at with level of perceptual capabilities (like human does).

    AB - During several decades, the research at Waseda University has been focused on developing anthropomorphic robots able of performing musical instruments. More recently, the authors have succeeded in developing a human-like robot able of playing the alto saxophone. As a result of our research efforts, the Waseda Flutist Robot WF-4RIV and the Waseda Saxophonist Robot WAS-1 have been designed to reproduce the human player performance. Therefore, as a long-term goal, we are proposing to enable the interaction between musical performance robots (i.e. robots orchestra). Such approach may enable us not only to propose new ways of musical expression, but also we may contribute to the better understanding of some of the mechanisms that enable the communication of humans in musical terms. In general terms, the communication of humans within an orchestra is a special case of conventional human social behavior. Rhythm, harmony and timbre of the music played represent the emotional states of the musicians. Of course, we are not considering a musical performance robot (MPR) just as a mere sophisticated MIDI instrument. Instead, its human-like design and the integration of perceptual capabilities may enable to act on its own autonomous initiative based on models which consider its own physical constrains. Due to the complexity of our long-term goal, in this paper, we are presenting our first steps towards enabling the interaction between musical performance robots. In particular, the details of the musical performance control systems are detailed. Thanks to the use of MIDI data, we performed preliminary experiments to enable a duet performance between the WF-4RIV and the WAS-1. We expect in the future; as a result of our research, we may enable a single anthropomorphic robot to perform different kinds of woodwind instruments as well as enable to interact at with level of perceptual capabilities (like human does).

    UR - http://www.scopus.com/inward/record.url?scp=76249104936&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=76249104936&partnerID=8YFLogxK

    U2 - 10.1109/IROS.2009.5354547

    DO - 10.1109/IROS.2009.5354547

    M3 - Conference contribution

    AN - SCOPUS:76249104936

    SN - 9781424438044

    SP - 2309

    EP - 2314

    BT - 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009

    ER -