Robotic interface for embodied interaction via dance and musical performance

Kenji Suzuki, Shuji Hashimoto

    Research output: Contribution to journalArticle

    6 Citations (Scopus)

    Abstract

    A substantial robotic interface is proposed for collaborative work between humans and machines in a multimodal musical environment. The robotic interface is regarded as a "moving instrument" that displays the reactive motion on a stage while producing sound and music by embedded stereo speakers according to the context of the performance. In this paper, we introduce four musical platforms utilizing robotic technology and information technology in different circumstances. These are effective designing environments for artists such as musicians, composers, and choreographers, not only for music creation but also for media coordination including motion and visual effects. The architecture, called the MIDI network, enables them to control the robot movement as well as to compose music. Each of the developed robotic systems works as a sort of reflector to create an acoustic and visual space with multimodality. The proposed approach to equip musical instruments with an autonomous mobile ability promises a new type of computer music performance.

    Original languageEnglish
    Pages (from-to)656-671
    Number of pages16
    JournalProceedings of the IEEE
    Volume92
    Issue number4
    DOIs
    Publication statusPublished - 2004 Apr

    Fingerprint

    Robotics
    Instrument displays
    Musical instruments
    Computer music
    Information technology
    Acoustics
    Acoustic waves
    Robots

    Keywords

    • Computer music
    • Human-computer interaction (HCI)
    • Hyperinstruments
    • Multimodal human-machine interaction
    • Robotic interface
    • User interface human factors

    ASJC Scopus subject areas

    • Electrical and Electronic Engineering

    Cite this

    Robotic interface for embodied interaction via dance and musical performance. / Suzuki, Kenji; Hashimoto, Shuji.

    In: Proceedings of the IEEE, Vol. 92, No. 4, 04.2004, p. 656-671.

    Research output: Contribution to journalArticle

    Suzuki, Kenji ; Hashimoto, Shuji. / Robotic interface for embodied interaction via dance and musical performance. In: Proceedings of the IEEE. 2004 ; Vol. 92, No. 4. pp. 656-671.
    @article{eeed78ce9b6a48ea8dd59aac147eca31,
    title = "Robotic interface for embodied interaction via dance and musical performance",
    abstract = "A substantial robotic interface is proposed for collaborative work between humans and machines in a multimodal musical environment. The robotic interface is regarded as a {"}moving instrument{"} that displays the reactive motion on a stage while producing sound and music by embedded stereo speakers according to the context of the performance. In this paper, we introduce four musical platforms utilizing robotic technology and information technology in different circumstances. These are effective designing environments for artists such as musicians, composers, and choreographers, not only for music creation but also for media coordination including motion and visual effects. The architecture, called the MIDI network, enables them to control the robot movement as well as to compose music. Each of the developed robotic systems works as a sort of reflector to create an acoustic and visual space with multimodality. The proposed approach to equip musical instruments with an autonomous mobile ability promises a new type of computer music performance.",
    keywords = "Computer music, Human-computer interaction (HCI), Hyperinstruments, Multimodal human-machine interaction, Robotic interface, User interface human factors",
    author = "Kenji Suzuki and Shuji Hashimoto",
    year = "2004",
    month = "4",
    doi = "10.1109/JPROC.2004.825886",
    language = "English",
    volume = "92",
    pages = "656--671",
    journal = "Proceedings of the IEEE",
    issn = "0018-9219",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    number = "4",

    }

    TY - JOUR

    T1 - Robotic interface for embodied interaction via dance and musical performance

    AU - Suzuki, Kenji

    AU - Hashimoto, Shuji

    PY - 2004/4

    Y1 - 2004/4

    N2 - A substantial robotic interface is proposed for collaborative work between humans and machines in a multimodal musical environment. The robotic interface is regarded as a "moving instrument" that displays the reactive motion on a stage while producing sound and music by embedded stereo speakers according to the context of the performance. In this paper, we introduce four musical platforms utilizing robotic technology and information technology in different circumstances. These are effective designing environments for artists such as musicians, composers, and choreographers, not only for music creation but also for media coordination including motion and visual effects. The architecture, called the MIDI network, enables them to control the robot movement as well as to compose music. Each of the developed robotic systems works as a sort of reflector to create an acoustic and visual space with multimodality. The proposed approach to equip musical instruments with an autonomous mobile ability promises a new type of computer music performance.

    AB - A substantial robotic interface is proposed for collaborative work between humans and machines in a multimodal musical environment. The robotic interface is regarded as a "moving instrument" that displays the reactive motion on a stage while producing sound and music by embedded stereo speakers according to the context of the performance. In this paper, we introduce four musical platforms utilizing robotic technology and information technology in different circumstances. These are effective designing environments for artists such as musicians, composers, and choreographers, not only for music creation but also for media coordination including motion and visual effects. The architecture, called the MIDI network, enables them to control the robot movement as well as to compose music. Each of the developed robotic systems works as a sort of reflector to create an acoustic and visual space with multimodality. The proposed approach to equip musical instruments with an autonomous mobile ability promises a new type of computer music performance.

    KW - Computer music

    KW - Human-computer interaction (HCI)

    KW - Hyperinstruments

    KW - Multimodal human-machine interaction

    KW - Robotic interface

    KW - User interface human factors

    UR - http://www.scopus.com/inward/record.url?scp=21244457582&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=21244457582&partnerID=8YFLogxK

    U2 - 10.1109/JPROC.2004.825886

    DO - 10.1109/JPROC.2004.825886

    M3 - Article

    AN - SCOPUS:21244457582

    VL - 92

    SP - 656

    EP - 671

    JO - Proceedings of the IEEE

    JF - Proceedings of the IEEE

    SN - 0018-9219

    IS - 4

    ER -