Multimodal human-humanoid interaction using motions, brain NIRS and spike trains

Yasuo Matsuyama, Nimiko Ochiai, Takashi Hatakeyama, Keita Noguchi

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    1 Citation (Scopus)

    Abstract

    Heterogeneous bio-signals including human motions, brain NIRS and neural spike trains are utilized for operating biped humanoids. The Bayesian network comprising Hidden Markov Models and Support Vector Machines is designed for the signal integration. By this method, the system complexity is reduced so that that total operation is within the scope of PCs. The designed system is capable of transducing original sensory meaning to another. This leads to prosthesis, rehabilitation and gaming. In addition to the supervised mode, the humanoid can act autonomously for its own designed tasks.

    Original languageEnglish
    Title of host publication5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010
    Pages173-174
    Number of pages2
    DOIs
    Publication statusPublished - 2010
    Event5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010 - Osaka
    Duration: 2010 Mar 22010 Mar 5

    Other

    Other5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010
    CityOsaka
    Period10/3/210/3/5

    Fingerprint

    Bayesian networks
    Hidden Markov models
    Patient rehabilitation
    Support vector machines
    Brain
    Prostheses and Implants

    Keywords

    • Brain NIRS
    • HMM/SVM-embedded BN
    • Human-humanoid interaction
    • Motion recognition
    • Multimodal
    • Neural spike train
    • Non-verbal
    • Sensory transducing

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Human-Computer Interaction

    Cite this

    Matsuyama, Y., Ochiai, N., Hatakeyama, T., & Noguchi, K. (2010). Multimodal human-humanoid interaction using motions, brain NIRS and spike trains. In 5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010 (pp. 173-174) https://doi.org/10.1145/1734454.1734529

    Multimodal human-humanoid interaction using motions, brain NIRS and spike trains. / Matsuyama, Yasuo; Ochiai, Nimiko; Hatakeyama, Takashi; Noguchi, Keita.

    5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010. 2010. p. 173-174.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Matsuyama, Y, Ochiai, N, Hatakeyama, T & Noguchi, K 2010, Multimodal human-humanoid interaction using motions, brain NIRS and spike trains. in 5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010. pp. 173-174, 5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010, Osaka, 10/3/2. https://doi.org/10.1145/1734454.1734529
    Matsuyama Y, Ochiai N, Hatakeyama T, Noguchi K. Multimodal human-humanoid interaction using motions, brain NIRS and spike trains. In 5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010. 2010. p. 173-174 https://doi.org/10.1145/1734454.1734529
    Matsuyama, Yasuo ; Ochiai, Nimiko ; Hatakeyama, Takashi ; Noguchi, Keita. / Multimodal human-humanoid interaction using motions, brain NIRS and spike trains. 5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010. 2010. pp. 173-174
    @inproceedings{26849f70dbf742d188b196564d76231d,
    title = "Multimodal human-humanoid interaction using motions, brain NIRS and spike trains",
    abstract = "Heterogeneous bio-signals including human motions, brain NIRS and neural spike trains are utilized for operating biped humanoids. The Bayesian network comprising Hidden Markov Models and Support Vector Machines is designed for the signal integration. By this method, the system complexity is reduced so that that total operation is within the scope of PCs. The designed system is capable of transducing original sensory meaning to another. This leads to prosthesis, rehabilitation and gaming. In addition to the supervised mode, the humanoid can act autonomously for its own designed tasks.",
    keywords = "Brain NIRS, HMM/SVM-embedded BN, Human-humanoid interaction, Motion recognition, Multimodal, Neural spike train, Non-verbal, Sensory transducing",
    author = "Yasuo Matsuyama and Nimiko Ochiai and Takashi Hatakeyama and Keita Noguchi",
    year = "2010",
    doi = "10.1145/1734454.1734529",
    language = "English",
    isbn = "9781424448937",
    pages = "173--174",
    booktitle = "5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010",

    }

    TY - GEN

    T1 - Multimodal human-humanoid interaction using motions, brain NIRS and spike trains

    AU - Matsuyama, Yasuo

    AU - Ochiai, Nimiko

    AU - Hatakeyama, Takashi

    AU - Noguchi, Keita

    PY - 2010

    Y1 - 2010

    N2 - Heterogeneous bio-signals including human motions, brain NIRS and neural spike trains are utilized for operating biped humanoids. The Bayesian network comprising Hidden Markov Models and Support Vector Machines is designed for the signal integration. By this method, the system complexity is reduced so that that total operation is within the scope of PCs. The designed system is capable of transducing original sensory meaning to another. This leads to prosthesis, rehabilitation and gaming. In addition to the supervised mode, the humanoid can act autonomously for its own designed tasks.

    AB - Heterogeneous bio-signals including human motions, brain NIRS and neural spike trains are utilized for operating biped humanoids. The Bayesian network comprising Hidden Markov Models and Support Vector Machines is designed for the signal integration. By this method, the system complexity is reduced so that that total operation is within the scope of PCs. The designed system is capable of transducing original sensory meaning to another. This leads to prosthesis, rehabilitation and gaming. In addition to the supervised mode, the humanoid can act autonomously for its own designed tasks.

    KW - Brain NIRS

    KW - HMM/SVM-embedded BN

    KW - Human-humanoid interaction

    KW - Motion recognition

    KW - Multimodal

    KW - Neural spike train

    KW - Non-verbal

    KW - Sensory transducing

    UR - http://www.scopus.com/inward/record.url?scp=77951538303&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=77951538303&partnerID=8YFLogxK

    U2 - 10.1145/1734454.1734529

    DO - 10.1145/1734454.1734529

    M3 - Conference contribution

    AN - SCOPUS:77951538303

    SN - 9781424448937

    SP - 173

    EP - 174

    BT - 5th ACM/IEEE International Conference on Human-Robot Interaction, HRI 2010

    ER -