Human-robot cooperation using quasi-symbols generated by RNNPB model

Tetsuya Ogata, Shohei Matsumoto, Jun Tani, Kazunori Komatani, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)

Abstract

We describe a means of human robot interaction based not on natural language but on "quasi symbols," which represent sensory-motor dynamics in the task and/or environment. It thus overcomes a key problem of using natural language for human-robot interaction - the need to understand the dynamic context The quasi-symbols used are motion primitives corresponding to the attractor dynamics of the sensory-motor flow. These primitives are extracted from the observed data using the recurrent neural network with parametric bias (RNNPB) model. Binary representations based on the model parameters were implemented as quasi symbols in a humanoid robot, Robovie. The experiment task was robot-arm operation on a table. The quasi-symbols acquired by learning enabled the robot to perform novel motions. A person was able to control the arm through speech interaction using these quasi-symbols. These quasi symbols formed a hierarchical structure corresponding to the number of nodes in the model. The meaning of some of the quasi-symbols depended on the context, indicating that they are useful for human-robot interaction.

Original languageEnglish
Title of host publicationProceedings - IEEE International Conference on Robotics and Automation
Pages2156-2161
Number of pages6
DOIs
Publication statusPublished - 2007
Externally publishedYes
Event2007 IEEE International Conference on Robotics and Automation, ICRA'07 - Rome
Duration: 2007 Apr 102007 Apr 14

Other

Other2007 IEEE International Conference on Robotics and Automation, ICRA'07
CityRome
Period07/4/1007/4/14

Fingerprint

Human robot interaction
Recurrent neural networks
Robots
Experiments

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering

Cite this

Ogata, T., Matsumoto, S., Tani, J., Komatani, K., & Okuno, H. G. (2007). Human-robot cooperation using quasi-symbols generated by RNNPB model. In Proceedings - IEEE International Conference on Robotics and Automation (pp. 2156-2161). [4209404] https://doi.org/10.1109/ROBOT.2007.363640

Human-robot cooperation using quasi-symbols generated by RNNPB model. / Ogata, Tetsuya; Matsumoto, Shohei; Tani, Jun; Komatani, Kazunori; Okuno, Hiroshi G.

Proceedings - IEEE International Conference on Robotics and Automation. 2007. p. 2156-2161 4209404.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ogata, T, Matsumoto, S, Tani, J, Komatani, K & Okuno, HG 2007, Human-robot cooperation using quasi-symbols generated by RNNPB model. in Proceedings - IEEE International Conference on Robotics and Automation., 4209404, pp. 2156-2161, 2007 IEEE International Conference on Robotics and Automation, ICRA'07, Rome, 07/4/10. https://doi.org/10.1109/ROBOT.2007.363640
Ogata T, Matsumoto S, Tani J, Komatani K, Okuno HG. Human-robot cooperation using quasi-symbols generated by RNNPB model. In Proceedings - IEEE International Conference on Robotics and Automation. 2007. p. 2156-2161. 4209404 https://doi.org/10.1109/ROBOT.2007.363640
Ogata, Tetsuya ; Matsumoto, Shohei ; Tani, Jun ; Komatani, Kazunori ; Okuno, Hiroshi G. / Human-robot cooperation using quasi-symbols generated by RNNPB model. Proceedings - IEEE International Conference on Robotics and Automation. 2007. pp. 2156-2161
@inproceedings{2d17c7f8dfbf485ab6089b8eb0a99f87,
title = "Human-robot cooperation using quasi-symbols generated by RNNPB model",
abstract = "We describe a means of human robot interaction based not on natural language but on {"}quasi symbols,{"} which represent sensory-motor dynamics in the task and/or environment. It thus overcomes a key problem of using natural language for human-robot interaction - the need to understand the dynamic context The quasi-symbols used are motion primitives corresponding to the attractor dynamics of the sensory-motor flow. These primitives are extracted from the observed data using the recurrent neural network with parametric bias (RNNPB) model. Binary representations based on the model parameters were implemented as quasi symbols in a humanoid robot, Robovie. The experiment task was robot-arm operation on a table. The quasi-symbols acquired by learning enabled the robot to perform novel motions. A person was able to control the arm through speech interaction using these quasi-symbols. These quasi symbols formed a hierarchical structure corresponding to the number of nodes in the model. The meaning of some of the quasi-symbols depended on the context, indicating that they are useful for human-robot interaction.",
author = "Tetsuya Ogata and Shohei Matsumoto and Jun Tani and Kazunori Komatani and Okuno, {Hiroshi G.}",
year = "2007",
doi = "10.1109/ROBOT.2007.363640",
language = "English",
isbn = "1424406021",
pages = "2156--2161",
booktitle = "Proceedings - IEEE International Conference on Robotics and Automation",

}

TY - GEN

T1 - Human-robot cooperation using quasi-symbols generated by RNNPB model

AU - Ogata, Tetsuya

AU - Matsumoto, Shohei

AU - Tani, Jun

AU - Komatani, Kazunori

AU - Okuno, Hiroshi G.

PY - 2007

Y1 - 2007

N2 - We describe a means of human robot interaction based not on natural language but on "quasi symbols," which represent sensory-motor dynamics in the task and/or environment. It thus overcomes a key problem of using natural language for human-robot interaction - the need to understand the dynamic context The quasi-symbols used are motion primitives corresponding to the attractor dynamics of the sensory-motor flow. These primitives are extracted from the observed data using the recurrent neural network with parametric bias (RNNPB) model. Binary representations based on the model parameters were implemented as quasi symbols in a humanoid robot, Robovie. The experiment task was robot-arm operation on a table. The quasi-symbols acquired by learning enabled the robot to perform novel motions. A person was able to control the arm through speech interaction using these quasi-symbols. These quasi symbols formed a hierarchical structure corresponding to the number of nodes in the model. The meaning of some of the quasi-symbols depended on the context, indicating that they are useful for human-robot interaction.

AB - We describe a means of human robot interaction based not on natural language but on "quasi symbols," which represent sensory-motor dynamics in the task and/or environment. It thus overcomes a key problem of using natural language for human-robot interaction - the need to understand the dynamic context The quasi-symbols used are motion primitives corresponding to the attractor dynamics of the sensory-motor flow. These primitives are extracted from the observed data using the recurrent neural network with parametric bias (RNNPB) model. Binary representations based on the model parameters were implemented as quasi symbols in a humanoid robot, Robovie. The experiment task was robot-arm operation on a table. The quasi-symbols acquired by learning enabled the robot to perform novel motions. A person was able to control the arm through speech interaction using these quasi-symbols. These quasi symbols formed a hierarchical structure corresponding to the number of nodes in the model. The meaning of some of the quasi-symbols depended on the context, indicating that they are useful for human-robot interaction.

UR - http://www.scopus.com/inward/record.url?scp=36348959597&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=36348959597&partnerID=8YFLogxK

U2 - 10.1109/ROBOT.2007.363640

DO - 10.1109/ROBOT.2007.363640

M3 - Conference contribution

AN - SCOPUS:36348959597

SN - 1424406021

SN - 9781424406029

SP - 2156

EP - 2161

BT - Proceedings - IEEE International Conference on Robotics and Automation

ER -