Tool-body assimilation of humanoid robot using a neurodynamical system

Shun Nishide, Jun Tani, Toru Takahashi, Hiroshi G. Okuno, Tetsuya Ogata

Research output: Contribution to journalArticle

21 Citations (Scopus)

Abstract

Researches in the brain science field have uncovered the human capability to use tools as if they are part of the human bodies (known as tool-body assimilation) through trial and experience. This paper presents a method to apply a robot's active sensing experience to create the tool-body assimilation model. The model is composed of a feature extraction module, dynamics learning module, and a tool-body assimilation module. Self-organizing map (SOM) is used for the feature extraction module to extract object features from raw images. Multiple time-scales recurrent neural network (MTRNN) is used as the dynamics learning module. Parametric bias (PB) nodes are attached to the weights of MTRNN as second-order network to modulate the behavior of MTRNN based on the properties of the tool. The generalization capability of neural networks provide the model the ability to deal with unknown tools. Experiments were conducted with the humanoid robot HRP-2 using no tool, I-shaped, T-shaped, and L-shaped tools. The distribution of PB values have shown that the model has learned that the robot's dynamic properties change when holding a tool. Motion generation experiments show that the tool-body assimilation model is capable of applying to unknown tools to generate goal-oriented motions.

Original languageEnglish
Article number6095595
Pages (from-to)139-149
Number of pages11
JournalIEEE Transactions on Autonomous Mental Development
Volume4
Issue number2
DOIs
Publication statusPublished - 2012
Externally publishedYes

Fingerprint

Robots
Recurrent neural networks
Feature extraction
Self organizing maps
Brain
Experiments
Neural networks

Keywords

  • Active sensing
  • humanoid robots
  • recurrent neural network
  • tool-body assimilation

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software

Cite this

Tool-body assimilation of humanoid robot using a neurodynamical system. / Nishide, Shun; Tani, Jun; Takahashi, Toru; Okuno, Hiroshi G.; Ogata, Tetsuya.

In: IEEE Transactions on Autonomous Mental Development, Vol. 4, No. 2, 6095595, 2012, p. 139-149.

Research output: Contribution to journalArticle

@article{65308c1f868c48f3ac1d18eb709d8cf1,
title = "Tool-body assimilation of humanoid robot using a neurodynamical system",
abstract = "Researches in the brain science field have uncovered the human capability to use tools as if they are part of the human bodies (known as tool-body assimilation) through trial and experience. This paper presents a method to apply a robot's active sensing experience to create the tool-body assimilation model. The model is composed of a feature extraction module, dynamics learning module, and a tool-body assimilation module. Self-organizing map (SOM) is used for the feature extraction module to extract object features from raw images. Multiple time-scales recurrent neural network (MTRNN) is used as the dynamics learning module. Parametric bias (PB) nodes are attached to the weights of MTRNN as second-order network to modulate the behavior of MTRNN based on the properties of the tool. The generalization capability of neural networks provide the model the ability to deal with unknown tools. Experiments were conducted with the humanoid robot HRP-2 using no tool, I-shaped, T-shaped, and L-shaped tools. The distribution of PB values have shown that the model has learned that the robot's dynamic properties change when holding a tool. Motion generation experiments show that the tool-body assimilation model is capable of applying to unknown tools to generate goal-oriented motions.",
keywords = "Active sensing, humanoid robots, recurrent neural network, tool-body assimilation",
author = "Shun Nishide and Jun Tani and Toru Takahashi and Okuno, {Hiroshi G.} and Tetsuya Ogata",
year = "2012",
doi = "10.1109/TAMD.2011.2177660",
language = "English",
volume = "4",
pages = "139--149",
journal = "IEEE Transactions on Cognitive and Developmental Systems",
issn = "2379-8920",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "2",

}

TY - JOUR

T1 - Tool-body assimilation of humanoid robot using a neurodynamical system

AU - Nishide, Shun

AU - Tani, Jun

AU - Takahashi, Toru

AU - Okuno, Hiroshi G.

AU - Ogata, Tetsuya

PY - 2012

Y1 - 2012

N2 - Researches in the brain science field have uncovered the human capability to use tools as if they are part of the human bodies (known as tool-body assimilation) through trial and experience. This paper presents a method to apply a robot's active sensing experience to create the tool-body assimilation model. The model is composed of a feature extraction module, dynamics learning module, and a tool-body assimilation module. Self-organizing map (SOM) is used for the feature extraction module to extract object features from raw images. Multiple time-scales recurrent neural network (MTRNN) is used as the dynamics learning module. Parametric bias (PB) nodes are attached to the weights of MTRNN as second-order network to modulate the behavior of MTRNN based on the properties of the tool. The generalization capability of neural networks provide the model the ability to deal with unknown tools. Experiments were conducted with the humanoid robot HRP-2 using no tool, I-shaped, T-shaped, and L-shaped tools. The distribution of PB values have shown that the model has learned that the robot's dynamic properties change when holding a tool. Motion generation experiments show that the tool-body assimilation model is capable of applying to unknown tools to generate goal-oriented motions.

AB - Researches in the brain science field have uncovered the human capability to use tools as if they are part of the human bodies (known as tool-body assimilation) through trial and experience. This paper presents a method to apply a robot's active sensing experience to create the tool-body assimilation model. The model is composed of a feature extraction module, dynamics learning module, and a tool-body assimilation module. Self-organizing map (SOM) is used for the feature extraction module to extract object features from raw images. Multiple time-scales recurrent neural network (MTRNN) is used as the dynamics learning module. Parametric bias (PB) nodes are attached to the weights of MTRNN as second-order network to modulate the behavior of MTRNN based on the properties of the tool. The generalization capability of neural networks provide the model the ability to deal with unknown tools. Experiments were conducted with the humanoid robot HRP-2 using no tool, I-shaped, T-shaped, and L-shaped tools. The distribution of PB values have shown that the model has learned that the robot's dynamic properties change when holding a tool. Motion generation experiments show that the tool-body assimilation model is capable of applying to unknown tools to generate goal-oriented motions.

KW - Active sensing

KW - humanoid robots

KW - recurrent neural network

KW - tool-body assimilation

UR - http://www.scopus.com/inward/record.url?scp=84862334332&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84862334332&partnerID=8YFLogxK

U2 - 10.1109/TAMD.2011.2177660

DO - 10.1109/TAMD.2011.2177660

M3 - Article

VL - 4

SP - 139

EP - 149

JO - IEEE Transactions on Cognitive and Developmental Systems

JF - IEEE Transactions on Cognitive and Developmental Systems

SN - 2379-8920

IS - 2

M1 - 6095595

ER -