Preferential training of neurodynamical model based on predictability of target dynamics

Shun Nishide, Harumitsu Nobuta, Hiroshi G. Okuno, Tetsuya Ogata

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Intrinsic motivation is one of the keys in implementing the mechanism of interest to robots. In this paper, we present a method to apply intrinsic motivation in dynamics learning with predictable and unpredictable targets in view. The robots arm is used for the predictable target and the humans arm is used for the unpredictable target in the experiment. The learning algorithm based on intrinsic motivation will automatically set a larger weight to targets that would contribute to decreasing the training error, while setting a smaller weight to others. A neurodynamical model, namely multiple timescales recurrent neural network (MTRNN), is utilized for studying the robots arm/external object dynamics. Training of MTRNN is done using the back propagation through time (BPTT) algorithm. We modify the BPTT algorithm by the following two steps. (1) Evaluate predictability of robots arm/objects using training error of MTRNN. (2) Assign a preference ratio, which represents the weight of the training, to each object based on predictability. The proposed training method would focus more on reducing training error of predictable objects compared to normal BPTT, where training error is equally treated for every object. Experiments were conducted using an actual robot platform, moving the robots arm while a human moves his arm in the robots camera view. The results of the experiment showed that the proposed training method could achieve smaller training error of the robots arm visuomotor dynamics, which is predictable from the robots motor command, compared to general training with BPTT. Evaluation of MTRNN as a forward model to predict untrained data showed that the proposed model is capable of predicting the robots hand motion, specifically with larger number of nodes.

Original languageEnglish
Pages (from-to)587-596
Number of pages10
JournalAdvanced Robotics
Volume29
Issue number9
DOIs
Publication statusPublished - 2015 May 3

Keywords

  • cognitive developmental robotics
  • intrinsic motivation
  • recurrent neural network

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Human-Computer Interaction
  • Hardware and Architecture
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Preferential training of neurodynamical model based on predictability of target dynamics'. Together they form a unique fingerprint.

  • Cite this