Learning to reproduce fluctuating time series by inferring their time-dependent stochastic properties: Application in Robot learning via tutoring

Shingo Murata, Jun Namikawa, Hiroaki Arie, Shigeki Sugano, Jun Tani

Research output: Contribution to journalArticle

33 Citations (Scopus)


This study proposes a novel type of dynamic neural network model that can learn to extract stochastic or fluctuating structures hidden in time series data. The network learns to predict not only the mean of the next input state, but also its time-dependent variance. The training method is based on maximum likelihood estimation by using the gradient descent method and the likelihood function is expressed as a function of the estimated variance. Regarding the model evaluation, we present numerical experiments in which training data were generated in different ways utilizing Gaussian noise. Our analysis showed that the network can predict the time-dependent variance and the mean and it can also reproduce the target stochastic sequence data by utilizing the estimated variance. Furthermore, it was shown that a humanoid robot using the proposed network can learn to reproduce latent stochastic structures hidden in fluctuating tutoring trajectories. This learning scheme is essential for the acquisition of sensory-guided skilled behavior.

Original languageEnglish
Article number6502665
Pages (from-to)298-310
Number of pages13
JournalIEEE Transactions on Autonomous Mental Development
Issue number4
Publication statusPublished - 2013 Dec 1



  • Dynamical systems approach
  • humanoid robot
  • maximum likelihood estimation
  • recurrent neural network

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this