Improvement of generalization ability for identifying dynamical systems by using universal learning networks

Kotaro Hirasawa, Sung Ho Kim, Jinglu Hu, Junichi Murata, Min Han, Chunzhi Jin

研究成果: Article査読

20 被引用数 (Scopus)

抄録

This paper studies how the generalization ability of models of dynamical systems can be improved by taking advantage of the second order derivatives of the outputs with respect to the external inputs. The proposed method can be regarded as a direct implementation of the well-known regularization technique using the higher order derivatives of the Universal Learning Networks (ULNs). ULNs consist of a number of interconnected nodes where the nodes may have any continuously differentiable nonlinear functions in them and each pair of nodes can be connected by multiple branches with arbitrary time delays. A generalized learning algorithm has been derived for the ULNs, in which both the first order derivatives (gradients) and the higher order derivatives are incorporated. First, the method for computing the second order derivatives of ULNs is discussed. Then, a new method for implementing the regularization term is presented. Finally, simulation studies on identification of a nonlinear dynamical system with noises are carried out to demonstrate the effectiveness of the proposed method. Simulation results show that the proposed method can improve the generalization ability of neural networks significantly, especially in terms that (1) the robust network can be obtained even when the branches of trained ULNs are destructed, and (2) the obtained performance does not depend on the initial parameter values.

本文言語English
ページ(範囲)1389-1404
ページ数16
ジャーナルNeural Networks
14
10
DOI
出版ステータスPublished - 2001
外部発表はい

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Artificial Intelligence

フィンガープリント 「Improvement of generalization ability for identifying dynamical systems by using universal learning networks」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル