Training quasi-ARX neural network model by homotopy approach

Jinglu Hu*, Xibin Lu, Kotaro Hirasawa

*この研究の対応する著者

研究成果: Paper査読

2 被引用数 (Scopus)

抄録

Quasi-ARX neural networks (NN) are NN based nonlinear models that not only have linear structures similar to linear ARX models, but also have useful interpretation in part of their parameters. However when applying an ordinary backpropagation (BP) for the training, it has potential risk that the BP algorithm is stuck at a local minimum, which results in a poorly trained model. In this paper, a homotopy continuation method is introduced to improve the convergence performance of BP training. The idea is to start the BP training with the criterion function for linear ARX model, which is gradually deformed first into one for quasi-ARX NN model with linear node functions, and then into the actual one for quasi-ARX NN with sigmoid node functions. By building the deformation into a usual recursive procedure for BP training of quasi-ARX NN model with adaptable node functions so that the proposed homotopy based BP algorithm is able to achieve improved convergence performance without much increase in the computation load. Numerical simulation results show that the proposed homotopy based BP has better performance than an ordinary BP.

本文言語English
ページ17-22
ページ数6
出版ステータスPublished - 2004 12 1
イベントSICE Annual Conference 2004 - Sapporo, Japan
継続期間: 2004 8 42004 8 6

Conference

ConferenceSICE Annual Conference 2004
国/地域Japan
CitySapporo
Period04/8/404/8/6

ASJC Scopus subject areas

  • 制御およびシステム工学
  • コンピュータ サイエンスの応用
  • 電子工学および電気工学

フィンガープリント

「Training quasi-ARX neural network model by homotopy approach」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル