Universal learning network and its application to robust control

Kotaro Hirasawa, Junichi Murata, Takayuki Furuzuki, Chunzhi Jin

Research output: Contribution to journalArticle

22 Citations (Scopus)

Abstract

Universal learning networks (ULN's) and robust control system design are discussed. ULN's provide a generalized framework to model and control complex systems. They consist of a number of inter-connected nodes where the nodes may have any continuously differentiable nonlinear functions in them and each pair of nodes can be connected by multiple branches with arbitrary time delays. Therefore, physical systems which can be described by differential or difference equations and also their controllers can be modeled in a unified way. So, ULN's constitute a superset of neural networks or fuzzy neural networks. In order to optimize the systems, a generalized learning algorithm is derived for the ULN's, in which both the first order derivatives (gradients) and the higher order derivatives are incorporated. The derivatives are calculated by using forward or backward propagation schemes. These algorithms for calculating the derivatives are extended versions of back propagation through time (BPTT) and real time recurrent learning (RTRL) by Williams in the sense that generalized nonlinear functions and higher order derivatives are dealt with. As an application of ULN's, the higher order derivative, one of the distinguished features of ULN's, is applied to realizing a robust control system in this paper. In addition, it is shown that the higher order derivatives are effective tools to realize sophisticated control of nonlinear systems. Other features of ULN's such as multiple branches with arbitrary time delays and using a priori information will be discussed in other papers.

Original languageEnglish
Pages (from-to)419-430
Number of pages12
JournalIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Volume30
Issue number3
DOIs
Publication statusPublished - 2000
Externally publishedYes

Fingerprint

Robust control
Derivatives
Time delay
Control systems
Fuzzy neural networks
Difference equations
Backpropagation
Learning algorithms
Large scale systems
Nonlinear systems
Differential equations
Systems analysis
Neural networks
Controllers

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Artificial Intelligence
  • Human-Computer Interaction

Cite this

Universal learning network and its application to robust control. / Hirasawa, Kotaro; Murata, Junichi; Furuzuki, Takayuki; Jin, Chunzhi.

In: IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, Vol. 30, No. 3, 2000, p. 419-430.

Research output: Contribution to journalArticle

@article{254126fe7db1464ab18cb4ab1c580f3c,
title = "Universal learning network and its application to robust control",
abstract = "Universal learning networks (ULN's) and robust control system design are discussed. ULN's provide a generalized framework to model and control complex systems. They consist of a number of inter-connected nodes where the nodes may have any continuously differentiable nonlinear functions in them and each pair of nodes can be connected by multiple branches with arbitrary time delays. Therefore, physical systems which can be described by differential or difference equations and also their controllers can be modeled in a unified way. So, ULN's constitute a superset of neural networks or fuzzy neural networks. In order to optimize the systems, a generalized learning algorithm is derived for the ULN's, in which both the first order derivatives (gradients) and the higher order derivatives are incorporated. The derivatives are calculated by using forward or backward propagation schemes. These algorithms for calculating the derivatives are extended versions of back propagation through time (BPTT) and real time recurrent learning (RTRL) by Williams in the sense that generalized nonlinear functions and higher order derivatives are dealt with. As an application of ULN's, the higher order derivative, one of the distinguished features of ULN's, is applied to realizing a robust control system in this paper. In addition, it is shown that the higher order derivatives are effective tools to realize sophisticated control of nonlinear systems. Other features of ULN's such as multiple branches with arbitrary time delays and using a priori information will be discussed in other papers.",
author = "Kotaro Hirasawa and Junichi Murata and Takayuki Furuzuki and Chunzhi Jin",
year = "2000",
doi = "10.1109/3477.846231",
language = "English",
volume = "30",
pages = "419--430",
journal = "IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics",
issn = "1083-4419",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

TY - JOUR

T1 - Universal learning network and its application to robust control

AU - Hirasawa, Kotaro

AU - Murata, Junichi

AU - Furuzuki, Takayuki

AU - Jin, Chunzhi

PY - 2000

Y1 - 2000

N2 - Universal learning networks (ULN's) and robust control system design are discussed. ULN's provide a generalized framework to model and control complex systems. They consist of a number of inter-connected nodes where the nodes may have any continuously differentiable nonlinear functions in them and each pair of nodes can be connected by multiple branches with arbitrary time delays. Therefore, physical systems which can be described by differential or difference equations and also their controllers can be modeled in a unified way. So, ULN's constitute a superset of neural networks or fuzzy neural networks. In order to optimize the systems, a generalized learning algorithm is derived for the ULN's, in which both the first order derivatives (gradients) and the higher order derivatives are incorporated. The derivatives are calculated by using forward or backward propagation schemes. These algorithms for calculating the derivatives are extended versions of back propagation through time (BPTT) and real time recurrent learning (RTRL) by Williams in the sense that generalized nonlinear functions and higher order derivatives are dealt with. As an application of ULN's, the higher order derivative, one of the distinguished features of ULN's, is applied to realizing a robust control system in this paper. In addition, it is shown that the higher order derivatives are effective tools to realize sophisticated control of nonlinear systems. Other features of ULN's such as multiple branches with arbitrary time delays and using a priori information will be discussed in other papers.

AB - Universal learning networks (ULN's) and robust control system design are discussed. ULN's provide a generalized framework to model and control complex systems. They consist of a number of inter-connected nodes where the nodes may have any continuously differentiable nonlinear functions in them and each pair of nodes can be connected by multiple branches with arbitrary time delays. Therefore, physical systems which can be described by differential or difference equations and also their controllers can be modeled in a unified way. So, ULN's constitute a superset of neural networks or fuzzy neural networks. In order to optimize the systems, a generalized learning algorithm is derived for the ULN's, in which both the first order derivatives (gradients) and the higher order derivatives are incorporated. The derivatives are calculated by using forward or backward propagation schemes. These algorithms for calculating the derivatives are extended versions of back propagation through time (BPTT) and real time recurrent learning (RTRL) by Williams in the sense that generalized nonlinear functions and higher order derivatives are dealt with. As an application of ULN's, the higher order derivative, one of the distinguished features of ULN's, is applied to realizing a robust control system in this paper. In addition, it is shown that the higher order derivatives are effective tools to realize sophisticated control of nonlinear systems. Other features of ULN's such as multiple branches with arbitrary time delays and using a priori information will be discussed in other papers.

UR - http://www.scopus.com/inward/record.url?scp=0033723746&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0033723746&partnerID=8YFLogxK

U2 - 10.1109/3477.846231

DO - 10.1109/3477.846231

M3 - Article

C2 - 18252374

AN - SCOPUS:0033723746

VL - 30

SP - 419

EP - 430

JO - IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

JF - IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

SN - 1083-4419

IS - 3

ER -