Probabilistic universal learning networks and their applications to nonlinear control systems

Kotaro Hirasawa, Takayuki Furuzuki, Junichi Murata, ChunZhi Jin

Research output: Contribution to journalArticle

Abstract

Probabilistic Universal Learning Networks (PrULNs) are proposed, which are learning networks with a capability of dealing with stochastic signals. PrULNs are extensions of Universal Learning Networks (ULNs). ULNs form a superset of neural networks and were proposed to provide a universal framework for modeling and control of nonlinear large-scale complex systems. A generalized learning algorithm has been devised for ULNs which can also be used in a unified manner for almost all kinds of learning networks. However, the ULNs can not deal with stochastic variables. Specific value of a stochastic signal can be propagated through a ULN, but the ULN does not provide any stochastic characteristics of the signals propagating through it. The PrULNs proposed here are equipped with machinery to calculate stochastic properties of signals and to train network parameters so that the signals behave with the pre-specified stochastic properties. The PrULNs will contribute to the solution of the following problems: (1) improving the generalization capability of the learning networks, (2) more sophisticated stochastic control than the conventional stochastic control, (3) designing problems for the complex systems such as chaotic systems. In this paper, PrULN is proposed and is applied to a nonlinear control system with noise.

Original languageEnglish
Pages (from-to)149-158
Number of pages10
JournalResearch Reports on Information Science and Electrical Engineering of Kyushu University
Volume3
Issue number2
Publication statusPublished - 1998 Sep
Externally publishedYes

Fingerprint

Nonlinear control systems
Large scale systems
Chaotic systems
Learning algorithms
Machinery
Neural networks

Keywords

  • Backward propagation
  • Complex systems
  • Control systems
  • Covariance
  • Forward propagation
  • Gradient method
  • Learning networks
  • Mean
  • Neural networks
  • Nonlinear systems
  • Probabilistic networks
  • Stochastic signals

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Hardware and Architecture
  • Engineering (miscellaneous)

Cite this

Probabilistic universal learning networks and their applications to nonlinear control systems. / Hirasawa, Kotaro; Furuzuki, Takayuki; Murata, Junichi; Jin, ChunZhi.

In: Research Reports on Information Science and Electrical Engineering of Kyushu University, Vol. 3, No. 2, 09.1998, p. 149-158.

Research output: Contribution to journalArticle

@article{349f92321ef1492284579f49cb382403,
title = "Probabilistic universal learning networks and their applications to nonlinear control systems",
abstract = "Probabilistic Universal Learning Networks (PrULNs) are proposed, which are learning networks with a capability of dealing with stochastic signals. PrULNs are extensions of Universal Learning Networks (ULNs). ULNs form a superset of neural networks and were proposed to provide a universal framework for modeling and control of nonlinear large-scale complex systems. A generalized learning algorithm has been devised for ULNs which can also be used in a unified manner for almost all kinds of learning networks. However, the ULNs can not deal with stochastic variables. Specific value of a stochastic signal can be propagated through a ULN, but the ULN does not provide any stochastic characteristics of the signals propagating through it. The PrULNs proposed here are equipped with machinery to calculate stochastic properties of signals and to train network parameters so that the signals behave with the pre-specified stochastic properties. The PrULNs will contribute to the solution of the following problems: (1) improving the generalization capability of the learning networks, (2) more sophisticated stochastic control than the conventional stochastic control, (3) designing problems for the complex systems such as chaotic systems. In this paper, PrULN is proposed and is applied to a nonlinear control system with noise.",
keywords = "Backward propagation, Complex systems, Control systems, Covariance, Forward propagation, Gradient method, Learning networks, Mean, Neural networks, Nonlinear systems, Probabilistic networks, Stochastic signals",
author = "Kotaro Hirasawa and Takayuki Furuzuki and Junichi Murata and ChunZhi Jin",
year = "1998",
month = "9",
language = "English",
volume = "3",
pages = "149--158",
journal = "Research Reports on Information Science and Electrical Engineering of Kyushu University",
issn = "1342-3819",
publisher = "Kyushu University, Faculty of Science",
number = "2",

}

TY - JOUR

T1 - Probabilistic universal learning networks and their applications to nonlinear control systems

AU - Hirasawa, Kotaro

AU - Furuzuki, Takayuki

AU - Murata, Junichi

AU - Jin, ChunZhi

PY - 1998/9

Y1 - 1998/9

N2 - Probabilistic Universal Learning Networks (PrULNs) are proposed, which are learning networks with a capability of dealing with stochastic signals. PrULNs are extensions of Universal Learning Networks (ULNs). ULNs form a superset of neural networks and were proposed to provide a universal framework for modeling and control of nonlinear large-scale complex systems. A generalized learning algorithm has been devised for ULNs which can also be used in a unified manner for almost all kinds of learning networks. However, the ULNs can not deal with stochastic variables. Specific value of a stochastic signal can be propagated through a ULN, but the ULN does not provide any stochastic characteristics of the signals propagating through it. The PrULNs proposed here are equipped with machinery to calculate stochastic properties of signals and to train network parameters so that the signals behave with the pre-specified stochastic properties. The PrULNs will contribute to the solution of the following problems: (1) improving the generalization capability of the learning networks, (2) more sophisticated stochastic control than the conventional stochastic control, (3) designing problems for the complex systems such as chaotic systems. In this paper, PrULN is proposed and is applied to a nonlinear control system with noise.

AB - Probabilistic Universal Learning Networks (PrULNs) are proposed, which are learning networks with a capability of dealing with stochastic signals. PrULNs are extensions of Universal Learning Networks (ULNs). ULNs form a superset of neural networks and were proposed to provide a universal framework for modeling and control of nonlinear large-scale complex systems. A generalized learning algorithm has been devised for ULNs which can also be used in a unified manner for almost all kinds of learning networks. However, the ULNs can not deal with stochastic variables. Specific value of a stochastic signal can be propagated through a ULN, but the ULN does not provide any stochastic characteristics of the signals propagating through it. The PrULNs proposed here are equipped with machinery to calculate stochastic properties of signals and to train network parameters so that the signals behave with the pre-specified stochastic properties. The PrULNs will contribute to the solution of the following problems: (1) improving the generalization capability of the learning networks, (2) more sophisticated stochastic control than the conventional stochastic control, (3) designing problems for the complex systems such as chaotic systems. In this paper, PrULN is proposed and is applied to a nonlinear control system with noise.

KW - Backward propagation

KW - Complex systems

KW - Control systems

KW - Covariance

KW - Forward propagation

KW - Gradient method

KW - Learning networks

KW - Mean

KW - Neural networks

KW - Nonlinear systems

KW - Probabilistic networks

KW - Stochastic signals

UR - http://www.scopus.com/inward/record.url?scp=0032154411&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032154411&partnerID=8YFLogxK

M3 - Article

VL - 3

SP - 149

EP - 158

JO - Research Reports on Information Science and Electrical Engineering of Kyushu University

JF - Research Reports on Information Science and Electrical Engineering of Kyushu University

SN - 1342-3819

IS - 2

ER -