TY - GEN

T1 - The α-EM algorithm

T2 - 4th International Work-Conference on Artificial and Natural Neural Networks, IWANN 1997

AU - Matsuyama, Yasuo

PY - 1997

Y1 - 1997

N2 - The a-divergence is utilized to derive a generalized expectation and maximization algorithm (EM algorithm). This algorithm has a wide range of applications. In this paper, neural network learning for mixture probabilities is focused. The a-EM algorithm includes the existing EM algorithm as a special case since that corresponds to a = -1. The parameter a specifies a probability weight for the learning. This number affects learning speed and local optimality. In the discussions of update equations of neural nets, extensions of basic statistics such as Fisher's efficient score, his measure of information and Cramdr-Rao's inequality are also given. Besides, this paper unveils another new idea. It is found that the cyclic EM structure can be used as a building block to generate a learning systolic array. Attaching monitors to this systolic array makes it possible to create a functionally distributed learning system.

AB - The a-divergence is utilized to derive a generalized expectation and maximization algorithm (EM algorithm). This algorithm has a wide range of applications. In this paper, neural network learning for mixture probabilities is focused. The a-EM algorithm includes the existing EM algorithm as a special case since that corresponds to a = -1. The parameter a specifies a probability weight for the learning. This number affects learning speed and local optimality. In the discussions of update equations of neural nets, extensions of basic statistics such as Fisher's efficient score, his measure of information and Cramdr-Rao's inequality are also given. Besides, this paper unveils another new idea. It is found that the cyclic EM structure can be used as a building block to generate a learning systolic array. Attaching monitors to this systolic array makes it possible to create a functionally distributed learning system.

UR - http://www.scopus.com/inward/record.url?scp=6744266982&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=6744266982&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:6744266982

SN - 3540630473

SN - 9783540630470

VL - 1240 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 483

EP - 492

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer Verlag

Y2 - 4 June 1997 through 6 June 1997

ER -