Network Information Criterion—Determining the Number of Hidden Units for an Artificial Neural Network Model

Noboru Murata, Shuji Yoshizawa, Shun Ichi Amari

Research output: Contribution to journalArticle

401 Citations (Scopus)

Abstract

The problem of model selection, or determination of the number of hidden units, can be approached statistically, by generalizing Akaike’s information criterion (AIC) to be applicable to unfaithful (i.e., unrealizable) models with general loss criteria including regularization terms. The relation between the training error and the generalization error is studied in terms of the number of the training examples and the complexity of a network which reduces to the number of parameters in the ordinary statistical theory of the AIC. This relation leads to a new Network Information Criterion (NIC) which is useful for selecting the optimal network model based on a given training set.

Original languageEnglish
Pages (from-to)865-872
Number of pages8
JournalIEEE Transactions on Neural Networks
Volume5
Issue number6
DOIs
Publication statusPublished - 1994 Nov
Externally publishedYes

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Network Information Criterion—Determining the Number of Hidden Units for an Artificial Neural Network Model'. Together they form a unique fingerprint.

  • Cite this