Unsupervised Weight Parameter Estimation Method for Ensemble Learning

Masato Uchida, Yousuke Maehara, Hiroyuki Shioya

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

When there are multiple trained predictors, one may want to integrate them into one predictor. However, this is challenging if the performances of the trained predictors are unknown and labeled data for evaluating their performances are not given. In this paper, a method is described that uses unlabeled data to estimate the weight parameters needed to build an ensemble predictor integrating multiple trained component predictors. It is readily derived from a mathematical model of ensemble learning based on a generalized mixture of probability density functions and corresponding information divergence measures. Numerical experiments demonstrated that the performance of our method is much better than that of simple average-based ensemble learning, even when the assumption placed on the performances of the component predictors does not hold exactly.

Original languageEnglish
Pages (from-to)307-322
Number of pages16
JournalJournal of Mathematical Modelling and Algorithms
Volume10
Issue number4
DOIs
Publication statusPublished - 2011 Dec 1
Externally publishedYes

Keywords

  • Ensemble learning
  • Exponential mixture model
  • Kullback-Leibler divergence
  • Unsupervised learning

ASJC Scopus subject areas

  • Modelling and Simulation
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Unsupervised Weight Parameter Estimation Method for Ensemble Learning'. Together they form a unique fingerprint.

  • Cite this