Effect of Hamming Distance on Performance of ECOC with Estimated Binary Classifiers

Gendo Kumoi, Hideki Yagi, Manabu Kobayashi, Shigeichi Hirasawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Error-Correcting Output Coding (ECOC) is a method for constructing a multi-valued classifier using a combination of binary classifiers. The effectiveness of ECOC for multivalued classification problems has been demonstrated by many experimental evaluations. Therefore, classification performance have strongly depended on the data under consideration, and it is not clear what kind of combinations of binary classifiers have good performance. Motivated by this fact, the authors have clarified the best combination of binary classifiers that makes ECOC, assuming a situation in which each binary classifier can estimate the true posterior probability. They also have proposed a total framework for analytical evaluation when a binary classifier outputs an estimated posterior probability that approximates the true posterior probability. These studies established a framework for evaluating the theoretical performance of ECOC.Based on these findings, this study discusses the theoretical performance of ECOC from the upper bound perspective. The results showed that increasing the Hamming distance between code words can blackuce the error rate. We then evaluate various combinations of binary classifiers based on analytical evaluation.

Original languageEnglish
Title of host publication2022 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2022 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages111-116
Number of pages6
ISBN (Electronic)9781665452588
DOIs
Publication statusPublished - 2022
Event2022 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2022 - Prague, Czech Republic
Duration: 2022 Oct 92022 Oct 12

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
Volume2022-October
ISSN (Print)1062-922X

Conference

Conference2022 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2022
Country/TerritoryCzech Republic
CityPrague
Period22/10/922/10/12

Keywords

  • error-correcting output coding
  • estimated posterior probabilities
  • Hamming distance
  • multi-valued classification

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Effect of Hamming Distance on Performance of ECOC with Estimated Binary Classifiers'. Together they form a unique fingerprint.

Cite this