System evaluation of ternary error-correcting output codes for multiclass classification problems

Shigeichi Hirasawa, Gendo Kumoi, Hideki Yagi, Manabu Kobayashi, Masayuki Goto, Tetsuya Sakai, Hiroshige Inazumi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

To solve multiple classification problems with M (geq 3) categories, many studies have been devoted using N (geq lceillog-{2}Mrceil) binary ({0, 1}) classifiers, where these systems are known as binary Error-Correcting Output Codes (binary ECOC). As an extended version of the binary ECOC, the ternary ({0,∗1}) ECOC have also been discussed, where ternary classifiers classify data into positive examples when the element is 1, into negative examples when the element is 0, and no classification when the element is. In this paper, we discuss the ternary ECOC system from the view point of the system evaluation model based on rate-distortion function. First, we discuss a table of M code words with length N which is given by a ternary matrix W of M rows and N columns. Next, by leveraging the benchmark data for multiclass document classification which is widely used in Japan, the relationships between the probability of classification error Pe and the number of the ternary classifiers N for a given M are experimentally investigated. In addition, by assuming the M-dimensional Normal distribution for a classification data model, the relationship between Pe and N for a given M is also examined. Finally, we show by the system evaluation model that the ternary ECOC systems have desirable properties such as 'Flexible', 'Elastic', and 'Effective Elastic', when M becomes large.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2893-2898
Number of pages6
ISBN (Electronic)9781728145693
DOIs
Publication statusPublished - 2019 Oct
Event2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019 - Bari, Italy
Duration: 2019 Oct 62019 Oct 9

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
Volume2019-October
ISSN (Print)1062-922X

Conference

Conference2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019
CountryItaly
CityBari
Period19/10/619/10/9

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'System evaluation of ternary error-correcting output codes for multiclass classification problems'. Together they form a unique fingerprint.

  • Cite this

    Hirasawa, S., Kumoi, G., Yagi, H., Kobayashi, M., Goto, M., Sakai, T., & Inazumi, H. (2019). System evaluation of ternary error-correcting output codes for multiclass classification problems. In 2019 IEEE International Conference on Systems, Man and Cybernetics, SMC 2019 (pp. 2893-2898). [8914295] (Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics; Vol. 2019-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SMC.2019.8914295