An autoencoder-based piecewise linear model for nonlinear classification using quasilinear support vector machines

Weite Li, Peifeng Liang, Takayuki Furuzuki

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

In this paper, we propose to implement a piecewise linear model to solve nonlinear classification problems. In order to realize a switch between linear models, a data-dependent gating mechanism achieved by an autoencoder is designed to assign gate signals automatically. We ensure that a diversity of gate signals is available so that it is possible for our model to switch between a large number of linear classifiers. Besides, we also introduce a sparsity level to add a manual control on the flexibility of the proposed model by using a winner-take-all strategy. Therefore, our model can maintain a balance between underfitting and overfitting problems. Then, given a learned gating mechanism, the proposed model is shown to be equivalent to a kernel machine by deriving a quasilinear kernel function with the gating mechanism included. Therefore, a quasilinear support vector machine can be applied to solve the nonlinear classification problems. Experimental results demonstrate that our proposed piecewise linear model performs better than or is at least competitive with its state-of-the-art counterparts.

Original languageEnglish
Pages (from-to)1236-1243
Number of pages8
JournalIEEJ Transactions on Electrical and Electronic Engineering
Volume14
Issue number8
DOIs
Publication statusPublished - 2019 Aug 1

    Fingerprint

Keywords

  • autoencoder
  • kernel machine
  • nonlinear classification
  • support vector machine

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this