A geometry-based two-step method for nonlinear classification using quasi-linear support vector machine

Weite Li, Bo Zhou, Benhui Chen, Takayuki Furuzuki

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

This paper proposes a two-step method to construct a nonlinear classifier consisting of multiple local linear classifiers interpolated with a basis function. In the first step, a geometry-based approach is first introduced to detect local linear partitions and build local linear classifiers. A coarse nonlinear classifier can then be constructed by interpolating the local linear classifiers. In the second step, a support vector machine (SVM) formulation is used to further implicitly optimize the linear parameters of the nonlinear classifier. In this way, the nonlinear classifier is constructed in exactly the same way as a standard SVM, using a special data-dependent quasi-linear kernel composed of the information of the local linear partitions. Numerical experiments on several real-world datasets demonstrate the effectiveness of the proposed classifier and show that, in cases where traditional nonlinear SVMs run into overfitting problems, the proposed classifier is effective in improving the classification performance.

Original languageEnglish
Pages (from-to)883-890
Number of pages8
JournalIEEJ Transactions on Electrical and Electronic Engineering
Volume12
Issue number6
DOIs
Publication statusPublished - 2017 Nov 1

Fingerprint

Support vector machines
Classifiers
Geometry

Keywords

  • kernel composition
  • multiple local linear classifiers
  • nonlinear classification
  • support vector machine

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

A geometry-based two-step method for nonlinear classification using quasi-linear support vector machine. / Li, Weite; Zhou, Bo; Chen, Benhui; Furuzuki, Takayuki.

In: IEEJ Transactions on Electrical and Electronic Engineering, Vol. 12, No. 6, 01.11.2017, p. 883-890.

Research output: Contribution to journalArticle

@article{01a11d0423f048719be0fcf1cceabf32,
title = "A geometry-based two-step method for nonlinear classification using quasi-linear support vector machine",
abstract = "This paper proposes a two-step method to construct a nonlinear classifier consisting of multiple local linear classifiers interpolated with a basis function. In the first step, a geometry-based approach is first introduced to detect local linear partitions and build local linear classifiers. A coarse nonlinear classifier can then be constructed by interpolating the local linear classifiers. In the second step, a support vector machine (SVM) formulation is used to further implicitly optimize the linear parameters of the nonlinear classifier. In this way, the nonlinear classifier is constructed in exactly the same way as a standard SVM, using a special data-dependent quasi-linear kernel composed of the information of the local linear partitions. Numerical experiments on several real-world datasets demonstrate the effectiveness of the proposed classifier and show that, in cases where traditional nonlinear SVMs run into overfitting problems, the proposed classifier is effective in improving the classification performance.",
keywords = "kernel composition, multiple local linear classifiers, nonlinear classification, support vector machine",
author = "Weite Li and Bo Zhou and Benhui Chen and Takayuki Furuzuki",
year = "2017",
month = "11",
day = "1",
doi = "10.1002/tee.22479",
language = "English",
volume = "12",
pages = "883--890",
journal = "IEEJ Transactions on Electrical and Electronic Engineering",
issn = "1931-4973",
publisher = "John Wiley and Sons Inc.",
number = "6",

}

TY - JOUR

T1 - A geometry-based two-step method for nonlinear classification using quasi-linear support vector machine

AU - Li, Weite

AU - Zhou, Bo

AU - Chen, Benhui

AU - Furuzuki, Takayuki

PY - 2017/11/1

Y1 - 2017/11/1

N2 - This paper proposes a two-step method to construct a nonlinear classifier consisting of multiple local linear classifiers interpolated with a basis function. In the first step, a geometry-based approach is first introduced to detect local linear partitions and build local linear classifiers. A coarse nonlinear classifier can then be constructed by interpolating the local linear classifiers. In the second step, a support vector machine (SVM) formulation is used to further implicitly optimize the linear parameters of the nonlinear classifier. In this way, the nonlinear classifier is constructed in exactly the same way as a standard SVM, using a special data-dependent quasi-linear kernel composed of the information of the local linear partitions. Numerical experiments on several real-world datasets demonstrate the effectiveness of the proposed classifier and show that, in cases where traditional nonlinear SVMs run into overfitting problems, the proposed classifier is effective in improving the classification performance.

AB - This paper proposes a two-step method to construct a nonlinear classifier consisting of multiple local linear classifiers interpolated with a basis function. In the first step, a geometry-based approach is first introduced to detect local linear partitions and build local linear classifiers. A coarse nonlinear classifier can then be constructed by interpolating the local linear classifiers. In the second step, a support vector machine (SVM) formulation is used to further implicitly optimize the linear parameters of the nonlinear classifier. In this way, the nonlinear classifier is constructed in exactly the same way as a standard SVM, using a special data-dependent quasi-linear kernel composed of the information of the local linear partitions. Numerical experiments on several real-world datasets demonstrate the effectiveness of the proposed classifier and show that, in cases where traditional nonlinear SVMs run into overfitting problems, the proposed classifier is effective in improving the classification performance.

KW - kernel composition

KW - multiple local linear classifiers

KW - nonlinear classification

KW - support vector machine

UR - http://www.scopus.com/inward/record.url?scp=85023769913&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85023769913&partnerID=8YFLogxK

U2 - 10.1002/tee.22479

DO - 10.1002/tee.22479

M3 - Article

VL - 12

SP - 883

EP - 890

JO - IEEJ Transactions on Electrical and Electronic Engineering

JF - IEEJ Transactions on Electrical and Electronic Engineering

SN - 1931-4973

IS - 6

ER -