A geometry-based two-step method for nonlinear classification using quasi-linear support vector machine

Weite Li, Bo Zhou, Benhui Chen, Takayuki Furuzuki

研究成果: Article

4 引用 (Scopus)

抄録

This paper proposes a two-step method to construct a nonlinear classifier consisting of multiple local linear classifiers interpolated with a basis function. In the first step, a geometry-based approach is first introduced to detect local linear partitions and build local linear classifiers. A coarse nonlinear classifier can then be constructed by interpolating the local linear classifiers. In the second step, a support vector machine (SVM) formulation is used to further implicitly optimize the linear parameters of the nonlinear classifier. In this way, the nonlinear classifier is constructed in exactly the same way as a standard SVM, using a special data-dependent quasi-linear kernel composed of the information of the local linear partitions. Numerical experiments on several real-world datasets demonstrate the effectiveness of the proposed classifier and show that, in cases where traditional nonlinear SVMs run into overfitting problems, the proposed classifier is effective in improving the classification performance.

元の言語English
ページ(範囲)883-890
ページ数8
ジャーナルIEEJ Transactions on Electrical and Electronic Engineering
12
発行部数6
DOI
出版物ステータスPublished - 2017 11 1

Fingerprint

Support vector machines
Classifiers
Geometry

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

これを引用

@article{01a11d0423f048719be0fcf1cceabf32,
title = "A geometry-based two-step method for nonlinear classification using quasi-linear support vector machine",
abstract = "This paper proposes a two-step method to construct a nonlinear classifier consisting of multiple local linear classifiers interpolated with a basis function. In the first step, a geometry-based approach is first introduced to detect local linear partitions and build local linear classifiers. A coarse nonlinear classifier can then be constructed by interpolating the local linear classifiers. In the second step, a support vector machine (SVM) formulation is used to further implicitly optimize the linear parameters of the nonlinear classifier. In this way, the nonlinear classifier is constructed in exactly the same way as a standard SVM, using a special data-dependent quasi-linear kernel composed of the information of the local linear partitions. Numerical experiments on several real-world datasets demonstrate the effectiveness of the proposed classifier and show that, in cases where traditional nonlinear SVMs run into overfitting problems, the proposed classifier is effective in improving the classification performance.",
keywords = "kernel composition, multiple local linear classifiers, nonlinear classification, support vector machine",
author = "Weite Li and Bo Zhou and Benhui Chen and Takayuki Furuzuki",
year = "2017",
month = "11",
day = "1",
doi = "10.1002/tee.22479",
language = "English",
volume = "12",
pages = "883--890",
journal = "IEEJ Transactions on Electrical and Electronic Engineering",
issn = "1931-4973",
publisher = "John Wiley and Sons Inc.",
number = "6",

}

TY - JOUR

T1 - A geometry-based two-step method for nonlinear classification using quasi-linear support vector machine

AU - Li, Weite

AU - Zhou, Bo

AU - Chen, Benhui

AU - Furuzuki, Takayuki

PY - 2017/11/1

Y1 - 2017/11/1

N2 - This paper proposes a two-step method to construct a nonlinear classifier consisting of multiple local linear classifiers interpolated with a basis function. In the first step, a geometry-based approach is first introduced to detect local linear partitions and build local linear classifiers. A coarse nonlinear classifier can then be constructed by interpolating the local linear classifiers. In the second step, a support vector machine (SVM) formulation is used to further implicitly optimize the linear parameters of the nonlinear classifier. In this way, the nonlinear classifier is constructed in exactly the same way as a standard SVM, using a special data-dependent quasi-linear kernel composed of the information of the local linear partitions. Numerical experiments on several real-world datasets demonstrate the effectiveness of the proposed classifier and show that, in cases where traditional nonlinear SVMs run into overfitting problems, the proposed classifier is effective in improving the classification performance.

AB - This paper proposes a two-step method to construct a nonlinear classifier consisting of multiple local linear classifiers interpolated with a basis function. In the first step, a geometry-based approach is first introduced to detect local linear partitions and build local linear classifiers. A coarse nonlinear classifier can then be constructed by interpolating the local linear classifiers. In the second step, a support vector machine (SVM) formulation is used to further implicitly optimize the linear parameters of the nonlinear classifier. In this way, the nonlinear classifier is constructed in exactly the same way as a standard SVM, using a special data-dependent quasi-linear kernel composed of the information of the local linear partitions. Numerical experiments on several real-world datasets demonstrate the effectiveness of the proposed classifier and show that, in cases where traditional nonlinear SVMs run into overfitting problems, the proposed classifier is effective in improving the classification performance.

KW - kernel composition

KW - multiple local linear classifiers

KW - nonlinear classification

KW - support vector machine

UR - http://www.scopus.com/inward/record.url?scp=85023769913&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85023769913&partnerID=8YFLogxK

U2 - 10.1002/tee.22479

DO - 10.1002/tee.22479

M3 - Article

AN - SCOPUS:85023769913

VL - 12

SP - 883

EP - 890

JO - IEEJ Transactions on Electrical and Electronic Engineering

JF - IEEJ Transactions on Electrical and Electronic Engineering

SN - 1931-4973

IS - 6

ER -