One-class classification using a support vector machine with a quasi-linear kernel

Peifeng Liang, Weite Li, Hao Tian, Takayuki Furuzuki

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

This article proposes a novel method for one-class classification based on a divide-and-conquer strategy to improve the one-class support vector machine (SVM). The idea is to build a piecewise linear separation boundary in the feature space to separate the data points from the origin, which is expected to have a more compact region in the input space. For the purpose, the input space of the dataset is first divided into a group of partitions by using a partitioning mechanism of top s% winner-take-all autoencoder. A gated linear network is designed to implement a group of linear classifiers for each partition, in which the gate signals are generated from the autoencoder. By applying a one-class SVM (OCSVM) formulation to optimize the parameter set of the gated linear network, the one-class classifier is implemented in an exactly same way as a standard OCSVM with a quasi-linear kernel composed using a base kernel with the gate signals. The proposed one-class classification method is applied to different real-world datasets, and simulation results show that it shows a better performance than a traditional OCSVM.

Original languageEnglish
JournalIEEJ Transactions on Electrical and Electronic Engineering
DOIs
Publication statusAccepted/In press - 2018 Jan 1

Fingerprint

Linear networks
Support vector machines
Classifiers

Keywords

  • kernel composition
  • one-class classification
  • support vector machine
  • winner-take-all autoencoder

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

One-class classification using a support vector machine with a quasi-linear kernel. / Liang, Peifeng; Li, Weite; Tian, Hao; Furuzuki, Takayuki.

In: IEEJ Transactions on Electrical and Electronic Engineering, 01.01.2018.

Research output: Contribution to journalArticle

@article{d212afe4568246f59feec664efd49bb1,
title = "One-class classification using a support vector machine with a quasi-linear kernel",
abstract = "This article proposes a novel method for one-class classification based on a divide-and-conquer strategy to improve the one-class support vector machine (SVM). The idea is to build a piecewise linear separation boundary in the feature space to separate the data points from the origin, which is expected to have a more compact region in the input space. For the purpose, the input space of the dataset is first divided into a group of partitions by using a partitioning mechanism of top s{\%} winner-take-all autoencoder. A gated linear network is designed to implement a group of linear classifiers for each partition, in which the gate signals are generated from the autoencoder. By applying a one-class SVM (OCSVM) formulation to optimize the parameter set of the gated linear network, the one-class classifier is implemented in an exactly same way as a standard OCSVM with a quasi-linear kernel composed using a base kernel with the gate signals. The proposed one-class classification method is applied to different real-world datasets, and simulation results show that it shows a better performance than a traditional OCSVM.",
keywords = "kernel composition, one-class classification, support vector machine, winner-take-all autoencoder",
author = "Peifeng Liang and Weite Li and Hao Tian and Takayuki Furuzuki",
year = "2018",
month = "1",
day = "1",
doi = "10.1002/tee.22826",
language = "English",
journal = "IEEJ Transactions on Electrical and Electronic Engineering",
issn = "1931-4973",
publisher = "John Wiley and Sons Inc.",

}

TY - JOUR

T1 - One-class classification using a support vector machine with a quasi-linear kernel

AU - Liang, Peifeng

AU - Li, Weite

AU - Tian, Hao

AU - Furuzuki, Takayuki

PY - 2018/1/1

Y1 - 2018/1/1

N2 - This article proposes a novel method for one-class classification based on a divide-and-conquer strategy to improve the one-class support vector machine (SVM). The idea is to build a piecewise linear separation boundary in the feature space to separate the data points from the origin, which is expected to have a more compact region in the input space. For the purpose, the input space of the dataset is first divided into a group of partitions by using a partitioning mechanism of top s% winner-take-all autoencoder. A gated linear network is designed to implement a group of linear classifiers for each partition, in which the gate signals are generated from the autoencoder. By applying a one-class SVM (OCSVM) formulation to optimize the parameter set of the gated linear network, the one-class classifier is implemented in an exactly same way as a standard OCSVM with a quasi-linear kernel composed using a base kernel with the gate signals. The proposed one-class classification method is applied to different real-world datasets, and simulation results show that it shows a better performance than a traditional OCSVM.

AB - This article proposes a novel method for one-class classification based on a divide-and-conquer strategy to improve the one-class support vector machine (SVM). The idea is to build a piecewise linear separation boundary in the feature space to separate the data points from the origin, which is expected to have a more compact region in the input space. For the purpose, the input space of the dataset is first divided into a group of partitions by using a partitioning mechanism of top s% winner-take-all autoencoder. A gated linear network is designed to implement a group of linear classifiers for each partition, in which the gate signals are generated from the autoencoder. By applying a one-class SVM (OCSVM) formulation to optimize the parameter set of the gated linear network, the one-class classifier is implemented in an exactly same way as a standard OCSVM with a quasi-linear kernel composed using a base kernel with the gate signals. The proposed one-class classification method is applied to different real-world datasets, and simulation results show that it shows a better performance than a traditional OCSVM.

KW - kernel composition

KW - one-class classification

KW - support vector machine

KW - winner-take-all autoencoder

UR - http://www.scopus.com/inward/record.url?scp=85055292965&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055292965&partnerID=8YFLogxK

U2 - 10.1002/tee.22826

DO - 10.1002/tee.22826

M3 - Article

AN - SCOPUS:85055292965

JO - IEEJ Transactions on Electrical and Electronic Engineering

JF - IEEJ Transactions on Electrical and Electronic Engineering

SN - 1931-4973

ER -