A Metric Learning Method for Improving Neural Network Based Kernel Learning for SVM

Peifeng Liang, Xueqin Yao, Takayuki Furuzuki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A gated linear network is able to mimic the functionality of a pre-trained neural network with a compound activation function R(x) = x ∗ S(x). An SVM can then be formulated to further implicitly optimize the gated linear network, in which a quasi-linear kernel is composed by using the gate signal S(x) generated from the pre-trained neural network. In this way, we realize a neural network based kernel learning. In this paper, a distance metric learning is applied to improving the kernel learning. In the pre-training of neural network, the loss function of distance metric learning is used as a regularization term. With the loss function of distance metric learning, the samples from within-class become closer and that from between-class become farther, which can improve the quasi-linear kernel. Accordingly, the classifier optimized by SVM with quasi-linear kernel will have better performance. The proposed classification method is applied to different real-world datasets and simulation results confirm the effectiveness of the proposed method.

Original languageEnglish
Title of host publicationProceedings - 2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1641-1646
Number of pages6
ISBN (Electronic)9781538666500
DOIs
Publication statusPublished - 2019 Jan 16
Event2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018 - Miyazaki, Japan
Duration: 2018 Oct 72018 Oct 10

Publication series

NameProceedings - 2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018

Conference

Conference2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018
CountryJapan
CityMiyazaki
Period18/10/718/10/10

ASJC Scopus subject areas

  • Information Systems
  • Information Systems and Management
  • Health Informatics
  • Artificial Intelligence
  • Computer Networks and Communications
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'A Metric Learning Method for Improving Neural Network Based Kernel Learning for SVM'. Together they form a unique fingerprint.

  • Cite this

    Liang, P., Yao, X., & Furuzuki, T. (2019). A Metric Learning Method for Improving Neural Network Based Kernel Learning for SVM. In Proceedings - 2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018 (pp. 1641-1646). [8616280] (Proceedings - 2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SMC.2018.00284