A Semi-supervised Classification Using Gated Linear Model

Yanni Ren, Weite Li, Jinglu Hu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Semi-supervised learning aims to construct a classifier by making use of both labeled data and unlabeled data. This paper proposes a semi-supervised classification method using a gated linear model, based on the idea of effectively utilizing manifold information. A gating mechanism is firstly trained in a semi-supervised manner to capture manifold information which guides the generation of gate signals. Then the gated linear model is formulated into a linear regression form with the gate signals included. Secondly, a Laplacian regularized least squares (LapRLS) formulation is applied to optimize the linear regression form of the gated linear model. In this way, the gate signals are integrated into the kernel function, which is defined as inner product of the regression vectors. Moreover, this kernel function is used as a better similarity function for graph construction. As a result, the manifold information is ingeniously incorporated into both kernel and graph Laplacian in the LapRLS. Experimental results exhibit the effectiveness of our proposed method.

Original languageEnglish
Title of host publication2019 International Joint Conference on Neural Networks, IJCNN 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728119854
DOIs
Publication statusPublished - 2019 Jul
Event2019 International Joint Conference on Neural Networks, IJCNN 2019 - Budapest, Hungary
Duration: 2019 Jul 142019 Jul 19

Publication series

NameProceedings of the International Joint Conference on Neural Networks
Volume2019-July

Conference

Conference2019 International Joint Conference on Neural Networks, IJCNN 2019
CountryHungary
CityBudapest
Period19/7/1419/7/19

Fingerprint

Linear regression
Supervised learning
Classifiers

Keywords

  • graph construction
  • kernel composition
  • Laplacian RLS
  • semi-supervised learning

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this

Ren, Y., Li, W., & Hu, J. (2019). A Semi-supervised Classification Using Gated Linear Model. In 2019 International Joint Conference on Neural Networks, IJCNN 2019 [8852099] (Proceedings of the International Joint Conference on Neural Networks; Vol. 2019-July). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IJCNN.2019.8852099

A Semi-supervised Classification Using Gated Linear Model. / Ren, Yanni; Li, Weite; Hu, Jinglu.

2019 International Joint Conference on Neural Networks, IJCNN 2019. Institute of Electrical and Electronics Engineers Inc., 2019. 8852099 (Proceedings of the International Joint Conference on Neural Networks; Vol. 2019-July).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ren, Y, Li, W & Hu, J 2019, A Semi-supervised Classification Using Gated Linear Model. in 2019 International Joint Conference on Neural Networks, IJCNN 2019., 8852099, Proceedings of the International Joint Conference on Neural Networks, vol. 2019-July, Institute of Electrical and Electronics Engineers Inc., 2019 International Joint Conference on Neural Networks, IJCNN 2019, Budapest, Hungary, 19/7/14. https://doi.org/10.1109/IJCNN.2019.8852099
Ren Y, Li W, Hu J. A Semi-supervised Classification Using Gated Linear Model. In 2019 International Joint Conference on Neural Networks, IJCNN 2019. Institute of Electrical and Electronics Engineers Inc. 2019. 8852099. (Proceedings of the International Joint Conference on Neural Networks). https://doi.org/10.1109/IJCNN.2019.8852099
Ren, Yanni ; Li, Weite ; Hu, Jinglu. / A Semi-supervised Classification Using Gated Linear Model. 2019 International Joint Conference on Neural Networks, IJCNN 2019. Institute of Electrical and Electronics Engineers Inc., 2019. (Proceedings of the International Joint Conference on Neural Networks).
@inproceedings{90b80eb7537b4c2ba3040aeb5e71bef5,
title = "A Semi-supervised Classification Using Gated Linear Model",
abstract = "Semi-supervised learning aims to construct a classifier by making use of both labeled data and unlabeled data. This paper proposes a semi-supervised classification method using a gated linear model, based on the idea of effectively utilizing manifold information. A gating mechanism is firstly trained in a semi-supervised manner to capture manifold information which guides the generation of gate signals. Then the gated linear model is formulated into a linear regression form with the gate signals included. Secondly, a Laplacian regularized least squares (LapRLS) formulation is applied to optimize the linear regression form of the gated linear model. In this way, the gate signals are integrated into the kernel function, which is defined as inner product of the regression vectors. Moreover, this kernel function is used as a better similarity function for graph construction. As a result, the manifold information is ingeniously incorporated into both kernel and graph Laplacian in the LapRLS. Experimental results exhibit the effectiveness of our proposed method.",
keywords = "graph construction, kernel composition, Laplacian RLS, semi-supervised learning",
author = "Yanni Ren and Weite Li and Jinglu Hu",
year = "2019",
month = "7",
doi = "10.1109/IJCNN.2019.8852099",
language = "English",
series = "Proceedings of the International Joint Conference on Neural Networks",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2019 International Joint Conference on Neural Networks, IJCNN 2019",

}

TY - GEN

T1 - A Semi-supervised Classification Using Gated Linear Model

AU - Ren, Yanni

AU - Li, Weite

AU - Hu, Jinglu

PY - 2019/7

Y1 - 2019/7

N2 - Semi-supervised learning aims to construct a classifier by making use of both labeled data and unlabeled data. This paper proposes a semi-supervised classification method using a gated linear model, based on the idea of effectively utilizing manifold information. A gating mechanism is firstly trained in a semi-supervised manner to capture manifold information which guides the generation of gate signals. Then the gated linear model is formulated into a linear regression form with the gate signals included. Secondly, a Laplacian regularized least squares (LapRLS) formulation is applied to optimize the linear regression form of the gated linear model. In this way, the gate signals are integrated into the kernel function, which is defined as inner product of the regression vectors. Moreover, this kernel function is used as a better similarity function for graph construction. As a result, the manifold information is ingeniously incorporated into both kernel and graph Laplacian in the LapRLS. Experimental results exhibit the effectiveness of our proposed method.

AB - Semi-supervised learning aims to construct a classifier by making use of both labeled data and unlabeled data. This paper proposes a semi-supervised classification method using a gated linear model, based on the idea of effectively utilizing manifold information. A gating mechanism is firstly trained in a semi-supervised manner to capture manifold information which guides the generation of gate signals. Then the gated linear model is formulated into a linear regression form with the gate signals included. Secondly, a Laplacian regularized least squares (LapRLS) formulation is applied to optimize the linear regression form of the gated linear model. In this way, the gate signals are integrated into the kernel function, which is defined as inner product of the regression vectors. Moreover, this kernel function is used as a better similarity function for graph construction. As a result, the manifold information is ingeniously incorporated into both kernel and graph Laplacian in the LapRLS. Experimental results exhibit the effectiveness of our proposed method.

KW - graph construction

KW - kernel composition

KW - Laplacian RLS

KW - semi-supervised learning

UR - http://www.scopus.com/inward/record.url?scp=85073239138&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073239138&partnerID=8YFLogxK

U2 - 10.1109/IJCNN.2019.8852099

DO - 10.1109/IJCNN.2019.8852099

M3 - Conference contribution

AN - SCOPUS:85073239138

T3 - Proceedings of the International Joint Conference on Neural Networks

BT - 2019 International Joint Conference on Neural Networks, IJCNN 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -