Learning and evolution of genetic network programming with knowledge transfer

Xianneng Li, Wen He, Kotaro Hirasawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Traditional evolutionary algorithms (EAs) generally starts evolution from scratch, in other words, randomly. However, this is computationally consuming, and can easily cause the instability of evolution. In order to solve the above problems, this paper describes a new method to improve the evolution efficiency of a recently proposed graph-based EA - genetic network programming (GNP) - by introducing knowledge transfer ability. The basic concept of the proposed method, named GNP-KT, arises from two steps: First, it formulates the knowledge by discovering abstract decision-making rules from source domains in a learning classifier system (LCS) aspect; Second, the knowledge is adaptively reused as advice when applying GNP to a target domain. A reinforcement learning (RL)-based method is proposed to automatically transfer knowledge from source domain to target domain, which eventually allows GNP-KT to result in better initial performance and final fitness values. The experimental results in a real mobile robot control problem confirm the superiority of GNP-KT over traditional methods.

Original languageEnglish
Title of host publicationProceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages798-805
Number of pages8
ISBN (Print)9781479914883
DOIs
Publication statusPublished - 2014 Sep 16
Event2014 IEEE Congress on Evolutionary Computation, CEC 2014 - Beijing
Duration: 2014 Jul 62014 Jul 11

Other

Other2014 IEEE Congress on Evolutionary Computation, CEC 2014
CityBeijing
Period14/7/614/7/11

Fingerprint

Network Programming
Knowledge Transfer
Genetic Network
Genetic Programming
Evolutionary algorithms
Reinforcement learning
Mobile robots
Classifiers
Decision making
Evolutionary Algorithms
Learning Classifier Systems
Target
Robot Control
Reinforcement Learning
Mobile Robot
Fitness
Control Problem
Decision Making
Learning
Experimental Results

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computational Theory and Mathematics
  • Theoretical Computer Science

Cite this

Li, X., He, W., & Hirasawa, K. (2014). Learning and evolution of genetic network programming with knowledge transfer. In Proceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014 (pp. 798-805). [6900315] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CEC.2014.6900315

Learning and evolution of genetic network programming with knowledge transfer. / Li, Xianneng; He, Wen; Hirasawa, Kotaro.

Proceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014. Institute of Electrical and Electronics Engineers Inc., 2014. p. 798-805 6900315.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Li, X, He, W & Hirasawa, K 2014, Learning and evolution of genetic network programming with knowledge transfer. in Proceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014., 6900315, Institute of Electrical and Electronics Engineers Inc., pp. 798-805, 2014 IEEE Congress on Evolutionary Computation, CEC 2014, Beijing, 14/7/6. https://doi.org/10.1109/CEC.2014.6900315
Li X, He W, Hirasawa K. Learning and evolution of genetic network programming with knowledge transfer. In Proceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014. Institute of Electrical and Electronics Engineers Inc. 2014. p. 798-805. 6900315 https://doi.org/10.1109/CEC.2014.6900315
Li, Xianneng ; He, Wen ; Hirasawa, Kotaro. / Learning and evolution of genetic network programming with knowledge transfer. Proceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 798-805
@inproceedings{452ecf2824f1456dadb82a3f81a2a7fb,
title = "Learning and evolution of genetic network programming with knowledge transfer",
abstract = "Traditional evolutionary algorithms (EAs) generally starts evolution from scratch, in other words, randomly. However, this is computationally consuming, and can easily cause the instability of evolution. In order to solve the above problems, this paper describes a new method to improve the evolution efficiency of a recently proposed graph-based EA - genetic network programming (GNP) - by introducing knowledge transfer ability. The basic concept of the proposed method, named GNP-KT, arises from two steps: First, it formulates the knowledge by discovering abstract decision-making rules from source domains in a learning classifier system (LCS) aspect; Second, the knowledge is adaptively reused as advice when applying GNP to a target domain. A reinforcement learning (RL)-based method is proposed to automatically transfer knowledge from source domain to target domain, which eventually allows GNP-KT to result in better initial performance and final fitness values. The experimental results in a real mobile robot control problem confirm the superiority of GNP-KT over traditional methods.",
author = "Xianneng Li and Wen He and Kotaro Hirasawa",
year = "2014",
month = "9",
day = "16",
doi = "10.1109/CEC.2014.6900315",
language = "English",
isbn = "9781479914883",
pages = "798--805",
booktitle = "Proceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Learning and evolution of genetic network programming with knowledge transfer

AU - Li, Xianneng

AU - He, Wen

AU - Hirasawa, Kotaro

PY - 2014/9/16

Y1 - 2014/9/16

N2 - Traditional evolutionary algorithms (EAs) generally starts evolution from scratch, in other words, randomly. However, this is computationally consuming, and can easily cause the instability of evolution. In order to solve the above problems, this paper describes a new method to improve the evolution efficiency of a recently proposed graph-based EA - genetic network programming (GNP) - by introducing knowledge transfer ability. The basic concept of the proposed method, named GNP-KT, arises from two steps: First, it formulates the knowledge by discovering abstract decision-making rules from source domains in a learning classifier system (LCS) aspect; Second, the knowledge is adaptively reused as advice when applying GNP to a target domain. A reinforcement learning (RL)-based method is proposed to automatically transfer knowledge from source domain to target domain, which eventually allows GNP-KT to result in better initial performance and final fitness values. The experimental results in a real mobile robot control problem confirm the superiority of GNP-KT over traditional methods.

AB - Traditional evolutionary algorithms (EAs) generally starts evolution from scratch, in other words, randomly. However, this is computationally consuming, and can easily cause the instability of evolution. In order to solve the above problems, this paper describes a new method to improve the evolution efficiency of a recently proposed graph-based EA - genetic network programming (GNP) - by introducing knowledge transfer ability. The basic concept of the proposed method, named GNP-KT, arises from two steps: First, it formulates the knowledge by discovering abstract decision-making rules from source domains in a learning classifier system (LCS) aspect; Second, the knowledge is adaptively reused as advice when applying GNP to a target domain. A reinforcement learning (RL)-based method is proposed to automatically transfer knowledge from source domain to target domain, which eventually allows GNP-KT to result in better initial performance and final fitness values. The experimental results in a real mobile robot control problem confirm the superiority of GNP-KT over traditional methods.

UR - http://www.scopus.com/inward/record.url?scp=84908606522&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908606522&partnerID=8YFLogxK

U2 - 10.1109/CEC.2014.6900315

DO - 10.1109/CEC.2014.6900315

M3 - Conference contribution

AN - SCOPUS:84908606522

SN - 9781479914883

SP - 798

EP - 805

BT - Proceedings of the 2014 IEEE Congress on Evolutionary Computation, CEC 2014

PB - Institute of Electrical and Electronics Engineers Inc.

ER -