An extension of genetic network programming with reinforcement learning using actor-critic

Hiroyuki Hatakeyama, Shingo Mabu, Kotaro Hirasawa, Takayuki Furuzuki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

A new graph-based evolutionary algorithm named "Genetic Network Programming, GNP" has been already proposed. GNP represents its solutions as graph structures, which can improve the expression ability and performance. In addition, GNP with Reinforcement Learning (GNP-RL) was proposed a few years ago. Since GNP-RL can do reinforcement learning during task execution in addition to evolution after task execution, it can search for solutions efficiently. In this paper, GNP with Actor-Critic (GNP-AC) which is a new type of GNP-RL is proposed. Originally, GNP deals with discrete information, but GNP-AC aims to deal with continuous information. The proposed method is applied to the controller of the Khepera simulator and its performance is evaluated.

Original languageEnglish
Title of host publication2006 IEEE Congress on Evolutionary Computation, CEC 2006
Pages1537-1543
Number of pages7
Publication statusPublished - 2006
Event2006 IEEE Congress on Evolutionary Computation, CEC 2006 - Vancouver, BC
Duration: 2006 Jul 162006 Jul 21

Other

Other2006 IEEE Congress on Evolutionary Computation, CEC 2006
CityVancouver, BC
Period06/7/1606/7/21

Fingerprint

Network Programming
Genetic Network
Reinforcement learning
Reinforcement Learning
Genetic Programming
Graph in graph theory
Evolutionary algorithms
Evolutionary Algorithms
Simulator
Simulators
Controller
Controllers
Actors

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software
  • Theoretical Computer Science

Cite this

Hatakeyama, H., Mabu, S., Hirasawa, K., & Furuzuki, T. (2006). An extension of genetic network programming with reinforcement learning using actor-critic. In 2006 IEEE Congress on Evolutionary Computation, CEC 2006 (pp. 1537-1543). [1688491]

An extension of genetic network programming with reinforcement learning using actor-critic. / Hatakeyama, Hiroyuki; Mabu, Shingo; Hirasawa, Kotaro; Furuzuki, Takayuki.

2006 IEEE Congress on Evolutionary Computation, CEC 2006. 2006. p. 1537-1543 1688491.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hatakeyama, H, Mabu, S, Hirasawa, K & Furuzuki, T 2006, An extension of genetic network programming with reinforcement learning using actor-critic. in 2006 IEEE Congress on Evolutionary Computation, CEC 2006., 1688491, pp. 1537-1543, 2006 IEEE Congress on Evolutionary Computation, CEC 2006, Vancouver, BC, 06/7/16.
Hatakeyama H, Mabu S, Hirasawa K, Furuzuki T. An extension of genetic network programming with reinforcement learning using actor-critic. In 2006 IEEE Congress on Evolutionary Computation, CEC 2006. 2006. p. 1537-1543. 1688491
Hatakeyama, Hiroyuki ; Mabu, Shingo ; Hirasawa, Kotaro ; Furuzuki, Takayuki. / An extension of genetic network programming with reinforcement learning using actor-critic. 2006 IEEE Congress on Evolutionary Computation, CEC 2006. 2006. pp. 1537-1543
@inproceedings{6688f17498404bfeb51d839918834f0a,
title = "An extension of genetic network programming with reinforcement learning using actor-critic",
abstract = "A new graph-based evolutionary algorithm named {"}Genetic Network Programming, GNP{"} has been already proposed. GNP represents its solutions as graph structures, which can improve the expression ability and performance. In addition, GNP with Reinforcement Learning (GNP-RL) was proposed a few years ago. Since GNP-RL can do reinforcement learning during task execution in addition to evolution after task execution, it can search for solutions efficiently. In this paper, GNP with Actor-Critic (GNP-AC) which is a new type of GNP-RL is proposed. Originally, GNP deals with discrete information, but GNP-AC aims to deal with continuous information. The proposed method is applied to the controller of the Khepera simulator and its performance is evaluated.",
author = "Hiroyuki Hatakeyama and Shingo Mabu and Kotaro Hirasawa and Takayuki Furuzuki",
year = "2006",
language = "English",
isbn = "0780394879",
pages = "1537--1543",
booktitle = "2006 IEEE Congress on Evolutionary Computation, CEC 2006",

}

TY - GEN

T1 - An extension of genetic network programming with reinforcement learning using actor-critic

AU - Hatakeyama, Hiroyuki

AU - Mabu, Shingo

AU - Hirasawa, Kotaro

AU - Furuzuki, Takayuki

PY - 2006

Y1 - 2006

N2 - A new graph-based evolutionary algorithm named "Genetic Network Programming, GNP" has been already proposed. GNP represents its solutions as graph structures, which can improve the expression ability and performance. In addition, GNP with Reinforcement Learning (GNP-RL) was proposed a few years ago. Since GNP-RL can do reinforcement learning during task execution in addition to evolution after task execution, it can search for solutions efficiently. In this paper, GNP with Actor-Critic (GNP-AC) which is a new type of GNP-RL is proposed. Originally, GNP deals with discrete information, but GNP-AC aims to deal with continuous information. The proposed method is applied to the controller of the Khepera simulator and its performance is evaluated.

AB - A new graph-based evolutionary algorithm named "Genetic Network Programming, GNP" has been already proposed. GNP represents its solutions as graph structures, which can improve the expression ability and performance. In addition, GNP with Reinforcement Learning (GNP-RL) was proposed a few years ago. Since GNP-RL can do reinforcement learning during task execution in addition to evolution after task execution, it can search for solutions efficiently. In this paper, GNP with Actor-Critic (GNP-AC) which is a new type of GNP-RL is proposed. Originally, GNP deals with discrete information, but GNP-AC aims to deal with continuous information. The proposed method is applied to the controller of the Khepera simulator and its performance is evaluated.

UR - http://www.scopus.com/inward/record.url?scp=34547365679&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34547365679&partnerID=8YFLogxK

M3 - Conference contribution

SN - 0780394879

SN - 9780780394872

SP - 1537

EP - 1543

BT - 2006 IEEE Congress on Evolutionary Computation, CEC 2006

ER -