TY - GEN
T1 - An extension of genetic network programming with reinforcement learning using actor-critic
AU - Hatakeyama, Hiroyuki
AU - Mabu, Shingo
AU - Hirasawa, Kotaro
AU - Hu, Jinglu
PY - 2006/12/1
Y1 - 2006/12/1
N2 - A new graph-based evolutionary algorithm named "Genetic Network Programming, GNP" has been already proposed. GNP represents its solutions as graph structures, which can improve the expression ability and performance. In addition, GNP with Reinforcement Learning (GNP-RL) was proposed a few years ago. Since GNP-RL can do reinforcement learning during task execution in addition to evolution after task execution, it can search for solutions efficiently. In this paper, GNP with Actor-Critic (GNP-AC) which is a new type of GNP-RL is proposed. Originally, GNP deals with discrete information, but GNP-AC aims to deal with continuous information. The proposed method is applied to the controller of the Khepera simulator and its performance is evaluated.
AB - A new graph-based evolutionary algorithm named "Genetic Network Programming, GNP" has been already proposed. GNP represents its solutions as graph structures, which can improve the expression ability and performance. In addition, GNP with Reinforcement Learning (GNP-RL) was proposed a few years ago. Since GNP-RL can do reinforcement learning during task execution in addition to evolution after task execution, it can search for solutions efficiently. In this paper, GNP with Actor-Critic (GNP-AC) which is a new type of GNP-RL is proposed. Originally, GNP deals with discrete information, but GNP-AC aims to deal with continuous information. The proposed method is applied to the controller of the Khepera simulator and its performance is evaluated.
UR - http://www.scopus.com/inward/record.url?scp=34547365679&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34547365679&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:34547365679
SN - 0780394879
SN - 9780780394872
T3 - 2006 IEEE Congress on Evolutionary Computation, CEC 2006
SP - 1537
EP - 1543
BT - 2006 IEEE Congress on Evolutionary Computation, CEC 2006
T2 - 2006 IEEE Congress on Evolutionary Computation, CEC 2006
Y2 - 16 July 2006 through 21 July 2006
ER -