TY - GEN
T1 - Sample efficiency improvement on neuroevolution via estimation-based elimination strategy
AU - Xu, Shengbo
AU - Inoue, Yuki
AU - Inamura, Tetsunari
AU - Moriguchi, Hirotaka
AU - Honiden, Shinichi
N1 - Publisher Copyright:
Copyright © 2014, International Foundation for Autonomous Agents and Multiagent Systems (www.ifaamas.org). All rights reserved.
PY - 2014
Y1 - 2014
N2 - In this paper, we propose estimation-based elimination strategy, which improves sample efficiency of NeuroEvolution (NE) algorithms. The fitness of new individuals was estimated using fitness of individuals evaluated in the past generations. The estimation was achieved by taking average fitness of individuals with high correlation with the new individual. Estimation-based elimination strategy avoids evaluating individuals with low estimated fitness. We adapt estimation-based elimination strategy for state-of-the-art NE algorithms: CMA-NeuroES and CMA-TWEANN. From the experimental results of pole-balancing benchmark tasks, we show that the proposed strategy improves sample efficiency of the NE algorithms.
AB - In this paper, we propose estimation-based elimination strategy, which improves sample efficiency of NeuroEvolution (NE) algorithms. The fitness of new individuals was estimated using fitness of individuals evaluated in the past generations. The estimation was achieved by taking average fitness of individuals with high correlation with the new individual. Estimation-based elimination strategy avoids evaluating individuals with low estimated fitness. We adapt estimation-based elimination strategy for state-of-the-art NE algorithms: CMA-NeuroES and CMA-TWEANN. From the experimental results of pole-balancing benchmark tasks, we show that the proposed strategy improves sample efficiency of the NE algorithms.
KW - Evolutionaly computation
KW - Fitness estimation
KW - Neuroevolution
UR - http://www.scopus.com/inward/record.url?scp=84911375599&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84911375599&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84911375599
T3 - 13th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2014
SP - 1537
EP - 1538
BT - 13th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2014
PB - International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)
T2 - 13th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2014
Y2 - 5 May 2014 through 9 May 2014
ER -