TY - GEN
T1 - A study of applying genetic network programming with reinforcement learning to elevator group supervisory control system
AU - Zhou, Jin
AU - Eguchi, Toru
AU - Mabu, Shingo
AU - Hirasawa, Kotaro
AU - Hu, Jinglu
AU - Markon, Sandor
PY - 2006/12/1
Y1 - 2006/12/1
N2 - Elevator Group Supervisory Control System (EGSCS) is a very large scale stochastic dynamic optimization problem. Due to its vast state space, significant uncertainty, and numerous resource constraints such as finite car capacities and registered hall/car calls, it is hard to manage EGSCS using conventional control methods. Recently, many solutions for EGSCS using Artificial Intelligence (AI) technologies have been reported. Genetic Network Programming (GNP), which is proposed as a new evolutionary computation method several years ago, is also proved to be efficient when applied to EGSCS problem. In this paper, we propose an extended algorithm for EGSCS by introducing Reinforcement Learning (RL) into GNP framework, and expect to make an improvement of the EGSCS' performances since the efficiency of GNP with RL has been clarified in some other studies like tile-world problem. Simulation tests using traffic flows in a typical office building have been made, and the results show an actual improvement of the EGSCS' performances comparing to the algorithms using original GNP and conventional control methods.
AB - Elevator Group Supervisory Control System (EGSCS) is a very large scale stochastic dynamic optimization problem. Due to its vast state space, significant uncertainty, and numerous resource constraints such as finite car capacities and registered hall/car calls, it is hard to manage EGSCS using conventional control methods. Recently, many solutions for EGSCS using Artificial Intelligence (AI) technologies have been reported. Genetic Network Programming (GNP), which is proposed as a new evolutionary computation method several years ago, is also proved to be efficient when applied to EGSCS problem. In this paper, we propose an extended algorithm for EGSCS by introducing Reinforcement Learning (RL) into GNP framework, and expect to make an improvement of the EGSCS' performances since the efficiency of GNP with RL has been clarified in some other studies like tile-world problem. Simulation tests using traffic flows in a typical office building have been made, and the results show an actual improvement of the EGSCS' performances comparing to the algorithms using original GNP and conventional control methods.
UR - http://www.scopus.com/inward/record.url?scp=34547247623&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34547247623&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:34547247623
SN - 0780394879
SN - 9780780394872
T3 - 2006 IEEE Congress on Evolutionary Computation, CEC 2006
SP - 3035
EP - 3041
BT - 2006 IEEE Congress on Evolutionary Computation, CEC 2006
T2 - 2006 IEEE Congress on Evolutionary Computation, CEC 2006
Y2 - 16 July 2006 through 21 July 2006
ER -