关键词: 多Agent系统, 递阶控制, 交通信号, Q-学习, Tile Coding

Abstract: In view of the existing deficiencies of traffic signal control system, this paper proposes two-layer hierarchical multi-Agent system solution for traffic signal control. Through regional division of the traffic network, it uses the bottom level Agent to control the intersection, the top level Agent to control areas, so as to achieve the two-layer hierarchical control. The bottom level Agent uses the classical Q-learning to synchronize the optimal strategy, the top level Agent utilizes the special continuous space processing ability of Tile Coding to achieve Q learning of action value function approximation method. The simulation test results show that, the hierarchical control not only improves the efficiency of traffic signal control system, but also provides a good scalable solution for large-scale applications.

Key words: multi-Agent systems, hierarchical control, traffic signals, Q-learning, Tile Coding