关键词: 交通信号, 交叉口, 协调机制, 强化学习

Abstract: Aiming at the problem of dimensionality curse and the lack of coordination mechanism in the urban adaptive traffic signal timing decision using traditional reinforcement learning, a reinforcement learning algorithm with interaction coordination mechanism is proposed. An independent Q-reinforcement learning algorithm for the urban traffic signal timing decision is designed with the vehicle delay as the performance index. On this basis, the independent Q-reinforcement learning algorithm is extended by introducing interaction coordination mechanism. That is to say, the intersection traffic signal control agent directly exchanges actions and interaction values with the adjacent ones. Simulation results show that the proposed method substantially outperforms the independent reinforcement learning algorithm with more efficient coordination and better convergence performance.

Key words: traffic signal, intersection, coordination mechanism, reinforcement learning