Urban traffic control based on SA-FQL

doi:10.3778/j.issn.1002-8331.2010.27.065

Computer Engineering and Applications ›› 2010, Vol. 46 ›› Issue (27): 231-233.DOI: 10.3778/j.issn.1002-8331.2010.27.065

• 工程与应用 • Previous Articles Next Articles

Urban traffic control based on SA-FQL

DENG Jun，LIU Zhi-yong

School of Information，Wuyi University，Jiangmen，Guangdong 529020，China

Received:2009-01-13 Revised:2009-03-20 Online:2010-09-21 Published:2010-09-21
Contact: DENG Jun

基于SA-FQL算法的区域交通控制方法

邓军，刘智勇

五邑大学信息学院，广东江门 529020

通讯作者: 邓军

Abstract

Abstract: For area traffic control，the Simulated Annealing Fuzzy Q-Learning（SA-FQL），a modified version of the popular Fuzzy Q-Learning，is used.Firstly，this paper optimizes the common cycle of the traffic network using SA-FQL，then optimizes offset for every trunk road using the same method based on the common cycle，lastly adjusts split for every intersection according its traffic volume.TSIS simulation results show that，compared with Fuzzy Q-Learning method and Q-Learning method，the method proposed in this paper can significantly accelerate learning and improve traffic efficiency.

Key words: area traffic control, Simulated Annealing Fuzzy Q-Learning（SA-FQL）, fuzzy Q-learning, Q-learning, Metropolis criterion

摘要： 将模拟退火算法的Metropolis准则用于平衡模糊Q学习中探索和扩张之间的关系，提出基于Metropolis准则的模糊Q学习算法Simulated Annealing Fuzzy Q-learning（SA-FQL）。利用SA-FQL算法优化区域的公共周期，在给定周期的基础上再用SA-FQL算法优化区域中各干线相邻两路口的相位差，最后根据交通流量确定各路口的绿信比。TSIS仿真结果表明，相比基于Q学习和模糊Q学习的控制方法，该方法能显著提高学习速度和交通效率。

关键词: 区域交通控制, 模拟退火模糊Q学习算法, 模糊Q学习, Q学习, Metropolis准则

CLC Number:

TP391

DENG Jun，LIU Zhi-yong.

Urban traffic control based on SA-FQL

[J]. Computer Engineering and Applications, 2010, 46(27): 231-233.

邓军，刘智勇. 基于SA-FQL算法的区域交通控制方法[J]. 计算机工程与应用, 2010, 46(27): 231-233.

[1]	ZHANG Junjie, ZHANG Cong, ZHAO Hanjie. Dueling Deep Q Network Algorithm with State Value Reuse [J]. Computer Engineering and Applications, 2021, 57(4): 134-140.
[2]	HAN Daoqi, ZHANG Junyao, ZHOU Yuhang, LIU Qing. Research on Intelligent Trader Model Based on Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2020, 56(21): 145-153.
[3]	WANG Mengjiao, YIN Xiang, HUANG Ningxin. Multitask Assignment Algorithm Based on Transfer Learning [J]. Computer Engineering and Applications, 2020, 56(13): 150-155.
[4]	CHEN Xiaoqian, LIU Ruixiang. Route Planning Method Based on Least-Squares Policy Iteration for Unmanned Aerial Vehicle [J]. Computer Engineering and Applications, 2020, 56(1): 191-195.
[5]	HU Lingyao1，2，3, CHEN Jianping1，2，3, FU Qiming1，2，3，4, HU Wen1，2，3, NI Qingwen1，2，3. Building energy efficiency oriented reinforcement learning adaptive control method [J]. Computer Engineering and Applications, 2017, 53(21): 239-246.
[6]	XU Xinlin, HU Zhongbo, HE Xianping, SU Qinghua. Improved backtracking search optimization algorithm with self-adaptable mutation scale factor and hybrid selection strategy [J]. Computer Engineering and Applications, 2017, 53(17): 6-13.
[7]	LIU Xiaowei1, GAO Chunming2. Optimization of agent behavior decision in UT2004 combined with behavior tree and Q-learning algorithm [J]. Computer Engineering and Applications, 2016, 52(3): 113-118.
[8]	ZHANG Xiaofang1, XIE Jun2. Research on optimization model and power strategy of controllable household appliances’ loads [J]. Computer Engineering and Applications, 2016, 52(24): 246-250.
[9]	GE Jun1, ZHOU Lianying2. Two-layer hierarchical control solutions for traffic signal [J]. Computer Engineering and Applications, 2015, 51(20): 246-252.
[10]	ZHAO Fajun, LI Longshu. RoboCup regional cooperative strategy based on multi-Agent Q-learning [J]. Computer Engineering and Applications, 2014, 50(23): 127-130.
[11]	SHENG Xinyi1, SUN Jun2, ZHOU Di1, XU Wenbo2. Quantum-behaved particle swarm optimization method based on Q-learning [J]. Computer Engineering and Applications, 2014, 50(21): 8-13.
[12]	LI Tong1, MAO Li1, WU Bin1, YANG Hong2, XIAO Wei2. Improved particle swarm optimization based on campaign leader strategy [J]. Computer Engineering and Applications, 2014, 50(20): 36-40.
[13]	ZHANG Huilong, LI Longshu. Application of Q-Learning in local attacking decision [J]. Computer Engineering and Applications, 2013, 49(7): 240-242.
[14]	LIU Zhiyong1，2，SONG Zhengdong2. Chaotic fuzzy Q-learning control for urban area traffic signals [J]. Computer Engineering and Applications, 2012, 48(4): 207-210.
[15]	WANG Haizhen1, LIAN Zuozheng2, TENG Yanping1. Research on multi-Agent fuzzy Q-learning in intelligent office environment [J]. Computer Engineering and Applications, 2012, 48(18): 231-235.

Urban traffic control based on SA-FQL

基于SA-FQL算法的区域交通控制方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics