Multi-agents reinforcement learning for symmetrical coordination

doi:10.3778/j.issn.1002-8331.2008.36.067

Computer Engineering and Applications ›› 2008, Vol. 44 ›› Issue (36): 230-233.DOI: 10.3778/j.issn.1002-8331.2008.36.067

• 工程与应用 • Previous Articles Next Articles

Multi-agents reinforcement learning for symmetrical coordination

WANG Yun,HAN Wei

Information and Engineering College，Nanjing University of Finance and Economics，Nanjing 210046，China

Received:2008-06-17 Revised:2008-10-21 Online:2008-12-21 Published:2008-12-21
Contact: WANG Yun

对称协调博弈问题的多智能体强化学习

王云,韩伟

南京财经大学信息工程学院，南京 210046

通讯作者: 王云

Abstract

Abstract: Considering the problem of robots coordination games，the paper puts forward an agents’ belief revision model and a learning algorithm Position-Exchanging Learning（PEL） which is based on the similarity of agents’ strategies in coordination games.By position-exchanging，each agent stands from the viewpoint of its opponent and infers opponents’ actions.The belief revision model combines the objective observed actions and subjective inferred actions.Coordination is assured by adjusting the belief degree to be 0 or 1.The algorithm PEL is tested in simulations that robots coordinate to avoid collision，and the results prove it performs better than present methods.

Key words: Multi-Agents System（MAS）, reinforcement learning, coordination games

摘要： 针对多机器人协调问题，利用协调博弈中智能体策略相似性，提出智能体的高阶信念修正模型和学习方法PEL，使智能体站在对手角度进行换位推理，进而根据信念修正将客观观察行为和主观信念推理结合起来。证明了信念修正模型的推理置信度只在0和1两个值上调整即可协调成功。以多机器人避碰为实验背景进行仿真，表明算法比现有方法能够取得更好的协调性能。

关键词: 多智能体系统, 强化学习, 协调博弈

WANG Yun,HAN Wei. Multi-agents reinforcement learning for symmetrical coordination[J]. Computer Engineering and Applications, 2008, 44(36): 230-233.

王云,韩伟. 对称协调博弈问题的多智能体强化学习[J]. 计算机工程与应用, 2008, 44(36): 230-233.

[1]	WANG Xiao, TANG Lun, HE Xiaoyu, CHEN Qianbin. Multi-dimensional Resource Optimization of Service Function Chain Based on Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(4): 68-76.
[2]	LAI Jun, WEI Jingyi, CHEN Xiliang. Overview of Hierarchical Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(3): 72-79.
[3]	MA Zhihao, ZHU Xiangbin. Research on Quasi-hyperbolic Momentum Gradient for Adversarial Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(24): 90-99.
[4]	LI Baoshuai, YE Chunming. Job Shop Scheduling Problem Based on Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(23): 248-254.
[5]	WANG Jun, CAO Lei, CHEN Xiliang, LAI Jun, ZHANG Legui. Overview on Reinforcement Learning of Multi-agent Game [J]. Computer Engineering and Applications, 2021, 57(21): 1-13.
[6]	CHENG Yi, HAO Mimi. Path Planning for Indoor Mobile Robot with Improved Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(21): 256-262.
[7]	KUANG Liqun, LI Siyuan, FENG Li, HAN Xie, XU Qingyu. Application of Deep Reinforcement Learning Algorithm on Intelligent Military Decision System [J]. Computer Engineering and Applications, 2021, 57(20): 271-278.
[8]	KONG Songtao, LIU Chichi, SHI Yong, XIE Yi, WANG Kun. Review of Application Prospect of Deep Reinforcement Learning in Intelligent Manufacturing [J]. Computer Engineering and Applications, 2021, 57(2): 49-59.
[9]	LI Hao, NING Haoyu, KANG Yan, LIANG Wentao, HUO Wen. SMRFGAN Model for Text Emotion Transfer [J]. Computer Engineering and Applications, 2021, 57(2): 170-176.
[10]	ZHANG Rongxia, WU Changxu, SUN Tongchao, ZHAO Zengshun. Progress on Deep Reinforcement Learning in Path Planning [J]. Computer Engineering and Applications, 2021, 57(19): 44-56.
[11]	YANG Xueyu, CHEN Jianping, FU Qiming, LU You, WU Hongjie. Deep Deterministic Policy Gradient Algorithm Based on Stochastic Variance Reduction Method [J]. Computer Engineering and Applications, 2021, 57(19): 104-111.
[12]	SONG Haonan, ZHAO Gang, WANG Xingfen. Knowledge Reasoning Method Combining Knowledge Representation with Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(19): 189-197.
[13]	WANG Keyin, SHI Zhen, YANG Zhengcai, YANG Yahui, WANG Sishan. Path Planning for Mobile Robot Using Improved Reinforcement Learning Algorithm [J]. Computer Engineering and Applications, 2021, 57(18): 270-274.
[14]	ZHANG Jun, ZHU Qingwei, YAN Junjie, WEN Bo. UAV Indoor 3D Track Planning Based on Improved Reinforcement Learning Algorithm [J]. Computer Engineering and Applications, 2021, 57(16): 175-181.
[15]	CHE Xiangbei, KANG Wenqian, OUYANG Yuhong, YANG Kehan, LI Jian. SDN Routing Optimization Algorithm Based on Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(12): 93-98.

Multi-agents reinforcement learning for symmetrical coordination

对称协调博弈问题的多智能体强化学习

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics