计算机工程与应用 ›› 2014, Vol. 50 ›› Issue (23): 127-130.

• 数据库、数据挖掘、机器学习 • 上一篇    下一篇

基于多Agent Q学习的RoboCup局部配合策略

赵发君,李龙澍   

  1. 安徽大学 计算机科学与技术学院,合肥 230601
  • 出版日期:2014-12-01 发布日期:2014-12-12

RoboCup regional cooperative strategy based on multi-Agent Q-learning

ZHAO Fajun, LI Longshu   

  1. School of Computer Science and Engineering, Anhui University, Hefei 230601, China
  • Online:2014-12-01 Published:2014-12-12

摘要: 针对RoboCup(Robot World Cup)中,多Agent之间的配合策略问题,采用了一种局部合作的多Agent Q-学习方法:通过细分球场区域和Agent回报值的方法,加强了Agent之间的协作能力,从而增强了队伍的进攻和防守能力。同时通过约束此算法的使用范围,减少了学习所用的时间,确保了比赛的实时性。最后在仿真2D平台上进行的实验证明,该方法比以前的效果更好,完全符合初期的设计目标。

关键词: 随机对策, Q-学习, 实时性, 局部合作, RoboCup仿真2D, 配合策略

Abstract: Because many multi-Agent cooperative problems can hardly be solved in RoboCup, this paper investigates a regional cooperative multi-Agent Q-learning method. Through subdividing the stadium area and rewards of agents, the agents’ collaboration ability can be strengthened. As a result, the team’s offensive and defensive abilities are enhanced. At the same time, the agents can spend less time learning via restricting the using range of the algorithm. Consequently, the real-time of the game can be ensured. Finally, the experiment on the platform of the simulation 2D proves that the effect of this method is much better than that of the previous one, and it fully complies with the design of the original goal.

Key words: stochastic game, Q-learning, real-time, regional cooperation, RoboCup simulation 2D, cooperative strategy