计算机工程与应用 ›› 2009, Vol. 45 ›› Issue (21): 21-24.DOI: 10.3778/j.issn.1002-8331.2009.21.05

• 博士论坛 • 上一篇    下一篇

基于场景任务划分的多智能体Q-学习研究

刘 亮,李龙澍   

  1. 安徽大学 计算智能与信号处理教育部重点实验室,合肥 230039
  • 收稿日期:2009-04-08 修回日期:2009-05-14 出版日期:2009-07-21 发布日期:2009-07-21
  • 通讯作者: 刘 亮

Multi-agent Q-learning based on mission scenarios division

LIU Liang,LI Long-shu   

  1. Key Lab of IC&SP at Anhui University,Ministry of Education,Hefei 230039,China
  • Received:2009-04-08 Revised:2009-05-14 Online:2009-07-21 Published:2009-07-21
  • Contact: LIU Liang

摘要: 从研究分层强化学习入手,提出由MAS中任务结构分析产生的分层合作研究方法,通过区分子任务并以此建立更大粒度层面上的基于任务场景的状态空间,并结合以联合动作为基础的任务动作与势能场模型,从而解决强化学习中的状态空间的维数灾难。文中给出了基于机器人足球的子任务的算法应用,其效能得到实验的验证。

关键词: 多Agent系统, 强化学习, Q-学习, 任务场景

Abstract: From the study of layered reinforcement learning approach,this paper proposes layered collaboration research methods through the mission structure analysis in MAS.By distinguishing the sub-mission,the state space is built,which is in greater level of granularity and based on the mission effect,combining with the mission action based on joint action and potential field model so as to solve the dimensional disaster in state space of reinforcement learning.This paper provides application of the algorithm based on a subset of mission in robot soccer and its effectiveness is validated by experiments.

Key words: Multi-Agent System(MAS), reinforcement learning, Q-learning, mission scenarios