Optimal Strategy of Differential Game Pursuit Problem in Graph Attention Network

doi:10.3778/j.issn.1002-8331.2201-0148

Abstract

Abstract: The optimal strategy for the pursuit of fugitives in differential game is based on the trajectory prediction model of the pursuit of fugitives, and the prediction is made through the trajectory of both parties, so as to make a more predictable dynamic strategy.?Therefore, in order to obtain the optimal strategy of both sides in the game, the algorithm of random motion of both sides is proposed and designed, and the state equation of chasing both sides is established. On this basis, the adjacency matrix and the connection mode of feature data in the network are redesigned by improving the graph attention network（GAT）.?The trajectory prediction model of attacker and target is constructed and verified numerically.?In addition, the method of covering the trajectories of random motion by ring is used to establish the trajectory connection graph.??The results show that GAT network is superior to graph convolution network and Chebshev spectrum convolution network in MAE, MAPE and RMSE, and can be used to study the optimal strategy of differential game pursuit problem.

Key words: differential countermeasures, pursuit problem, graph attention network（GAT） network, entropy weight method

摘要： 微分博弈追逃问题的最优策略，是建立在追逃双方的轨迹预测模型基础上，通过双方轨迹进行预判，从而做出更有预见性的动态策略。因此为了获得博弈双方最优策略，提出并设计双方随机运动算法，建立了追逃双方的状态方程，并在此基础上通过改进图注意力网络（graph attention network，GAT），对其网络中邻接矩阵和特征数据连接方式进行重新设计，构建了攻击方与目标方轨迹预测模型并进行数值验证。此外采用将双方随机运动的轨迹由圆环覆盖的方法，建立轨迹连接图。结果表明，GAT网络在MAE、MAPE、RMSE等预测指标上均优于图卷积网络和契比雪夫频谱卷积网络，可用于微分博弈追逃问题的最优策略研究。

关键词: 微分对策, 追逃问题, 图注意力网络, 熵权法

LIU Zhaolong, SONG Yao, XU Yiming, FAN Xinyue. Optimal Strategy of Differential Game Pursuit Problem in Graph Attention Network[J]. Computer Engineering and Applications, 2023, 59(9): 313-318.

刘肇隆, 宋耀, 徐翊铭, 范馨月. 图注意力网络的微分博弈追逃问题最优策略[J]. 计算机工程与应用, 2023, 59(9): 313-318.

References

[1] HUANG C Q，DONG K S，HUANG H Q，et al.Autonomous air combat maneuver decision using Bayesian inferenceand moving horizon optimization[J].Journal of Systems Engineering and Electronics，2018，29（1）：86-97.
[2] 孙楚，赵辉，王渊，等.基于强化学习的无人机自主机动决策方法[J].火力与指挥控制，2019，44（4）：142-149．
SUN C，ZHAO H，WANG Y，et al.UCAV autonomic maneuver decision-making method based on reinforcement learning[J].Fire Control & Command Control，2019，44（4）：142-149.
[3] 杜海文，崔明朗，韩统，等.基于多目标优化与强化学习的空战机动决策[J].北京航空航天大学学报，2018，44（11）：2247-2256.
DU H W，CUI M L，HAN T，et al.Maneuvering decision in air combat based on multi-objective optimization and reinforcement learning[J].Journal of Beijing University of Aeronautics and Astronautics，2018，44（11）：2247-2256.
[4] 李世豪，丁勇，高振龙.基于直觉模糊博弈的无人机空战机动决策[J].系统工程与电子技术，2019，41（5）：1063-1070．
LI S H，DING Y，GAO Z L.UAV air combat maneuvering decision based on intuitionistic fuzzy game theory[J].Systems Engineering and Electronics，2019，41（5）：1063-1070.
[5] 李龙跃，刘付显，史向峰，等.导弹追逃博弈微分对策建模与求解[J].系统工程理论与实践，2016，36（8）：2161-2168.
LI L Y，LIU F X，SHI X F，et al.Differential game model and solving method for missile pursuit-evasion[J].Systems Engineering-Theory & Practice，2016，36（8）：2161-2168.
[6] 刘冰雁，叶雄兵，高勇，等.基于分支深度强化学习的非合作目标追逃博弈策略求解[J].航空学报，2020，41（10）：348-358.
LIU B Y，YE X B，GAO Y，et al.Strategy solution of non-cooperative target pursuit-evasion game based on branching deep reinforcement learing[J].Acta Aeronautica et Astronautica Sinica，2020，41（10）：348-358.
[7] 苏义鑫，石兵华，张华军，等.水面无人艇的抗追捕-逃跑策略[J].哈尔滨工程大学学报，2018，39（6）：1019-1025.
SU Y X，SHI B H，ZHANG H J，et al.Anti-pursuit evasion strategy of an unmanned surface vehicle[J].Journal of Harbin Engineering University，2018，39（6）：1019-1025.
[8] GOODFELLOW I，POUGET-ABADIE J，MIRZA M，et al.Generative adversarial nets[C]//Neural Information Processing Systems，2014.
[9] 范红旗，王胜，付强.离散时间二人随机微分对策问题信息模式的数学描述[J].电子学报，2010，38（6）：1355-1361.
FAN H Q，WANG S，FU Q.Mathematical description for information pattern of discrete-time two-person stochastic differential games[J].Acta Electronica Sinica，2010，38（6）：1355-1361.
[10] 张宏鹏，黄长强，唐上钦，等.基于卷积神经网络的无人作战飞机飞行轨迹实时预测[J].兵工学报，2020，41（9）：1894-1903.
ZHANG H P，HUANG C Q，TANG S Q，et al.CNN-based real-time prediction method of flight trajectory of unmanned combat aerial vehicle[J].Acta Armamentarii，2020，41（9）：1894-1903.
[11] 孙庆辉，移动轨迹目的地预测算法研究[D].广州：华南理工大学，2020.
SUN Q H.Research on trajectory destination prediction algorithm[D].Guangzhou：South China University of Technology，2020.
[12] 刘欢.基于深度学习的轨迹预测方法研究[D].西安：长安大学，2020.
LIU H.Research on trajectory prediction based on deep learning[D].Xi’an：Chang’an University，2020.
[13] LEFFERTS E J，MARKLEY F L，MALCOLM D S.Kalman filte ring for spacecraft attitude estimation[J].Journal of Guidance Control and Dynamics，1982，5（5）：417-429.
[14] KIPF T N，WELLING M.Semi-supervised classification with graph convolutional networks[J].arXiv：1609.02907，2016.
[15] DEFFERRARD M，BRESSON X，VANDERGHEYNST P.Convolutional neural networks on graphs with fast localized spectral filtering[C]//30th Conference on Neural Information Processing Systems，2016.
[16] VELIKOVI P，CUCURULL G，CASANOVA A，et al.Graph attention networks[C]//International Conference on Learning Representations，2018.