计算机工程与应用 ›› 2017, Vol. 53 ›› Issue (2): 151-156.DOI: 10.3778/j.issn.1002-8331.1503-0245

• 模式识别与人工智能 • 上一篇    下一篇

部分可观环境中AUV软件自修复模型研究

张汝波1,2,孟  雷1,史长亭1   

  1. 1.哈尔滨工程大学 计算机科学与技术学院,哈尔滨 150001
    2.大连民族大学 机电信息工程学院,辽宁 大连 116600
  • 出版日期:2017-01-15 发布日期:2017-05-11

Research on self-repair model for AUV software in partially observable environment

ZHANG Rubo1,2, MENG Lei1, SHI Changting1   

  1. 1.College of Computer Science and Technology, Harbin Engineering University, Harbin 150001, China
    2.College of Electromechanical and Information Engineering, Dalian Nationalities University, Dalian, Liaoning 116600, China
  • Online:2017-01-15 Published:2017-05-11

摘要: 针对AUV软件在部分可观环境中的故障修复问题,依据部分可观马尔科夫决策过程理论,提出基于POMDP模型和微重启技术的AUV软件故障修复方法。根据AUV 分层结构特点设计了多层次的微重启修复方法,构建了AUV软件自修复POMDP模型,同时采用基于点的值迭代算法求解生成修复策略使系统在部分可观环境下能够以较低的修复代价执行修复动作。仿真实验验证了算法有效性和模型适用性。

关键词: 智能水下机器人, 微重启技术, 自修复, 部分可观马尔科夫决策过程(POMDP), 基于点的值迭代(PBVI)

Abstract:  According to the AUV software fault repair problem in partially observable environment, a method based on Partially Observable Markov Decision Process(POMDP) model and micro-reboot mechanism for solving failure repair of AUV is presented. AUV software self-repairing POMDP model is established based on the characteristics of AUV hierarchical structure while can design multi-level micro-reboot repair method. With the help of repair strategy which based on the algorithm of Point Based Value Iteration(PBVI), the system can implement the repair at lower repair cost in the partially observable environment. Results of experiment prove the validity of algorithm and the applicability of the model.

Key words: Autonomos Underwater Vehicle(AUV), micro-reboot, self-repair, Paritally Observable Markov Decision Process(POMDP), Point Based Value Iteration(PBVI)