Instance based approximate solution to POMDP problem

doi:10.3778/j.issn.1002-8331.2008.29.022

Computer Engineering and Applications ›› 2008, Vol. 44 ›› Issue (29): 82-85.DOI: 10.3778/j.issn.1002-8331.2008.29.022

• 理论研究 • Previous Articles Next Articles

Instance based approximate solution to POMDP problem

XIU Guo-ming,ZHANG Ji-bin,PAN Qi-shu

School of Computer Science and Technology，Harbin Institute of Technology，Harbin 150001，China

Received:2007-11-06 Revised:2008-02-26 Online:2008-10-11 Published:2008-10-11
Contact: XIU Guo-ming

基于实例的POMDP问题的近似求解

修国明,张积滨,潘启树

哈尔滨工业大学计算机科学与技术学院，哈尔滨 150001

通讯作者: 修国明

Abstract

Abstract: In this paper，with the idea of combining heuristic solution and reinforcement learning technique，the instance based approximate solution to POMDP problem is studied and Nearest Neighbor based algorithm NNI and its extended parameterized version ENNI and Local Weighted Regression based algorithm LWI are presented.With the performance analyzed and compared through experiments on common workbench，solving POMDP problems using instance based methods can produce good sub-optimal solutions.

Key words: instance based method, Partially Observable Markov Decision Process（POMDP）, heuristic solution, reinforcement learning, nearest neighbor, local weighted regression

摘要： 结合启发式求解和增强学习技术，深入研究了基于实例的POMDP问题的近似求解算法，包括基于最近邻算法法的NNI及它的参数化增强版本ENNI和基于局部加权回归算法的LWI，并通过实验对比，给出了相应算法在实际应用中的性能。实验证明，基于实例的方法来求解POMDP问题，能够获得性能较好的次优解。

关键词: 基于实例的方法, 部分可观察马尔可夫决策过程（POMDP）, 启发式求解, 增强学习, 最近邻, 局部加权回归

XIU Guo-ming,ZHANG Ji-bin,PAN Qi-shu. Instance based approximate solution to POMDP problem[J]. Computer Engineering and Applications, 2008, 44(29): 82-85.

修国明,张积滨,潘启树. 基于实例的POMDP问题的近似求解[J]. 计算机工程与应用, 2008, 44(29): 82-85.

[1]	LAN Hong, HUANG Min. Fusion of KNN Optimized Density Peaks and FCM Clustering Algorithm [J]. Computer Engineering and Applications, 2021, 57(9): 81-88.
[2]	LEI Henglin, Gulanbaier Tuerhong, Mairidan Wushouer, ZHANG Dongmei. Review of Novelty Detection [J]. Computer Engineering and Applications, 2021, 57(5): 47-55.
[3]	WANG Xiao, TANG Lun, HE Xiaoyu, CHEN Qianbin. Multi-dimensional Resource Optimization of Service Function Chain Based on Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(4): 68-76.
[4]	LAI Jun, WEI Jingyi, CHEN Xiliang. Overview of Hierarchical Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(3): 72-79.
[5]	MA Zhihao, ZHU Xiangbin. Research on Quasi-hyperbolic Momentum Gradient for Adversarial Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(24): 90-99.
[6]	LI Baoshuai, YE Chunming. Job Shop Scheduling Problem Based on Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(23): 248-254.
[7]	WANG Le, HAN Meng, LI Xiaojuan, ZHANG Ni, CHENG Haodong. Review of Classification Methods for Unbalanced Data Sets [J]. Computer Engineering and Applications, 2021, 57(22): 42-52.
[8]	CHENG Yi, HAO Mimi. Path Planning for Indoor Mobile Robot with Improved Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(21): 256-262.
[9]	WANG Jun, CAO Lei, CHEN Xiliang, LAI Jun, ZHANG Legui. Overview on Reinforcement Learning of Multi-agent Game [J]. Computer Engineering and Applications, 2021, 57(21): 1-13.
[10]	CHEN Qianru, LI Yali, XU Kequan, LIU Yilong, WANG Shuqin. WKNN Feature Selection Method Based on Self-Tuning Adaptive Genetic Algorithm [J]. Computer Engineering and Applications, 2021, 57(20): 164-171.
[11]	KUANG Liqun, LI Siyuan, FENG Li, HAN Xie, XU Qingyu. Application of Deep Reinforcement Learning Algorithm on Intelligent Military Decision System [J]. Computer Engineering and Applications, 2021, 57(20): 271-278.
[12]	KONG Songtao, LIU Chichi, SHI Yong, XIE Yi, WANG Kun. Review of Application Prospect of Deep Reinforcement Learning in Intelligent Manufacturing [J]. Computer Engineering and Applications, 2021, 57(2): 49-59.
[13]	MENG Dongxia，LI Yujian. Oversampling Method for Unbalanced Data by Natural Nearest Neighbor [J]. Computer Engineering and Applications, 2021, 57(2): 91-96.
[14]	LI Hao, NING Haoyu, KANG Yan, LIANG Wentao, HUO Wen. SMRFGAN Model for Text Emotion Transfer [J]. Computer Engineering and Applications, 2021, 57(2): 170-176.
[15]	ZHANG Rongxia, WU Changxu, SUN Tongchao, ZHAO Zengshun. Progress on Deep Reinforcement Learning in Path Planning [J]. Computer Engineering and Applications, 2021, 57(19): 44-56.

Instance based approximate solution to POMDP problem

基于实例的POMDP问题的近似求解

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics