关键词: 状态值重利用, 竞争深度Q学习网络, 反距离加权法, 超参数搜索

Abstract:

When using the Inverse Distance Weighted method（IDW） to predict the content of heavy metals in soil, the super parameters in the algorithm are generally determined by prior knowledge, and there is uncertainty to a certain extent. In order to solve this problem, a dueling deep Q-learning network algorithm for reusing state values is proposed to accurately estimate the hyper-parameters of IDW. In the training process, the reward value of each training sample is standardized and combined with the state value of Q network in Dueling-DQN to form a new total reward value, and then the total reward value is input into the Q network for learning, so as to enhance the internal relationship between state and action and make the algorithm more stable. Finally, this method is used to perform hyper-parameter search on the IDW, and compare experiments with several common deep learning algorithms. Experimental results show that the proposed RSV-DuDQN algorithm can make the model converge faster, improve the stability of the model, and get more accurate IDW parameter estimation.

Key words: reuse of state values, dueling deep Q-learning network, Inverse Distance Weighted method（IDW）, hyper-parameter search