计算机工程与应用 ›› 2021, Vol. 57 ›› Issue (2): 49-59.DOI: 10.3778/j.issn.1002-8331.2008-0431

• 热点与综述 • 上一篇    下一篇

深度强化学习在智能制造中的应用展望综述

孔松涛,刘池池,史勇,谢义,王堃   

  1. 重庆科技学院 机械与动力工程学院,重庆 401331
  • 出版日期:2021-01-15 发布日期:2021-01-14

Review of Application Prospect of Deep Reinforcement Learning in Intelligent Manufacturing

KONG Songtao, LIU Chichi, SHI Yong, XIE Yi, WANG Kun   

  1. School of Mechanical and Power Engineering, Chongqing University of Science and Technology, Chongqing 401331, China
  • Online:2021-01-15 Published:2021-01-14

摘要:

深度强化学习作为机器学习发展的最新成果,已经在很多应用领域崭露头角。关于深度强化学习的算法研究和应用研究,产生了很多经典的算法和典型应用领域。深度强化学习应用在智能制造中,能在复杂环境中实现高水平控制。对深度强化学习的研究进行概述,对深度强化学习基本原理进行介绍,包括深度学习和强化学习。介绍深度强化学习算法应用的理论方法,在此基础对深度强化学习的算法进行了分类介绍,分别介绍了基于值函数和基于策略梯度的强化学习算法,列举了这两类算法的主要发展成果,以及其他相关研究成果。对深度强化学习在智能制造的典型应用进行分类分析。对深度强化学习存在的问题和未来发展方向进行了讨论。

关键词: 人工智能, 深度强化学习, 深度学习, 强化学习, 智能控制, 智能制造

Abstract:

As the latest development of machine learning, deep reinforcement learning has been shown in many application fields. The algorithm research and application research of deep reinforcement learning have produced many classical algorithms and typical application fields. The application of deep reinforcement learning in industrial manufacturing can realize high level control in complex environment. First of all, the research on deep reinforcement learning is summarized, and the basic principles of deep reinforcement learning are introduced, including deep learning and reinforcement learning. Then, the paper introduces the theoretical methods of the application of deep reinforcement learning algorithm. On this basis, it classifies the algorithms of deep reinforcement learning, respectively introduces the reinforcement learning algorithm based on value function and the reinforcement learning algorithm based on strategy gradient, and lists the main development results of these two kinds of algorithms, as well as other related research results. Then, the typical applications of deep reinforcement learning in industrial manufacturing are classified and analyzed. Finally, the existing problems and future development direction of deep reinforcement learning are discussed.

Key words: artificial intelligence, deep reinforcement learning, deep learning, reinforcement learning, intelligent control, intelligent manufacturing