Computer Engineering and Applications ›› 2021, Vol. 57 ›› Issue (20): 64-72.DOI: 10.3778/j.issn.1002-8331.2105-0135

Previous Articles     Next Articles

Review of Attention Mechanism in Convolutional Neural Networks

ZHANG Chenjia, ZHU Lei, YU Lu   

  1. School of Communication Engineering, Army Engineering University of PLA, Nanjing 210007, China
  • Online:2021-10-15 Published:2021-10-21



  1. 陆军工程大学 通信工程学院,南京 210007


Attention mechanism is widely used in deep learning tasks because of its excellent effect and plug and play convenience. This paper mainly focuses on convolution neural network, introduces various mainstream methods in the development process of convolution network attention mechanism, extracts and summarizes its core idea and implementation process, realizes each attention mechanism method, and makes comparative experiments and results analysis on the measured data of the same type of emitter equipment. According to the main ideas and experimental results, the research status and future development direction of attention mechanism in convolutional networks are summarized.

Key words: attention mechanism, convolutional neural network, development direction



关键词: 注意力机制, 卷积神经网络, 发展方向