关键词: 深度神经网络, 计算机视觉, 图像描述, 编码器-解码器架构, 注意力机制

Abstract:

With the rapid development of deep learning, the quality of image caption is significantly improved. This paper mainly reviews the methods of image caption based on deep neural network and its research status in detail. Image caption algorithm combines the knowledge of computer vision and natural language processing togenerate natural language descriptions based on the content detected in the image automatically, which is an important part of scene understanding. Generally, the basic architecture of image caption task is composed of encoder and decoder. Improving encoders or decoders, applying methods of Generative Adversarial Networks（GAN）. Reinforcement Learning（RL）, Unsupervised Learning（UL） and Graph Convolution Neural Network（GCN） can effectively improve the performance of image caption algorithm. Afterward, the effect, advantages and disadvantages of each representative model algorithm are analyzed. Moreover, public datasets are introduced. On this basis, the comparative experiments are carried out. Finally, the challenges of image caption and possibility of future work are prospected.

Key words: deep neural network, computer vision, image caption, encoder-decoder architecture, attention mechanism