Computer Engineering and Applications ›› 2021, Vol. 57 ›› Issue (24): 61-73.DOI: 10.3778/j.issn.1002-8331.2109-0196

• Research Hotspots and Reviews • Previous Articles     Next Articles

Review of Deep Learning Methods for Lip Recognition

MA Jinlin, ZHU Yanbin, MA Ziping, GONG Yuanwen, CHEN Deguang, LIU Yuhao   

  1. 1.School of Computer Science and Engineering, North Minzu University, Yinchuan 750021, China
    2.Key Laboratory for Intelligent Processing of Computer Images and Graphics of the State Ethnic Affairs Commission of PRC, Yinchuan 750021, China
    3.School of Mathematics and Information Science, North Minzu University, Yinchuan 750021, China
  • Online:2021-12-15 Published:2021-12-13



  1. 1.北方民族大学 计算机科学与工程学院,银川 750021
    2.图像图形智能信息处理国家民委重点实验室,银川 750021
    3.北方民族大学 数学与信息科学学院,银川 750021


With the continuous development of deep learning, significant progress has been made in the field of lip recognition, and many deep learning algorithms for lip recognition have emerged. According to the continuity of the recognition object, this paper divides lip recognition into isolated lip recognition and continuous lip recognition, analyzes and summarizes the deep learning methods of each recognition task in detail and in-depth. Firstly, it introduces the mainstream lip recognition methods from the two aspects of the deep learning method of isolated lip recognition and the deep method of continuous lip recognition, and compares the advantages, disadvantages and performance of each method. Secondly, the characteristics and performance of representative methods for different data sets are compared, and the advantages, disadvantages and application scope of the two methods are expounded. Finally, the problems and challenges of lip recognition methods are discussed, and the research trend of lip recognition methods is prospected.

Key words: lip recognition, deep learning, convolutional neural networks, attentional mechanisms



关键词: 唇语识别, 深度学习, 卷积神经网络, 注意力机制