Computer Engineering and Applications ›› 2021, Vol. 57 ›› Issue (23): 27-36.DOI: 10.3778/j.issn.1002-8331.2106-0228

• Research Hotspots and Reviews • Previous Articles     Next Articles

Overview of Image Quality Assessment Method Based on Deep Learning

CAO Yudong, LIU Haiyan, JIA Xu, LI Xiaohui   

  1. College of Electronics and Information Engineering, Liaoning University of Technology, Jinzhou, Liaoning 121001, China
  • Online:2021-12-01 Published:2021-12-02

基于深度学习的图像质量评价方法综述

曹玉东,刘海燕,贾旭,李晓会   

  1. 辽宁工业大学 电子与信息工程学院,辽宁 锦州 121001

Abstract:

Image quality evaluation is a measurement of the visual quality of an image or video. The researches on image quality evaluation algorithms in the past 10 years are reviewed. First, the measurement indicators of image quality evaluation algorithm and image quality evaluation datasets are introduced. Then, the different classification of image quality evaluation methods are analyzed, and image quality evaluation algorithms with deep learning technology are focused on, basic model of which is deep convolutional network, deep generative adversarial network and transformer. The performance of algorithms with deep learning is often higher than that of traditional image quality assessment algorithms. Subsequently, the principle of image quality assessment with deep learning is described in detail. A specific no-reference image quality evaluation algorithm based on deep generative adversarial network is introduced, which improves the reliability of simulated reference images through enhanced confrontation learning. Deep learning technology requires massive data support. Data enhancement methods are elaborated to improve the performance of the model. Finally, the future research trend of digital image quality evaluation is summarized.

Key words: deep learning, image quality assessment, generative adversarial network, Convolutional Neural Network(CNN), data enhancement

摘要:

图像质量评价是对图像或视频的视觉质量的一种度量,主要分析了最近10年图像质量评价算法的研究情况。介绍了图像质量评价算法的衡量指标以及常用的图像质量评价数据集,对图像质量评价方法的分类做了阐述,重点分析了基于深度学习技术的图像质量评价算法。目前,该类算法的基础模型主要包括深度卷积神经网络、深度生成对抗网络和变换器,其性能通常高于传统的图像质量评价算法。描述了基于深度学习技术的图像质量评价算法的原理,重点介绍了基于深度生成对抗网络的无参考图像质量评价算法,通过增强对抗学习强度提高模拟参考图的可靠性。深度学习技术需要海量训练数据的支持,探讨和总结数据集增强的方法,对数字图像质量评价方法的未来研究进行展望。

关键词: 深度学习, 图像质量评价, 生成对抗网络, 卷积神经网络, 数据增强