Computer Engineering and Applications ›› 2022, Vol. 58 ›› Issue (24): 1-11.DOI: 10.3778/j.issn.1002-8331.2206-0157

• Research Hotspots and Reviews • Previous Articles     Next Articles

Recent Advances on Panoramic Image Quality Assessment Methods

AI Da, BAI Yansong, YU Kexin, YUAN Hui, LIU Ying   

  1. 1.School of Communication and Information Engineering, Xi’an University of Posts and Telecommunications, Xi’an 710121, China
    2.School of Control Science and Engineering, Shandong University, Jinan 250100, China
  • Online:2022-12-15 Published:2022-12-15

全景图像质量评价方法最新进展

艾达,白岩松,于可欣,元辉,刘颖   

  1. 1.西安邮电大学 通信与信息工程学院,西安 710121
    2.山东大学 控制科学与工程学院,济南 250100

Abstract: With the rapid development of virtual reality(VR) technology, panoramic videos and images have become a new form of media display. Therefore, the quality assessment of panoramic image(PIQA) has great practical significance for improvement of VR technology. The researches of PIQA methods in recent five years are reviewed. The existing objective measures of panoramic image are analyzed, including the improved method based on peak signal-to-noise ratio and the improved method based on structural similarity respectively. The methods of deep learning for panoramic image quality assessment are summarized. The quality assessment methods of panoramic images are studied for two unique distortions, the stitching distortion and the projection distortion. The commonly used public datasets and some self-built datasets for PIQA are summarized. By using the pearson linear correlation coefficient, Spearman rank order correlation coefficient and root mean squared error as the evaluation performance measures, the degree of correlation between objective assessment of PIQA methods and subjective perception of human being is compared. The research trend in the future of PIQA methods is prospected.

Key words: panoramic image, image quality assessment, objective assessment, deep learning, stitching distortion, projection distortion

摘要: 随着虚拟现实技术的快速发展,全景视频图像已成为一种新的媒体展示形式被投入使用。全景图像的质量评价方法对促进虚拟现实技术具有重要的现实意义。研究了近五年来全景图像质量评价新方法。分析了全景图像客观评价指标,包括基于峰值信噪比的改进方法和基于结构相似性的改进方法。归纳总结了基于深度学习的全景图像质量评价方法以及其特有的缝合失真和投影失真的评价方法。搜集整理了常用的全景图像质量评价公共数据集与专有自建数据集。采用皮尔森相关系数、斯皮尔曼秩相关系数与均方根误差作为评价指标,根据客观评分与人眼主观感受的相关程度对现有全景图像质量评价方法进行了对比分析。对全景图像质量评价方法的发展方向进行展望。

关键词: 全景图像, 图像质量评价, 客观评价, 深度学习, 投影失真, 特殊失真