Computer Engineering and Applications ›› 2019, Vol. 55 ›› Issue (12): 202-207.DOI: 10.3778/j.issn.1002-8331.1807-0188

Previous Articles     Next Articles

Super Resolution of Single Frame Remote Sensing Image Based on Generative Adversarial Nets

SU Jianmin, YANG Lanxin   

  1. College of Information and Computer Engineering, Northeast Forestry University, Harbin 150040, China
  • Online:2019-06-15 Published:2019-06-13

基于生成对抗网络的单帧遥感图像超分辨率

苏健民,杨岚心   

  1. 东北林业大学 信息与计算机工程学院,哈尔滨 150040

Abstract: Due to the limitation of imaging devices and transmission conditions, the definition of remote sensing image is difficult to guarantee. Image super-resolution technology aims at recovering high-resolution images from low-resolution images, which is of great significance for high quality interpretation of remote sensing images. In this paper, a single remote sensing image super-resolution method based on boundary equilibrium generative adversarial networks is proposed to solve the problems of traditional methods depending on the multi-frame image sequence and the reconstruction results are too smooth. Both the generator and the discriminator are designed as end to end autoencoder with skip connections. In order to enhance the quality of the generated images and accelerate the convergence of the network, a loss function based on the discriminator reconstruction error is used. The experimental results on the NWPU-RESISC45 dataset show that the proposed method can provide more high frequency information, and the reconstruction results are closest to the real image. Compared with the nearest interpolation and the bicubic interpolation methods, the PSNR is raised about 2.70 dB. Compared with other methods based on the deep convolution neural network, the PSNR is improved by about 0.72 dB.

Key words: remote sensing image, super-resolution, boundary equilibrium generative adversarial network, auto-encoder, reconstruction error

摘要: 受成像设备、传输条件等因素限制,遥感图像的清晰度难以保证。图像超分辨率技术旨在从低分辨率图像中恢复出高分辨率图像,对遥感图像的高质量解译具有重要意义。针对传统方法依赖多帧图像序列、重建结果过于平滑等问题,提出一种基于边界平衡生成对抗网络的单帧遥感图像超分辨方法。生成器与判别器均设计成带跳跃连接的端到端自编码器结构,为增强生成图像质量及加速网络收敛,使用了一种基于判别器重构误差的损失函数。在NWPU-RESISC45数据集上的实验结果表明,该方法能够提供更多的高频信息,重建结果最接近真实图像,相较于邻近插值和双三次插值方法,PSNR提升约2.70 dB,相较于其他基于深度卷积神经网络的方法,PSNR提升约0.72 dB。

关键词: 遥感图像, 超分辨率, 边界平衡生成对抗网络, 自编码器, 重构误差