Hyperspectral Image Classification Based on Fully Convolutional Network and Auto-Encoder

doi:10.3778/j.issn.1002-8331.2009-0144

Abstract

Abstract: Aiming at the problems of insufficient utilization of hyperspectral image spatial information and the small number of labeled samples, a hyperspectral image classification algorithm based on fully convolutional network and stack sparse auto-encoder is proposed. First of all, based on the idea of transfer learning, the pre-trained fully convolutional network FCN-8s is used to mine the potential multi-scale geometric structure features of the image. Then the pixel neighborhood information of the features is selected, and the splicing fusion method is used to fuse with the original spectral information. Finally, the stacked sparse auto-encoder network is used to complete the final multi-scale spatial spectrum feature extraction, and the classification is realized by Softmax classifier.Experimental results on three groups of remote sensing images show that the proposed algorithm greatly improves the classification effect of boundary regions.

Key words: hyperspectral image, fully convolutional network, stacked sparse auto-encoder, transfer learning

摘要： 针对高光谱图像空间信息利用不足、标记样本数量较少的问题，提出一种基于全卷积网络和堆栈稀疏自编码的高光谱图像分类算法。基于迁移学习的思想，利用预训练好的全卷积网络FCN-8s，挖掘图像潜在的多尺度几何结构特征；选取其特征的像素邻域信息，采用拼接融合的方法与原光谱信息进行融合；利用堆栈稀疏自编码网络完成最终的多尺度空谱特征提取，并通过Softmax分类器实现分类。对三组遥感图像进行实验，结果显示，所提算法极大改善了边界区域的分类效果。

关键词: 高光谱图像, 全卷积网络, 堆栈稀疏自编码, 迁移学习

DONG Pengxin, DONG Anguo, LI Chuting, LIANG Miaomiao. Hyperspectral Image Classification Based on Fully Convolutional Network and Auto-Encoder[J]. Computer Engineering and Applications, 2022, 58(5): 256-263.

董朋欣, 董安国, 李楚婷, 梁苗苗. 基于全卷积网络和自编码的高光谱图像分类[J]. 计算机工程与应用, 2022, 58(5): 256-263.

References

[1] 陈世涵，李玲，蒋弘凡，等.基于高空间分辨率卫星遥感数据的探测环境变化对气温的影响[J].光学学报，2020，40（10）：159-168.
CHEN S H，LI L，JIANG H F，et al.Impact of observational environment change on air temperature based on high-spatial-resolution satellite remote sensing data[J].Acta Optica Sinica，2020，40（10）：159-168.
[2] YE X，REN H Z，LIU R Y，et al.Land surface temperature estimate from chinese Gaofen-5 satellite data using split-window algorithm[J].IEEE Transactions on Geoscience & Remote Sensing，2017，55（10）：5877-5888.
[3] ZHAO C H，LIU W，XU Y，et al.A spectral-spatial SVM-based multi-layer learning algorithm for hyperspectral image classification[J].Remote Sensing Letters，2018，9（3）：218-227.
[4] 董安国，张倩，刘洪超，等.基于TSNE和多尺度稀疏自编码的高光谱图像分类[J].计算机工程与应用，2019，55（21）：176-181.
DONG A G，ZHANG Q，LIU H C，et al.Hyperspectral image classification based on TSNE and multiscale sparse auto-encoder[J].Computer Engineering and Applications，2019，55（21）：176-181.
[5] FANG L Y，LI S T，KANG X D，et al.Spectral-spatial hyperspectral image classification via multiscale adaptive sparse representation[J].IEEE Transactions on Geoscience & Remote Sensing，2014，52（12）：7738-7749.
[6] HUANG H，DUAN Y L，SHI G Y，et al.Fusion of weighted mean reconstruction and SVMCK for hyperspectral image classification[J].IEEE Access，2018，6：15224-15235.
[7] FENG J，LIU L G，CAO X H，et al.Marginal stacked autoencoder with adaptively-spatial regularization for hyperspectral image classification[J].IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing，2018，11（9）：3297-3311.
[8] ZHONG P，GONG Z Q，LI S T，et al.Learning to diversify deep belief networks for hyperspectral image classification[J].IEEE Transactions on Geoscience and Remote Sensing，2017，55（6）：3516-3530.
[9] CHEN Y S，JIANG H L，LI C Y，et al.Deep feature extraction and classification of hyperspectral images based on convolutional neural networks[J].IEEE Transactions on Geoscience and Remote Sensing，2016，54（10）：6232-6251.
[10] DING H，JIANG X，SHUAI B，et al.Semantic segmentation with context encoding and multi-path decoding[J].IEEE Transactions on Image Processing，2020，29：3520-3533.
[11] 王立伟，李吉明，周国民，等.深度迁移学习在高光谱图像分类中的运用[J].计算机工程与应用，2019，55（5）：181-186.
WANG L W，LI J M，ZHOU G M，et al.Application of deep transfer learning in hyperspectral image classification[J].Computer Engineering and Applications，2019，55（5）：181-186.
[12] MAHAJAN A，CHAUDHARY S.Categorical image classification based on representational deep network （RESNET）[C]//2019 3rd International Conference on Electronics，Communication and Aerospace Technology（ICECA），June 12-14，2019，Coimbatore，India，2019：327-330.
[13] LONG J，SHELHAMER E，DARRELL T.Fully convolutional networks for semantic segmentation[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition（CVPR），June 7-12，2015，Boston，MA，USA，2015：3431-3440.
[14] HUANG Z L，PAN Z X，LEI B.What，where，and how to transfer in SAR target recognition based on deep CNNs[J].IEEE Transactions on Geoscience and Remote Sensing，2020，58（4）：2324-2336.
[15] LIANG M M，JIAO L C，YANG S Y，et al.Deep multiscale spectral-spatial feature fusion for hyperspectral images classification[J].IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing，2018，11（8）：2911-2924.
[16] SHIBATA K，IKEDA Y.Effect of number of hidden neurons on learning in large-scale layered neural networks[C]//Proceedings of ICROS-SICE International Joint Conference 2009，August 18-21，2009：5008-5013.
[17] BOUWMANS T，JAVED S，ZHANG H，et al.On the applications of robust PCA in image and video processing[J].Proceedings of the IEEE，2018，106（8）：1427-1457.
[18] WANG F，CHENG J，LIU W，et al.Additive margin softmax for face verification[J].IEEE Signal Processing Letters，2018，25（7）：926-930.
[19] MAATEN L V D，HINTON G.Visualizing data using t-SNE[J].Journal of Machine Learning Research，2008，9：2579-2605.