结合HDC和Attention的高分遥感影像光伏板提取研究

doi:10.3778/j.issn.1002-8331.2304-0355

摘要/Abstract

摘要： 人工调查维护光伏板导致人力维护成本昂贵。因此，使用深度学习方法通过遥感影像提取光伏板能够低成本为光伏发电场景的运行维护提供重要数据支撑。使用改进后的DeepLabV3+语义分割模型，解决了如何利用高分辨率遥感影像进行光伏的精确分割与提取的问题。提出一种基于DeepLabV3+深度学习架构的超高分辨率遥感影像光伏板提取方法。主要创新工作体现在：（1）针对遥感影像中光伏板信息难以精细提取的问题，提出混合空洞卷积空间金字塔池化模块；（2）针对光伏板信息提取中边缘细节易丢失的问题，引入注意力机制敏感捕捉小区域特征，以提高模型的分割能力。该研究采用2021年中国科学院大学发布的多分辨率光伏数据集进行实验，结果表明：提出的模型在0.1?m、0.3?m、0.8?m空间分辨率的分布式光伏数据集中IoU可达92.54%、79.91%、76.27%。在0.3?m、0.8?m空间分辨率的地面光伏数据集中可达到94.27%、87.24%，相较于原本的DeepLabV3+模型，在三种不同分辨率和不同背景的场景中的IoU提高0.13~2.02个百分点；同时在0.1?m、0.3?m、0.8?m空间分辨率的屋顶分布式光伏数据集上，提出的方法与经典语义分割模型U-Net、PSPNet、DeepLabV3+相比，IoU提高0.64~20.51个百分点。以上实验证明了该方法的有效性。

关键词: 高分辨率遥感, 光伏板识别与提取, 语义分割, 混合空洞卷积, 注意力机制

Abstract: Manual investigation and maintenance of photovoltaic panels result in expensive human maintenance costs.Therefore,using deep learning methods to extract photovoltaic panels from remote sensing images can provide important data support for the operation and maintenance of photovoltaic power generation scenarios at a low cost. The improved DeepLabV3+ semantic segmentation model has been used to solve the problem of precise segmentation and extraction of photovoltaics using high-resolution remote sensing images. It proposes a method for extracting photovoltaic panels from ultra-high resolution remote sensing images based on DeepLabV3+ deep learning architecture. The main innovative work is reflected in:(1) a hybrid cavity convolutional spatial pyramid pooling module is proposed to address the problem of difficulty in accurately extracting photovoltaic panel information from remote sensing images; (2) to address the issue of edge details being easily lost in photovoltaic panel information extraction, attention mechanism is introduced to sensitively capture small domain features to improve the segmentation ability of the model. This research uses the multi-resolution photovoltaic data set published by the University of the Chinese Academy of Sciences in 2021 to conduct experiments. The results show that the proposed model can achieve 92.54%, 79.91% and 76.27% of the distributed photovoltaic data set IoU with 0.1?m, 0.3?m and 0.8?m spatial resolution. Compared to the original DeepLabV3+ model, the ground photovoltaic dataset with spatial resolutions of 0.3?m and 0.8?m can achieve 94.27% and 87.24% IoU improvement of 0.13~2.02?percentage points in three different resolutions and backgrounds. Compared with the classical semantic segmentation models U-Net, PSPNet, and DeepLabV3+, the proposed method improves IoU by 0.64~20.51?percentage points on rooftop distributed photovoltaic datasets with spatial resolutions of 0.1 m, 0.3 m, and 0.8 m. The above experiments demonstrate the effectiveness of this method.

Key words: high-resolution remote sensing, PV panel identification and extraction, semantic segmentation, mixed void convolution, attention mechanism

刘桂生, 丁鑫, 祝锐, 张天健, 狄兮尧, 薛朝辉. 结合HDC和Attention的高分遥感影像光伏板提取研究[J]. 计算机工程与应用, 2024, 60(14): 357-366.

LIU Guisheng, DING Xin, ZHU Rui, ZHANG Tianjian, DI Xiyao, XUE Zhaohui. Research on Extracting Photovoltaic Panels from High Resolution Remote Sensing Images by Combining HDC and Attention[J]. Computer Engineering and Applications, 2024, 60(14): 357-366.

参考文献

[1] 洪向共, 周世芬. 基于灰度共生矩阵和区域生长算法的红外光伏面板图像分割[J]. 科学技术与工程, 2018, 18(34): 92-97.
HONG X G, ZHOU S F. Infrared photoelectric panels image segmentation based on gray level co-occurrence matrix and region growing algorithm[J]. Science and Technology and Engineering, 2018, 18(34): 92-97.
[2] 刘铖铖, 刘立群, 焦秀华, 等. 改进canny算子的太阳能电池表面缺陷检测[J]. 太原科技大学学报, 2021, 42(4): 255-260.
LIU C C, LIU L Q, JIAO X H, et al. Surface defect detection of solar cells based on improved canny operator[J]. Journal of Taiyuan University of Science and Technology, 2021, 42(4): 255-260.
[3] LONG J, SHELHAMER E, DARRELL T. Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015: 3431-3440.
[4] RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation[C]//Proceedings of the Medical Image Computing and Computer-Assisted Intervention, 2015: 234-241.
[5] ZHAO H S, SHI J P, QI X J, et al. Pyramid scene parsing network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017: 6230-6239.
[6] CHEN L C E, ZHU Y K, PAPANDREOU G, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation[C]//Proceedings of the Computer Vision-ECCV 2018: 15th European Conference, 2018: 833-851.
[7] ZHANG X H, XU M, WANG S J, et al. Mapping photovoltaic power plants in China using Landsat, random forest, and Google Earth Engine[J]. Earth System Science Data, 2022, 14(8): 3743-3755.
[8] JIE Y S, JI X H, YUE A Z, et al. Combined multi-layer feature fusion and edge detection method for distributed photovoltaic power station identification[J]. Energies, 2020, 13(24): 6742.
[9] SIZKOUHI A M M, AGHAEI M, ESMAILIFAR S M, et al. Automatic boundary extraction of large-scale photovoltaic plants using a fully convolutional network on aerial imagery[J]. IEEE Journal of Photovoltaics, 2020, 10(4): 1061-1067.
[10] PEREZ-GONZALEZ A, JARAMILLO-DUQUE A, CANO-QUINTERO J B. Automatic boundary extraction for photovoltaic plants using the deep learning u-net model[J]. Applied Sciences-Basel, 2021, 10(14): 1061-1067.
[11] GE F, WANG G Z, HE G J, et al. A hierarchical information extraction method for large-scale centralized photovoltaic power plants based on multi-source remote sensing images[J]. Remote Sensing, 2022, 14(17): 4211.
[12] WANG P Q, CHEN P F, YUAN Y, et al. Understanding convolution for semantic segmentation[C]//Proceedings of the IEEE Winter Conference on Applications of Computer Vision, 2018: 1451-1460.
[13] XU W J, ZHU Q. A semantic segmentation method with emphasis on the edges for automatic vessel wall analysis[J]. Applied Sciences-Basel, 2022, 12(14): 7012.
[14] WOO S H, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C]//Proceedings of the Lecture Notes in Computer Science, 2018: 3-19.
[15] LI S F, LI B, LI J, et al. Semantic segmentation algorithm of rice small target based on deep learning[J]. Agriculture-Basel, 2022, 12(8): 1232.
[16] JIANG H, YAO L, LU N, et al. Multi-resolution dataset for photovoltaic panel segmentation from satellite and aerial imagery[J]. Earth System Science Data, 2021, 13(11): 5389-5401.