结合多通道注意力的遥感图像飞机目标检测

doi:10.3778/j.issn.1002-8331.2107-0379

摘要/Abstract

摘要： 针对尺度多样化、目标密集、成像质量较差的遥感影像上飞机目标识别精度低的问题，提出结合平行层特征共享结构和注意力机制的遥感飞机目标自动检测模型AFF-CenterNet。该方法采用“编码-解码”的主干网络结构，以ResNet50进行基础特征提取；引入空洞卷积与注意力约束的平行层特征共享结构进行特征融合，有效提高了算法的特征提取能力；在UCAS-AOD和RSOD公共遥感数据集上分别进行实验，检测精度达到96.78%，相较于Faster R-CNN、SSD、YOLOv5s和原CenterNet算法分别提高了6.2、7.2、1.48和16个百分点。实验结果表明，该AFF-CenterNet算法在保持一定计算效率的条件下最大化CenterNet的小目标表征能力，有效提升了遥感影像中飞机的检测精度，对实现遥感影像飞机快速检测具有一定的参考意义。

关键词: 遥感飞机影像, CenterNet, 注意力机制, AFF-CenterNet

Abstract: Aiming at the problem of low aircraft target recognition accuracy in remote sensing images due to diversified target scales, dense targets, and poor imaging quality, a remote sensing aircraft target automatic detection model AFF-CenterNet, which combines parallel layer feature sharing structure and attention mechanism, is proposed. Firstly, the proposed method adopts an “encoding-decoding” backbone network structure to extract feature based on ResNet50. Then, the parallel layer feature sharing structure with hole convolution and attention constraints is used for feature fusion, which effectively improves the feature extraction ability of the algorithm. Finally, the quantitative comparison analysis is carried out on the public UCAS-AOD and RSOD data sets, and the detection accuracy reaches 96.78%. Compared with the faster R-CNN, SSD, YOLOv5 and the original CenterNet algorithm, the detection accuracy is improved by 6.2%, 7.2%, 1.48% and 16%, respectively. The experimental results show that the AFF-CenterNet algorithm maximizes CenterNet’s small target representation ability while maintaining a certain computational efficiency, thus improving the detection accuracy of aircraft in remote sensing images, and providing a reference for realizing rapid detection of aircraft in remote sensing images.

Key words: remote sensing aircraft image, CenterNet, attention mechanism, AFF-CenterNet

李婕, 周顺, 朱鑫潮, 李毅, 王恩果. 结合多通道注意力的遥感图像飞机目标检测[J]. 计算机工程与应用, 2022, 58(1): 209-217.

LI Jie, ZHOU Shun, ZHU Xinchao, LI Yi, WANG Enguo. Remote Sensing Image Aircraft Target Detection Combined with Multiple Channel Attention[J]. Computer Engineering and Applications, 2022, 58(1): 209-217.

参考文献

[1] LIU G，SUN X，FU K，et al.Interactive geospatial object extraction in high resolution remote sensing images using shape-based global minimization active contour model[J].Pattern Recognition Letters，2013，34（10）：1186-1195.
[2] WANG D，XIN H，WEI Z，et al.A method of aircraft image target recognition based on modified PCA features and SVM[C]//Proceedings of the 9th International Conference on Electronic Measurement & Instruments，2009：177-181.
[3] ALGANCI U，SOYDAS M，SERTEL E.Comparative research on deep learning approaches for airplane detection from very high-resolution satellite images[J].Remote Sensing，2020，12（3）：458-465.
[4] REN S，HE K，GIRSHICK R，et al.Faster R-CNN：Towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2017，39（6）：1137-1149.
[5] LIU W，ANGUELOV D，ERHAN D，et al.SSD：Single shot multibox detector[C]//Proceedings of European Conference on Computer Vision，2016：21-37.
[6] REDMON J，DIVVALA S，GIRSHICK R，et al.You only look once：Unified，real-time object detection[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition，2016：779-788.
[7] NEUBECK A，GOOL L.Efficient non-maximum suppression[C]//Proceedings of International Conference on Pattern Recognition，2006：20-24.
[8] LAW H，DENG J.CornerNet：Detecting objects as paired keypoints[C]//Proceedings of European Conference on Computer Vision，2018：765-781.
[9] ZHOU X，ZHUO J，KRHENBüHL P.Bottom-up object detection by grouping extreme and center points[J].arXiv：1901.08043，2019.
[10] ZHOU X，WANG D，PHILIPP P.Objects as points[J].arXiv：1904.07850，2019.
[11] LIU Y，YANG J，CUI W.Simple，fast，accurate object detection based on anchor-free method for high resolution remote sensing images[C]//Proceedings of IEEE International Geoscience and Remote Sensing Symposium，2020：2443-2446.
[12] ZHANG T，WANG G，ZHUANG Y，et al.Feature enhanced centernet for object detection in remote sensing images[C]//Proceedings of IEEE International Geoscience and Remote Sensing Symposium，2020：1639-1642.
[13] 魏玮，杨茹，朱叶.改进CenterNet的遥感图像目标检测[J].计算机工程与应用，2021，57（6）：191-199.
WEI W，YANG R，ZHU Y.Target detection of improved CenterNet to remote sensing images[J].Computer Engineering and Applications，2021，57（6）：191-199.
[14] MANDAL V，MUSSAH A R，ADU-GYAMFI Y.Deep learning frameworks for pavement distress classification：A comparative analysis[C]//Proceedings of IEEE International Conference on Big Data，2020：5577-5583.
[15] 姚群力，胡显，雷宏.基于多尺度融合特征卷积神经网络的遥感图像飞机目标检[J].测绘学报，2019，48（10）：1266-1274.
YAO Q L，HU X，LEI H.Aircraft detection in remote sensing imagery with multi-scale feature fusion convolutional neural network[J].Acta Geodaetica et Cartographica Sinica，2019，48（10）：1266-1274.
[16] 郑哲，雷琳，孙浩，等.FAGNet：基于MAFPN和GVR的遥感图像多尺度目标检测算法[J].计算机辅助设计与图形学学报，2021，33（6）：883-894.
ZHENG Z，LEI L，SUN H，et al.FAGNet：Multi-scale object detection method in remote sensing images combining MAFPN and GVR[J].Journal of Computer-Aided Design and Computer Graphics，2021，33（6）：883-894.
[17] LIM J S，ASTRID M，YOON H J，et al.Small object detection using context and attention[C]//Proceedings of International Conference on Artificial Intelligence in Information and Communication，2021：181-186.
[18] HU J，SHEN L，ALBANIE S，et al.Squeeze-and-excitation networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2020，42（8）：2011-2023.
[19] HE K，ZHANG X，REN S，et al.Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：770-778.
[20] YU F，WANG D，SHELHAMER E，et al.Deep layer aggregation[C]//Proceedings of the 2018 IEEE CVF Conference on Computer Vision and Pattern Recognition，2018：2403-2412.
[21] ZHU H，CHEN X，DAI W，et al.Orientation robust object detection in aerial images using deep convolutional neural network[C]//Proceedings of IEEE International Conference on Image Processing，2015：3735-3739.
[22] LONG Y，GONG Y，XIAO Z，et al.Accurate object localization in remote sensing images based on convolutional neural networks[J].IEEE Transactions on Geoscience and Remote Sensing，2017，55（5）：2486-2498.