Improved SSD-Based Multi-scale Object Detection Algorithm in Airport Surface

doi:10.3778/j.issn.1002-8331.2010-0110

Abstract

Abstract: Aiming at the problem that the existing general object detection method based on deep learning is difficult to detect the airport scene environment object with large scale difference, especially small targets are difficult to detect. This paper proposes a multi-scale object detection algorithm based on SSD algorithm combined with feature pyramid fusion network. The algorithm first uses ResNet-50 as the backbone network, and separately designs six additional feature layers. Secondly, the feature pyramid network is used for feature fusion to obtain more robust semantic information. Finally, Soft-NMS is used to solve the missing detection situation, and the scale ratio of the prior frame is adjusted to better detect small objects. Experiments on the airport surface dataset show that the improved algorithm can achieve 86.31% mAP when the inferred speed is 32?frame/s, which is at the leading level compared with other advanced detectors.

Key words: feature pyramid, object detection, airport surface surveillance, Soft-NMS

摘要： 针对现有基于深度学习的通用目标检测方法对机场场面环境目标尺度差别大，特别是小目标难以检测到的问题，提出了一个基于SSD算法并结合特征金字塔融合网络的多尺度目标检测算法。该算法采用了更深的ResNet-50作为骨干网络，并单独设计了六层额外特征层。使用特征金字塔网络进行特征融合，以获得更鲁棒的语义信息。使用Soft-NMS以解决存在的漏检情况，调整先验框的尺度比以更好地检测小目标。通过在机场场面数据集实验表明，该改进算法能够在推断速度为32?frame/s的情况下，取得86.31%的mAP，对比其他先进的检测器，达到领先水平。

关键词: 特征金字塔, 目标检测, 机场场面监视, Soft-NMS

HUANG Guoxin, LI Wei, ZHANG Bihao, LIANG Binbin, HAN Xiaodong, GONG Jianglei, WU Changqing. Improved SSD-Based Multi-scale Object Detection Algorithm in Airport Surface[J]. Computer Engineering and Applications, 2022, 58(5): 264-270.

黄国新, 李炜, 张比浩, 梁斌斌, 韩笑冬, 宫江雷, 武长青. 改进SSD的机场场面多尺度目标检测算法[J]. 计算机工程与应用, 2022, 58(5): 264-270.

References

[1] BESADA J A，GARCIA J，PORTILLO J，et al.Airport surface surveillance based on video images[J].IEEE Transactions on Aerospace and Electronic Systems，2005，41（3）：1075-1082.
[2] QIN Z，WANG J，HUANG C.The monocular visual imaging technology model applied in the airport surface surveillance[C]//International Symposium on Photoelectronic Detection and Imaging 2013：Imaging Sensors and Applications，International Society for Optics and Photonics，2013.
[3] VADDI S，LU H，HAYASHI M.Computer vision based surveillance concept for airport ramp operations[C]//Digital Avionics Systems Conference，2013.
[4] SCHMIDT M，RUDOLPH M，PAPENFUSS A，et al.Remote airport traffic control center with augmented vision video panorama[C]//2009 IEEE/AIAA 28th Digital Avionics Systems Conference，2009.
[5] LIU W，ANGUELOV D，ERHAN D，et al.SSD：single shot multibox detector[J].arXiv：1512.02325，2015.
[6] SIMONYAN K，ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv：1409.
1556，2014.
[7] EVERINGHAM M，VAN GOOL L，WILLIAMS C K，et al.The pascal visual object classes（voc） challenge[J].International Journal of Computer Vision，2010，88（2）：303-338.
[8] BODLA N，SINGH B，CHELLAPPA R，et al.Soft-NMS—improving object detection with one line of code[C]//Proceedings of the IEEE International Conference on Computer Vision，2017：5561-5569.
[9] HE K，ZHANG X，REN S，et al.Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2016：770-778.
[10] LIN T，DOLLáR P，GIRSHICK R，et al.Feature pyramid networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2017：2117-2125.
[11] HE K，SUN J.Convolutional neural networks at constrained time cost[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2015：5353-5360.
[12] CHOLLET F.Xception：deep learning with depthwise separable convolutions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2017：1251-1258.
[13] ZHOU P，NI B，GENG C，et al.Scale-transferrable object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：528-537.
[14] WOO S，HWANG S，KWEON I S.StairNet：top-down semantic aggregation for accurate one shot detection[C]//2018 IEEE Winter Conference on Applications of Computer Vision（WACV），2018：1093-1102.
[15] KONG T，SUN F，YAO A，et al.Ron：reverse connection with objectness prior networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2017：5936-5944.
[16] NEUBECK A，VAN GOOL L.Efficient non-maximum suppression[C]//18th International Conference on Pattern Recognition（ICPR’06），2006：850-855.
[17] EVERINGHAM M，ESLAMI S A，VAN GOOL L，et al.The pascal visual object classes challenge：a retrospective[J].International Journal of Computer Vision，2015，111（1）：98-136.
[18] LIN T，MAIRE M，BELONGIE S，et al.Microsoft coco：common objects in context[C]//European Conference on Computer Vision，2014：740-755.
[19] PASZKE A，GROSS S，MASSA F，et al.Pytorch：an imperative style，high-performance deep learning library[C]//Advances in Neural Information Processing Systems，2019：8026-8037.
[20] REDMON J，FARHADI A.YOLOv3：an incremental improvement[J].arXiv：1804.02767，2018.
[21] CHEN K，WANG J，PANG J，et al.Mmdetection：open mmlab detection toolbox and benchmark[J].arXiv：1906. 07155，2019.