CIEFRNet：面向高速公路的抛洒物检测算法

doi:10.3778/j.issn.1002-8331.2306-0395

摘要/Abstract

摘要： 高速公路抛洒物危及行车安全，极易诱发交通事故，及时识别并清理高速公路抛洒物十分重要。由于高速公路抛洒物在图像中面积占比小且图像背景复杂，现有检测方法常出现漏检和误检的情况。针对上述问题，提出了一种基于上下文信息增强和特征提纯的抛洒物检测算法，记为CIEFRNet。设计了一种融合上下文Transformer的主干特征提取模块（CSP-COT），充分挖掘局部静态上下文信息和全局动态上下文信息，增强小抛洒物的特征表示；主干网络中使用改进的空间金字塔池化（ISPP），通过级联的空洞卷积实现特征的多尺度下采样，减轻目标细节信息的损失；为提高特征融合能力，设计了特征提纯模块（CNAB），其中嵌入了提出的一种混合注意力机制（ECSA），可抑制图像背景噪声，强化微小抛洒物的特征；引入基于动态非单调聚焦机制的WIoU优化损失函数，提高小抛洒物学习能力，加速网络收敛。实验结果表明，所提方法在自制的高速公路抛洒物数据集上的精确率、召回率、AP0.5和AP0.5：0.95分别达到96.5%、81.6%、88.1%和46.5%，优于当前主流的目标检测方法，其算法复杂度也更低，满足实际场景应用需要。

关键词: 抛洒物检测, 上下文信息, 空间金字塔池化, 注意力机制, 损失函数

Abstract: Highway abandoned objects endanger traffic safety, easily cause traffic accidents, so it is critical to recognize and clean them up in time. Due to the small area of highway abandoned objects in the image and complex image background, the existing detection methods often have the problems of missed and false detection. To address the above problems, an abandoned objects detection algorithm based on contextual information enhancement and feature refinement is proposed, which is called CIEFRNet. Firstly, a backbone feature extraction module (CSP-COT) incorporating contextual Transformer is designed to fully mine local static and global dynamic context information, and enhance the feature representation of small abandoned objects. In addition, the proposes improved spatial pyramid pooling (ISPP) is used in the backbone, multi-scale downsampling of features is realized by cascade dilated convolution, which reduces the loss of object detail information; in order to improve the feature fusion ability, a feature refine module (CNAB) is designed, in which a proposed mixed attention mechanism (ECSA) is embedded, which can suppress image background noise, and enhances the features of tiny abandoned objects. Finally, it uses the WIoU loss function based on dynamic non-monotonic focus mechanism to improve the learning ability of small abandoned objects and accelerate the network convergence. The experi-
mental results demonstrate that the proposed method achieves 96.5%, 81.6%, 88.1% and 46.5% of accuracy, recall, AP0.5 and AP0.5：0.95 on the self-made highway abandoned objects dataset, respectively, which is better than the currently prevailing object detection methods, and its algorithm complexity is also lower to meet the needs of practical scene applications.

Key words: abandoned objects detection, context information, spatial pyramid pooling, attention mechanism, loss function

李旭, 宋焕生, 史勤, 张朝阳, 刘泽东, 孙士杰. CIEFRNet：面向高速公路的抛洒物检测算法[J]. 计算机工程与应用, 2024, 60(5): 336-346.

LI Xu, SONG Huansheng, SHI Qin, ZHANG Zhaoyang, LIU Zedong, SUN Shijie. CIEFRNet：Abandoned Objects Detection Algorithm for Highway[J]. Computer Engineering and Applications, 2024, 60(5): 336-346.

参考文献

[1] 蒋来. 浅谈高速公路抛洒物危害与对策[J]. 道路交通管理, 2021(4): 36-37.
JIANG L. A brief discussion on the hazards and countermeasures of abandoned objects in highway[J]. Road Traffic Management, 2021(4): 36-37.
[2] FU H, XIANG M, MA H, et al. Abandoned object detection in highway scene[C]//2011 6th International Conference on Pervasive Computing and Applications, 2011: 117-121.
[3] ZENG Y, LAN J, RAN B, et al. A novel abandoned object detection system based on three-dimensional image information[J]. Sensors, 2015, 15(3): 6885-6904.
[4] 汪贵平, 马力旺, 郭璐, 等. 高速公路抛洒物事件图像检测算法[J]. 长安大学学报 (自然科学版), 2017, 37(5): 81-88.
WANG G P, MA L W, GUO L, et al. Image detection algorithm for incident of abandoned objects in highway[J]. Journal of Chang’an University (Natural Science Edition), 2017, 35(5): 81-88.
[5] 李清瑶, 邹皓, 赵群, 等. 基于帧间差分自适应法的车辆抛洒物检测[J]. 长春理工大学学报 (自然科学版), 2018, 41(4): 108-113.
LI Q Y, ZOU H, ZHAO Q, et al. Vehicles throwing detection based on inter-frame difference adaptive method[J]. Journal of Changchun University of Science and Technology (Natural Science Edition), 2018, 41(4): 108-113.
[6] 王立志. 长短效双背景模型下交通遗撒物识别新方法[J]. 计算机应用研究, 2020, 37(1): 412-413.
WANG L Z. Novel method for traffic abandoned objects recognition based on long-term and short-term dual background model[J]. Application Research of Computers, 2020, 37(1): 412-413.
[7] 金瑶, 张锐, 尹东. 城市道路视频中小像素目标检测[J]. 光电工程, 2019, 46(9): 76-83.
JIN Y, ZHANG R, YIN D. Object detection for small pixel in urban roads videos[J]. Opto-Electronic Engineering, 2019, 46(9): 76-83.
[8] 张文风, 于艳玲. 基于Faster R-CNN的高速公路抛落物检测[J]. 上海船舶运输科学研究所学报, 2021, 44(1): 70-75.
ZHANG W F, YU Y L. Detection of dropped objects on highway with Faster R-CNN[J]. Journal of Shanghai Ship and Shipping Research Institute, 2021, 44(1): 70-75.
[9] HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 770-778.
[10] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[J]. arXiv:1409.1556,2014.
[11] ZEILER M D, FERGUS R. Visualizing and understanding convolutional networks[C]//13th European Conference on Computer Vision, Zurich, Switzerland, September 6-12, 2014: 818-833.
[12] 章悦, 张亮, 谢非, 等. 基于实例分割模型优化的道路抛洒物检测算法[J]. 计算机应用, 2021, 41(11): 3228-3233.
ZHANG Y, ZHANG L, XIE F, et al. Road abandoned object detection algorithm based on optimized instance segmentation model[J]. Journal of Computer Applications, 2021, 41(11): 3228-3233.
[13] 周勇, 张炳振, 张枭勇, 等. 融合改进YOLO和背景差分的道路抛洒物检测算法[J]. 交通信息与安全, 2022, 40(5): 112-119.
ZHOU Y, ZHANG B Z, ZHANG X Y, et al. A detection method for abandoned materials on road surface based on an improved YOLO and background differencing algorithm[J]. Transportation Information and Safety, 2022, 40(5): 112-119.
[14] 姜子渊. 高速公路道路异常检测研究与实现[D]. 西安: 西安工业大学, 2023.
JIANG Z Y. Research and implementation of road anomaly detection on expressway[D]. Xi’an: Xi’an Technological University, 2023.
[15] LIU W, LI J, LIU Y, et al. Research on the lightweight detection network of abandoned objects in freeway based on video[C]//Proceedings of the SPIE, 2023.
[16] TONG Z, CHEN Y, XU Z, et al. Wise-IoU: bounding box regression loss with dynamic focusing mechanism[J]. arXiv:2301.10051,2023.
[17] LI Y, YAO T, PAN Y, et al. Contextual transformer networks for visual recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 45(2): 1489-1500.
[18] WANG C Y, LIAO H, WU Y H, et al. CSPNet: a new backbone that can enhance learning capability of CNN[C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2020.
[19] HE K, ZHANG X, REN S, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(9): 1904-1916.
[20] LIU Z, MAO H, WU C Y, et al. A convnet for the 2020s[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022: 11976-11986.
[21] LIU Z, LIN Y, CAO Y, et al. Swin transformer: hierarchical vision transformer using shifted windows[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021: 10012-10022.
[22] TOUVRON H, CORD M, SABLAYROLLES A, et al. Going deeper with image transformers[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021: 32-42.
[23] WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision (ECCV), 2018: 3-19.
[24] WANG Q, WU B, ZHU P, et al. ECA-Net: efficient channel attention for deep convolutional neural networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020: 11534-11542.
[25] ZHENG Z, WANG P, REN D, et al. Enhancing geometric factors in model learning and inference for object detection and instance segmentation[J]. IEEE Transactions on Cybernetics, 2022, 52(8): 8574-8586.
[26] WANG P, CHEN P, YUAN Y, et al. Understanding convolution for semantic segmentation[C]//2018 IEEE Winter Conference on Applications of Computer Vision, 2018: 1451-1460.
[27] SELVARAJU R R, COGSWELL M, DAS A, et al. Grad-CAM: visual explanations from deep networks via gradient-based localization[C]//Proceedings of the IEEE International Conference on Computer Vision, 2017: 618-626.
[28] REN S, HE K, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. Advances in Neural Information Processing Systems, 2017, 39(6): 1137-1149.
[29] WANG C Y, BOCHKOVSKIY A, LIAO H Y M. YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[J]. arXiv:2207.02696,2022.
[30] SANDLER M, HOWARD A, ZHU M, et al. Mobilenetv2: inverted residuals and linear bottlenecks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018: 4510-4520.
[31] GE Z, LIU S, WANG F, et al. Yolox: exceeding YOLO series in 2021[J]. arXiv:2107.08430,2021.
[32] ZHU X, SU W, LU L, et al. Deformable DETR: deformable transformers for end-to-end object detection[J]. arXiv:2010.
04159,2020.
[33] YANG J, LI C, DAI X, et al. Focal modulation networks[C]//Advances in Neural Information Processing Systems, 2022: 4203-4217.