改进YOLOv5s+DeepSORT的监控视频车流量统计

doi:10.3778/j.issn.1002-8331.2108-0346

摘要/Abstract

摘要： 针对监控视频中车流量统计准确率低的问题，提出一种改进YOLOv5s检测结合Deep SORT跟踪的车流量统计方法。为了提升检测器识别效果，将注意力模块CBAM与YOLOv5s网络的Neck部分融合，提高网络的特征提取能力；将CIoU Loss代替GIoU Loss作为目标边界框回归损失函数，加快边界框回归速率的同时提高定位精度；使用DIoU-NMS替换NMS，改善目标拥挤时的漏检问题。调整Deep SORT外观特征提取网络的结构，并在车辆重识别数据集上重新训练，降低目标遮挡导致的身份切换。连接改进的YOLOv5s检测器和Deep SORT，在视频中设置虚拟检测线统计车流量。实验结果表明：改进的YOLOv5s相较原始算法平均准确率提高2.3个百分点，结合Deep SORT跟踪，在行车平峰、高峰、夜间三种场景的车流量统计准确率达到93.5%、91.2%、89.9%。

关键词: YOLOv5s, Deep SORT, 注意力机制, CIoU, 车流量统计

Abstract: To address the problem of low accuracy of vehicle volume statistics based on traffic monitoring video, an improved YOLOv5s detector combined with Deep SORT method is proposed.In order to improve the detection rate, the attention module CBAM is integrated with the Neck of the YOLOv5s to improve the feature extraction ability. CIoU Loss is used as the target bounding box regression loss function instead of GIoU Loss to speed up the bounding box regression rate while increasing positioning accuracy. NMS is replaced by DIoU-NMS to reduce the fail of detection when the targets are crowded. The structure of appearance feature extraction network of Deep SORT is refined, and it is retrained on the vehicle re-identification dataset to reduce identity switch caused by target occlusion. The improved YOLOv5s detector is fused with Deep SORT, and a virtual detection line is set in the video to count the traffic flow. The results show that the improved YOLOv5s has an average accuracy of 2.3 percentage points higher than that of the original algorithm. Combined with Deep SORT, the statistical accuracy of traffic flow in off-peak, rush hour, and night scenarios reaches 93.5%, 91.2%, and 89.9%.

Key words: YOLOv5s, Deep SORT, attention mechanism, CIoU, vehicle volume statistics

李永上, 马荣贵, 张美月. 改进YOLOv5s+DeepSORT的监控视频车流量统计[J]. 计算机工程与应用, 2022, 58(5): 271-279.

LI Yongshang, MA Ronggui, ZHANG Meiyue. Traffic Monitoring Video Vehicle Volume Statistics Method Based on Improved YOLOv5s+DeepSORT[J]. Computer Engineering and Applications, 2022, 58(5): 271-279.

参考文献

[1] VIOLA P，JONES M.Rapid object detection using a boosted cascade of simple features[C]//Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition，2001.
[2] DALAL N，TRIGGS B.Histograms of oriented gradients for human detection[C]//2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition（CVPR’05），2005：886-893.
[3] FELZENSZWALB P F，GIRSHICK R B，MCALLESTER D，et al.Object detection with discriminatively trained part-based models[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2009，32（9）：1627-1645.
[4] ZOU Z，SHI Z，GUO Y，et al.Object detection in 20 years：a survey[J].arXiv：1905.05055，2019.
[5] GIRSHICK R，DONAHUE J，DARRELL T，et al.Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2014：580-587.
[6] GIRSHICK R.Fast R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision，2015：1440-1448.
[7] REN S，HE K，GIRSHICK R，et al.Faster R-CNN：towards real-time object detection with region proposal networks[C]//Advances in Neural Information Processing Systems，2015：91-99.
[8] LIU W，ANGUELOV D，ERHAN D，et al.SSD：single shot multibox detector[C]//European Conference on Computer Vision，2016：21-37.
[9] LIN T Y，GOYAL P，GIRSHICK R，et al.Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision，2017：2980-2988.
[10] REDMON J，FARHADI A.Yolov3：an incremental improvement[J].arXiv：1804.02767，2018.
[11] BOCHKOVSKIY A，WANG C Y，LIAO H Y M.Yolov4：optimal speed and accuracy of object detection[J].arXiv：2004.10934，2020.
[12] Ultralytics.YOLOv5[EB/OL].[2021].https：//github.com/ultralytics/yolov5.
[13] 黄开启，刘小荣，钱艳群，等.雾霾天气车辆检测的改进YOLOv3算法[J].重庆大学学报，2021，45（12）：95-102.
HUANG K Q，LIU X R，QIAN Y Q，et al.Improved YOLOv3 algorithm for vehicle detection in haze weather[J].Journal of Chongqing University，2021，45（12）：95-102.
[14] 鞠默然，罗海波，王仲博，等.改进的YOLO V3算法及其在小目标检测中的应用[J].光学学报，2019，39（7）：253-260.
JU M R，LUO H B，WANG Z B，et al.Improved YOLO V3 algorithm and its application in small target detection[J].Acta Optica Sinica，2019，39（7）：253-260.
[15] 李国进，胡洁，艾矫燕.基于改进SSD算法的车辆检测[J].计算机工程，2022，48（1）：266-274.
LI G J，HU J，AI J Y.Vehicle detection based on improved SSD[J].Computer Engineering，2022，48（1）：266-274.
[16] 李俊彦，宋焕生，张朝阳，等.基于视频的多目标车辆跟踪及轨迹优化[J].计算机工程与应用，2020，56（5）：194-199.
LI J Y，SONG H S，ZHANG Z Y，et al.Multi-object vehicle tracking and trajectory optimization based on video[J].Computer Engineering and Applications，2020，56（5）：194-199.
[17] 刘磊，赵栓峰，郭卫.一种YOLO识别与Mean shift跟踪的车流量统计方法[J].制造业自动化，2020，42（2）：16-20.
LIU L，ZHAO S F，GUO W.Traffic flow statistics method based on YOLO recognition and mean shift tracking[J].Manufacturing Automation，2020，42（2）：16-20.
[18] 金立生，华强，郭柏苍，等.基于优化DeepSort的前方车辆多目标跟踪[J].浙江大学学报（工学版），2021，55（6）：1056-1064.
JIN L S，HUA Q，GUO B C，et al.Multi-target tracking of vehicles based on optimized DeepSort[J].Journal of Zhejiang University（Engineering Science），2021，55（6）：1056-1064.
[19] 张瑶，卢焕章，张路平，等.基于深度学习的视觉多目标跟踪算法综述[J].计算机工程与应用，2021，57（13）：55-66.
ZHANG Y，LU H Z，ZHANG L P，et al.Overview of visual multi-object tracking algorithms with deep learning[J].Computer Engineering and Applications，2021，57（13）：55-66.
[20] WANG C Y，LIAO H Y M，WU Y H，et al.CSPNet：a new backbone that can enhance learning capability of CNN[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops，2020：390-391.
[21] HE K，ZHANG X，REN S，et al.Spatial pyramid pooling in deep convolutional networks for visual recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，37（9）：1904-1916.
[22] LIU S，QI L，QIN H，et al.Path aggregation network for instance segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：8759-8768.
[23] 张宸嘉，朱磊，俞璐.卷积神经网络中的注意力机制综述[J].计算机工程与应用，2021，57（20）：64-72.
ZHANG C J，ZHU L，YU L.Review of attention mechanism in convolutional neural networks[J].Computer Engineering and Applications，2021，57（20）：64-72.
[24] WOO S，PARK J，LEE J Y，et al.Cbam：convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision（ECCV），2018：3-19.
[25] REZATOFIGHI H，TSOI N，GWAK J，et al.Generalized intersection over union：a metric and a loss for bounding box regression[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2019：658-666.
[26] 刘鑫辰.城市视频监控网络中车辆搜索关键技术研究[D].北京：北京邮电大学，2018.
LIU X C.Research on key techniques of vehicle search in urban video surveillance networks[D].Beijing：Beijing University of Posts and Telecommunications，2018.