计算机工程与应用 ›› 2023, Vol. 59 ›› Issue (5): 194-204.DOI: 10.3778/j.issn.1002-8331.2205-0163

• 图形图像处理 • 上一篇    下一篇

基于改进DeepSORT算法的摩托车头盔佩戴检测

冉险生,张之云,陈卓,苏山杰,陈俊豪   

  1. 重庆交通大学 机电与车辆工程学院,重庆 400047
  • 出版日期:2023-03-01 发布日期:2023-03-01

Motorcycle Helmet Wearing Detection Based on Improved DeepSORT Algorithm

RAN Xiansheng, ZHANG Zhiyun, CHEN Zhuo, SU Shanjie, CHEN Junhao   

  1. School of Mechatronics and Vehicle Engineering, Chongqing Jiaotong University, Chongqing 400047, China
  • Online:2023-03-01 Published:2023-03-01

摘要: 为了解决在实际道路场景中对摩托车驾乘者头盔佩戴情况的检测与跟踪问题,提出一种优化的DeepSORT多目标跟踪摩托车头盔检测算法。使用改进的YOLOv3算法作为目标检测器,该方法采用MobileNetv3-Large作为YOLOv3特征提取网络,以轻量化网络结构,借鉴CEM模块的思想,引入SoftPool池化层和SE模块,构建了深浅语义融合增强模块,加强网络对输入特征深浅语义的编码能力。为了实现摩托车头盔佩戴分类和DeepSORT算法中外观特征识别模型的优化,构建多任务学习框架,通过对比损失函数和改进的交叉损失函数对多任务网络进行迭代训练来提升相似度学习能力和实现最终头盔佩戴情况分类。实验结果表明:在目标检测方面,改进网络的摩托车检测精度相较原始算法提升了4.56个百分点,模型大小仅为YOLOv3的13.7%。结合DeepSORT算法,多目标跟踪准确率相较于YOLOv3-DeepSORT算法从51.6%提升到了67.5%,多目标跟踪精度从57.3%提升到75.6%,检测追踪速度由6?FPS提升到了20?FPS,最终的NPH模型检测分类精度为72.42%。实现了对实际道路中摩托车驾乘人员头盔佩戴检测及追踪,具有较强的实用价值。

关键词: YOLOv3, DeepSORT, 多任务学习, 摩托车头盔佩戴检测

Abstract: To solve the problem of detecting and tracking the helmet-wearing of motorcycle riders in the actual road scene, an optimized DeepSORT multi-target tracking motorcycle helmet detection algorithm is proposed. Using the improved YOLOv3 algorithms for the target detector, this method first uses MobileNetv3-Large as the YOLOv3 feature extraction network to lighten the network structure, and then draws on the idea of the CEM module, introduces the SoftPool pooling layer and SE. The deep and shallow semantic fusion enhancement module is constructed to enhance the network’s ability to encode the deep and shallow semantics of the input features. To realize the optimization of the motorcycle helmet wearing classification and the appearance feature recognition model in the DeepSORT algorithm, a multi-task learning framework is constructed. The multi-task network is iteratively trained by comparing the loss function and the improved cross loss function to improve the similarity learning ability and achieve the final helmet wearing situation classification. The experimental results show that: in terms of target detection, the motorcycle detection accuracy of the improved network is improved by 4.56?percentage points compared with the original algorithm, and the model size is only 13.7% of that of YOLOv3. Combined with the DeepSORT algorithm, the multi-target tracking accuracy has increased from 51.6% to 67.5% compared with the YOLOv3-DeepSORT algorithm, the multi-target tracking accuracy has increased from 57.3% to 75.6%, and the detection and tracking speed has increased from 6?FPS to 20?FPS. The final NPH model detection classification accuracy is 72.42%. It realizes the detection and tracking of helmet wearing of motorcycle drivers on actual roads and has strong practical value.

Key words: YOLOv3, DeepSORT, multi-task learning, motorcycle helmet wearing detection