Computer Engineering and Applications ›› 2023, Vol. 59 ›› Issue (24): 88-97.DOI: 10.3778/j.issn.1002-8331.2307-0017

• Pattern Recognition and Artificial Intelligence • Previous Articles     Next Articles

Real-Time Cross-Camera Vehicle Tracking Method for Tunnel Scenes by Fusing Spatiotemporal Features

GOU Lingtao, SONG Huansheng, ZHANG Zhaoyang, WEN Ya, LIU Lichen, SUN Shijie   

  1. School of Information Engineering, Chang’an University, Xi’an 710064, China
  • Online:2023-12-15 Published:2023-12-15

融合时空特征的隧道场景跨相机车辆实时跟踪方法

苟铃滔,宋焕生,张朝阳,文雅,刘莅辰,孙士杰   

  1. 长安大学 信息工程学院,西安 710064

Abstract: Cross-camera vehicle tracking is of great significance for realizing intelligent transportation. In the tunnel scene, the existing target re-identification scheme is difficult to meet the requirements of vehicle tracking accuracy and real-time in practical applications due to the influence of factors such as low environmental illumination and similar characteristics of the same type of vehicles. A cross-camera multi-target tracking method is proposed considering the vehicle type and spatiotemporal characteristics of vehicles in tunnel traffic scenarios. Firstly, the normalized attention module (NAM) is added to the YOLOv7 target detection model to make the model more focused on the region of interest, and combining with the camera calibration method, the vehicle position coordinates are obtained in real space. Secondly, the target position prediction is combined with vehicle velocity based on Kalman filtering, secondary correlation strategy(BYTE) is applied to complete single camera vehicle tracking, and interval frame method is used to improve the tracking speed. Finally, the cross-camera target matching cost matrix based on vehicle type and spatiotemporal characteristics is proposed, and the Hungarian algorithm is used to complete vehicle target matching, so as to realize cross-camera vehicle target tracking and generate the vehicle target spatiotemporal map of the tunnel scene. The experimental results on the cross-camera vehicle target tracking dataset constructed show that the tracking accuracy reaches 82.1%, the overall speed of detection and tracking reaches 115 frames per second, the accuracy of cross-camera target matching reaches 94.9%, and the tracking speed and accuracy are better than other methods.

Key words: cross-camera target tracking, tunnel scene, spatiotemporal feature, attention mechanism, secondary correlation strategy

摘要: 跨相机车辆跟踪对实现智慧交通具有重要意义,在隧道场景中,由于环境照度较低、同型车辆特征相似等因素的影响,现有目标重识别方案难以满足实际应用中对车辆跟踪精度和实时性的要求。考虑隧道交通场景下车辆的车型和时空特征,提出了一种融合时空特征的跨相机多目标跟踪方法。在YOLOv7目标检测模型中加入归一化注意力模块(NAM),使模型更关注感兴趣区域,结合相机标定获得车辆在真实空间中位置坐标。在卡尔曼滤波的基础上结合车辆速度进行目标位置预测,引入二次关联策略(BYTE)完成单相机下车辆跟踪,并使用间隔帧方法提高跟踪速度。提出以车型和时空特征为基础的跨相机目标匹配代价矩阵,采用匈牙利算法完成车辆目标匹配,从而实现跨相机车辆目标跟踪,生成隧道场景的车辆目标时空图。在构建的隧道场景跨相机车辆目标跟踪数据集上实验结果表明:跟踪准确度达到82.1%,检测跟踪整体速度达到115 FPS,跨相机目标匹配正确率达到94.9%,跟踪速度与精度优于其他方法。

关键词: 跨相机目标跟踪, 隧道场景, 时空特征, 注意力机制, 二次关联策略