Research on Pedestrian Multi-Object Tracking Algorithm for Intelligent Driving

doi:10.3778/j.issn.1002-8331.2204-0105

Abstract

Abstract: Multi-object tracking（MOT） is a research hotspot in intelligent driving scenarios. Most modern MOT networks follow the “tracking-by-detection” paradigm, and the trajectory association of tracked objects is one of the hotspots that needs to be solved urgently. Aiming at the problem of missing detection caused by scene confusion and accidental occlusion caused by overlapping objects, which increases the difficulty of data association, a multi-object tracking algorithm PDTNet for intelligent driving that integrates attention mechanism and anchor-free detection is proposed. Firstly, the pyramid segmentation attention module is integrated into the deep aggregation network to improve the representation ability of multi-scale features. Secondly, a simple re-identification module is designed. The target detection obtained by the anchor-free frame detector is combined with the existing tracking trajectories to perform multi-step matching to achieve robust multi-object tracking. The experimental results show that the effectiveness of the proposed algorithm is verified on the MOT16, MOT17 datasets and BUIISE datasets, and the proposed algorithm improves the detection accuracy, association accuracy and total tracking accuracy of multi-object tracking. It has great application in target tracking scenarios.

Key words: multi-object tracking, intelligent driving, attention mechanism, deep aggregation network

摘要： 多目标跟踪（multi-object tracking，MOT）是智能驾驶场景中的一个研究热点，大多数现代MOT网络遵循“逐检测跟踪”范式，跟踪目标的轨迹关联是其中一个急需解决的热点问题。针对场景混乱以及意外的遮挡造成的对象重叠往往会导致遗漏检测，进而增加了数据关联的难度等问题，提出融合注意力机制和无锚框检测的智能驾驶多目标跟踪算法PDTNet。将金字塔分割注意力模块融入深层聚合网络，提高多尺度特征的表示能力；设计一个简单Re-identification模块，将由无锚框检测器获得的目标检测与已有的跟踪轨迹相结合进行多步匹配，实现强鲁棒性的多目标跟踪。实验结果表明，在MOT16、MOT17数据集和BUUISE数据集上验证了算法的有效性，提高了多目标跟踪的检测准确率、关联准确率以及跟踪总精度等，在智能驾驶多目标跟踪场景中有很大应用。

关键词: 多目标跟踪, 智能驾驶, 注意力机制, 深层聚合网络

YAN Chenyang, LIU Hongzhe, XU Cheng, LI Xuewei. Research on Pedestrian Multi-Object Tracking Algorithm for Intelligent Driving[J]. Computer Engineering and Applications, 2023, 59(15): 206-213.

闫晨阳, 刘宏哲, 徐成, 李学伟. 面向智能驾驶的行人多目标跟踪算法研究[J]. 计算机工程与应用, 2023, 59(15): 206-213.

References

[1] BADUE C，GUIDOLINI R，CARNEIRO R V，et al.Self-driving cars：a survey[J].Expert Systems with Applications，2021，165：113816.
[2] RAVINDRAN R，SANTORA M J，JAMALI M M.Multi-object detection and tracking，based on DNN，for autonomous vehicles：a review[J].IEEE Sensors Journal，2020，21（5）：5668-5677.
[3] CIAPARRONE G，SáNCHEZ F L，TABIK S，et al.Deep learning in video multi-object tracking：a survey[J].Neurocomputing，2020，381：61-88.
[4] SUN Z，CHEN J，CHAO L，et al.A survey of multiple pedestrian tracking based on tracking-by-detection framework[J].IEEE Transactions on Circuits and Systems for Video Technology，2020，31（5）：1819-1833.
[5] 李杰.结合注意力和纹理特征增强的行人再识别[J].计算机科学与探索，2022，16（3）：661-668.
LI J.Attention and texture feature enhancement for person re-identification[J].Jounal of Frontiers of Computer Science and Technology，2022，16（3）：661-668.
[6] 陈璠，彭力.多层级重叠条纹特征融合的行人重识别[J].计算机科学与探索，2021，15（9）：1753-1761.
CHEN F，PENG L.Person re-identification based on multi-level feature fusion with overlapping stripes[J].Jounal of Frontiers of Computer Science and Technology，2021，15（9）：1753-1761.
[7] BEWLEY A，GE Z，OTT L，et al.Simple online and realtime tracking[C]//2016 IEEE International Conference on Image Processing（ICIP），2016：3464-3468.
[8] WOJKE N，BEWLEY A，PAULUS D.Simple online and realtime tracking with a deep association metric[C]//2017 IEEE International Conference on Image Processing（ICIP），2017：3645-3649.
[9] 柳恩涵，张锐，赵硕，等.一种基于视频预测的红外行人目标跟踪方法[J].哈尔滨工业大学学报，2020，52（10）：192-200.
LIU E H，ZHANG R，ZHAO S，et al.Infrared pedestrian target tracking method based on video prediction[J].Journal of Harbin Institute of Technology，2020，52（10）：192-200.
[10] ZHOU X，WANG D，KR?HENBüHL P.Objects as points[J].arXiv：1904.07850，2019.
[11] ZHOU X，KOLTUN V，KR?HENBüHL P.Tracking objects as points[C]//European Conference on Computer Vision.Cham：Springer，2020：474-490.
[12] HU J，SHEN L，SUN G.Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：7132-7141.
[13] WOO S，PARK J，LEE J Y，et al.CBAM：convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision（ECCV），2018：3-19.
[14] ZHANG H，ZU K，LU J，et al.EPSANet：an efficient pyramid squeeze attention block on convolutional neural network[J].arXiv：2105.14447，2021.
[15] YU F，WANG D，SHELHAMER E，et al.Deep layer aggregation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2018：2403-2412.
[16] MILAN A，LEAL-TAIXé L，REID I，et al.MOT16：a benchmark for multi-object tracking[J].arXiv：1603.00831，2016.
[17] BERNARDIN K，STIEFELHAGEN R.Evaluating multiple object tracking performance：the clear mot metrics[J].EURASIP Journal on Image and Video Processing，2008：1-10.
[18] LUITEN J，OSEP A，DENDORFER P，et al.Hota：a higher order metric for evaluating multi-object tracking[J].International Journal of Computer Vision，2021，129（2）：548-578.
[19] STADLER D，BEYERER J.Multi-pedestrian tracking with clusters[C]//2021 17th IEEE International Conference on Advanced Video and Signal Based Surveillance（AVSS），2021：1-10.
[20] PANG B，LI Y，ZHANG Y，et al.Tubetk：adopting tubes to track multi-object in a one-step training model[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2020：6308-6318.
[21] PENG J，WANG C，WAN F，et al.Chained-tracker：chaining paired attentive regression results for end-to-end joint multiple-object detection and tracking[C]//European Conference on Computer Vision.Cham：Springer，2020：145-161.
[22] STADLER D，BEYERER J.Improving multiple pedestrian tracking by track management and occlusion handling[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition，2021：10958-10967.
[23] CHAABANE M，ZHANG P，BEVERIDGE J R，et al.Deft：detection embeddings for tracking[J].arXiv：2102. 02267，2021.