面向多目标跟踪系统的专用循环目标检测器

doi:10.3778/j.issn.1002-8331.2101-0222

摘要/Abstract

摘要： 多目标跟踪技术在视频分析、信号处理等领域有着广泛的应用。在现代多目标跟踪系统通常遵循的“按检测跟踪”模式中，目标检测器的性能决定了多目标跟踪任务的跟踪精度和速度。为提高多目标跟踪系统跟踪性能，提出了面向多目标跟踪系统的专用循环目标检测器，它利用视频帧序列间高度相似性的特点，依据先前帧的目标位置信息和当前帧相对于先前帧的变化得分图来选取候选框，解决了传统二阶段目标检测器中使用候选框推荐网络带来的参数量和计算量大的问题，同时融合了目标外观特征提取分支，进一步减少了多目标跟踪系统整体运行时间。实验表明，专用循环目标检测器及其他最先进的检测器分别应用于多目标跟踪系统，采用专用循环目标检测器时能够在保证多目标跟踪系统跟踪精度的情况下提升跟踪速度。

关键词: 多目标跟踪, 目标检测, 目标外观特征

Abstract: Multiple object tracking technology has been widely applied in video analysis, signal processing and other fields. The object detector’s performance determines the tracking accuracy and speed, in the “tracking by detection” mode that modern multiple object tracking systems usually follow. A dedicated cyclic detector is proposed to improve the tracking performance, which uses the characteristics of high similarity between video frames. The candidate frame is selected by considering object position information in the previous frame, and variation score map of current frame relative to the previous frame, which solves the problem of large parameters and calculations caused by region proposal network in traditional two-stage target detector. At the same time, dedicated cyclic detector integrating the object appearance feature extraction branch can further reduce the overall running time of multiple object tracking system. Dedicated cyclic detector and other state-of-the-art detectors are respectively applied to multiple object tracking system. Experimental results prove that dedicated cyclic detector can improve the tracking speed while ensuring the tracking accuracy.

Key words: multiple object tracking, object detection, appearance feature

牛嘉丰, 石蕴玉, 刘翔, 贺桢, 戴佩哲. 面向多目标跟踪系统的专用循环目标检测器[J]. 计算机工程与应用, 2022, 58(18): 188-194.

NIU Jiafeng, SHI Yunyu, LIU Xiang, HE Zhen, DAI Peizhe. Dedicated Cyclic Detector for Multiple Object Tracking[J]. Computer Engineering and Applications, 2022, 58(18): 188-194.

参考文献

[1] GIRSHICK R，DONAHUE J，DARRELL T，et al.Rich feature hierarchies for accurate object detection and semantic segmentation[C]//27th IEEE Conference on Computer Vision and Pattern Recognition，Columbus，Jun 23-28，2014：580-587.
[2] GIRSHICK R.Fast r-cnn[C]//IEEE International Conference on Computer Vision，Santiago，Dec 11-18，2015：1440-1448.
[3] REN S Q，HE K M，GIRSHICK R，et al.Faster R-CNN：towards real-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，39（6）：1137-1149.
[4] CAI Z W，VASCONCELOS N.Cascade R-CNN：delving into high quality object detection[C]//Proceedings of the 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition，Salt Lake City，Jun 18-23，2018.Piscataway：IEEE，2018：6154-6162.
[5] REDMON J，DIVVALA S，GIRSHICK R，et al.You only look once：unified，real-time object detection[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition，Seattle，Jun 27-30，2016：779-788.
[6] ZHU J，YANG H，LIU N，et al.Online multi-object tracking with dual matching attention networks[J].arXiv：1506.02640，
2016.
[7] WANG C Y，LIAO H Y，WU Y H，et al.Cspnet：a new backbone that can enhance learning capability of CNN[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshop，Seattle，Jun 16-20，2020.Piscataway：IEEE，2020：390-391.
[8] LIU S，QI L，QIN H F，et al.Path aggregation network for instance segmentation[C]//Proceedings of the 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition，Salt Lake City，Jun 18-23，2018.Piscataway：IEEE，2018，8759-8768.
[9] ESS A，LEIBE B，SCHINDLER K，et al.A mobile vision system for robust multi-person tracking[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，Anchorage，Jun 23-28，2008.Piscataway：IEEE，2008：1857-1864.
[10] ZHANG S S，BENENSON R，SCHIELE B，et al.Citypersons：adiverse dataset for pedestrian detection[C]//Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern，Honolulu，Jul 21-26，2017.Piscataway：IEEE，2017：4457-4465.
[11] DOLLAR P，WOJEK C，SCHIELE B，et al.Pedestrian detection：a benchmark[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops，Miami Beach，Jun 20-25，2009.Piscataway：IEEE，2009：304-311.
[12] MILAN A，LEAL-TAIXE L，REID I，et al.Mot16：a benchmark for multi-object tracking[J].arXiv：1603.00831，2016.
[13] XIAO T，LI S，WANG B C，et al.Joint detection and identification feature learning for person search[C]//Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition，Honolulu，Jul 21-26，2017.Piscataway：IEEE，2017：3376-3385.
[14] ZHENG L，ZHANG H H，SUN S Y，et al.Person reidentification in the wild[C]//Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition，Honolulu，Jul 21-26，2017.Piscataway：IEEE，2017：3346-3355.
[15] ZHENG L，SHEN L Y，TIAN L，et al.Scalable person reidentifi-cation：a benchmark[C]//Proceedings of the IEEE International Conference on Computer Vision，Santiago，Dec 11-18，2015.Piscataway：IEEE，2015：1116-1124.
[16] HUANG Z Y，ZHU H Y，ZHOU T Y，et al.Deep residual learning for image recognition[C]//Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition，Seattle，Jun 27-30，2016.Piscataway：IEEE，2019：770-778.
[17] LEAL-TAIXE L，MILAN A，REID I，et al.Motchallenge 2015：towards a benchmark for multi-target tracking[J].arXiv：1504.01942，2015.
[18] WOJKE N，BEWLEY A，PAULUS D，et al.Simple online and realtime tracking with a deep association metric[C]//Proceedings of the 24th IEEE International Conference on Image Processing，Beijing，Sep 17-20，2017.Piscataway：IEEE，2017：3645-3649.
[19] ZHOU Z W，XING J L，ZHANG M D，et al.Online multi-target tracking with tensor-based high-order graph matching[C]//Proceedings of the 24th International Conference on Pattern Recognition，Chinese Acad Sci，Inst Automat，Beijing，Aug 20-24，2018.Piscataway：IEEE，2018：1809-1814.
[20] FANG K，XIANG Y，LI X C，et al.Recurrent autoregressive networks for online multi-object tracking[C]//Proceedings of the 18th IEEE Winter Conference on Applications of Computer Vision，NV，Mar 12-15，2018.Piscataway：IEEE，2018：466-475.
[21] YU F W，LI W B，LI Q Q，et al.Poi：multiple object tracking with high performance detection and appearance feature[C]//Proceedings of the 14th European Conference on Computer Vision，Amsterdam，Oct 08-16，2016.Heidelberg：Springer，2016：36-42.
[22] HE K M，GKIOXARI G，DOLLAR P，et al.Maskr-CNN[C]//Proceedings of the 16th IEEE International Conference on Computer Vision，Venice，Oct 22-29，2017.Piscataway：IEEE，2017：2980-2988.
[23] SZEGEDY C，LIU W，JIA Y Q，et al.Going deeper with convolutions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，Boston，Jun 07-12，2015.Piscataway：IEEE，2015：1-9.
[24] LIU Y，YAN J J，OUYANG W L，et al.Quality aware network for set to set recognition[C]//Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition，Honolulu，Jul 21-26，2017.Piscataway：IEEE，2017：4694-4703.
[25] ZAGORUYKO S，KOMODAKIS N.Wide residual networks[J].arXiv：1605.07146，2016.
[26] ZHENG L，BIE Z，SUN Y F，et al.Mars：a video benchmark for large-scale person re-identification[C]//Proceedings of the 14th European Conference on Computer Vision，Amsterdam，Oct 08-16，2016.Heidelberg：Springer，2016：868-884.