自适应特征融合的相关滤波跟踪算法

doi:10.3778/j.issn.1002-8331.2010-0382

摘要/Abstract

摘要： 为提高复杂背景下目标跟踪的鲁棒性，提出一种基于相关滤波的自适应特征融合目标跟踪算法。在HOG特征基础上，增加HSV颜色概率直方图，以此获得准确的位置预测。然后分别训练颜色名和HOG特征，并根据两个响应图的峰值自适应地分配融合系数，进而基于尺度池方法，采用多通道特征实现目标的尺度估计。模型的高置信度更新由两个响应图的平均峰值相关能量（APCE）实现。与五种主流相关滤波跟踪算法在两个基准数据集上进行对比实验，实验结果表明在快速运动、复杂背景、光照变化、尺度变化等复杂跟踪场景下，该算法表现出较好的准确性和稳健性。

关键词: 目标跟踪, 相关滤波, 特征融合, 自适应加权

Abstract: To improve the robustness of target tracking under complex background, an adaptive feature fusion based on correlation filter is proposed. The basis of HOG features, models based on HSV color statistics is as complementary to achieve the accuracy position prediction. Then, the color name and HOG features are trained respectively, and the fusion coefficients are adaptively assigned according to the peak value of the two response graphs. The multi-channel features are used to estimation target scale based on scale pool. Finally, the high-confidence updating of model is implemented by the average peak-to-correlation energy（APCE） of two response maps. Results are compared with 5 state-of-the-art trackers on two benchmark datasets. The experiment result shows that the proposed algorithm can achieve an accurate and robust tracking performance in fast moving, complex background changes, illumination, deformation and other complex tracking scenarios.

Key words: object tracking, correlation filter, feature fusion, adaptive weighting

李彪, 孙瑾, 李星达, 李扬. 自适应特征融合的相关滤波跟踪算法[J]. 计算机工程与应用, 2022, 58(9): 208-218.

LI Biao, SUN Jin, LI Xingda, LI Yang. Correlation Filter Target Tracking Based on Adaptive Multi-Feature Fusion[J]. Computer Engineering and Applications, 2022, 58(9): 208-218.

参考文献

[1] VOJIR T，NOSKOVA J，MATAS J.Robust scale-adaptive mean-shift for tracking[J].Pattern Recognition Letters，2014，49：250-258.
[2] KALMAN R E.A new approach to linear filtering and prediction problems[J].Journal of Basix Engineering，1960，82（1）：35-45.
[3] NUMMIARO K，KOLLER-MEIER E，GOOL L V.An adaptive color-based particle filter[J].Image & Vision Computing，2003，21（1）：99-110.
[4] LIU S，ZHANG T Z，CAO X C，et al.Structural correlation filter for robust visual tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2016：4312-4320.
[5] 张哲，孙瑾，杨刘涛.融合相关滤波与关键点匹配的跟踪算法研究[J].光学学报，2019，39（2）：259-267.
ZHANG Z，SUN J，YANG L T.Tracking algorithm based on correlation filter fusing with keypoint matching[J].Acta Optica Sinica，2019，39（2）：259-267.
[6] BOLME D S，BEVERIDEG J R，DRAPER B A，et al.Visual object tracking using adaptive correlation filters[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition，2010：2544-2550.
[7] HENRIQUES J F，RUI C，MARTINS P，et al.Exploiting the circulant structure of tracking-by-detection with kernels[C]//European Conference on Computer Vision，2012：702-715.
[8] HENRIQUES J F，CASEIRO R，MARTINS P，et al.High speedtracking with kernelized correlation filters[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，37（3）：583-596.
[9] DANELLJAN M，KHAN F S，FELSBERG M，et al.Adaptive color attributes for real-time visual tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2014：1090-1097.
[10] DANELLJAN M，KHAN F S，FELSBERG M，et al.Discriminative scale space tracking[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2016，39（8）：1561-1575.
[11] LI Y，ZHU J K.A scale adaptive kernel correlation filter tracker with feature integration[C]//European Conference on Computer Vision，2014：254-265.
[12] POSSEGGER H，MAUTHNER T，BISCHOF H.In defense of color-based model-free tracking[C]//IEEE Conference on Computer Vision and Pattern Ｒecognition（CVPR），2015：2113-2120．
[13] BERTINETTO L，VALMADRE J，GOLODETZ S，et al.Staple：complementary learners for real-time tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2016：1401-1409.
[14] DSNRLLJSN M，HDGER G KHAN F S，et al.Learning spatially regularized correlation filters for visual tracking[C]//IEEE International Conference on Computer Vision（ICCV），2015：4310-4318.
[15] 陈晨，邓赵红，高艳丽，等.多模糊核融合的单目标跟踪算法[J].计算机科学与探索，2020，14（5）：848-860.
CHEN C，DENG Z H，GAO Y L，et al.Single target tracking algorithm based on multi-fuzzy kernel fusion[J].Journal of Frontiers of Computer Science and Technology，2020，14（5）：848-860.
[16] 杨佳霖，王文伟，熊晓璇，等.快速尺度估计的增强型多核相关滤波算法[J].计算机工程与应用，2020，56（7）：210-220.
YANG J L，WANG W W，XIONG X X，et al.Fast scale estimation based on enhanced multi-kernel correlation filter algorithm[J].Computer Engineering and Applications，2020，56（7）：210-220.
[17] 李福进，刘慧慧，任红格，等.高置信度的尺度自适应核相关跟踪方法[J/OL].激光与光电子学进展.（2020-07-30）[2020-11-04].http：//kns.cnki.net/kcms/detail/31.1690.TN.
20201103.1036.004.html.
LI F J，LIU H H，REN H G，et al.Scale adaptive kernel correlation tracking method with high confidence[J/OL].Laser and Optoelectronics Progress.（2020-07-30）[2020-11-04].http：//kns.cnki.net/kcms/detail/31.1690.TN.20201103.
1036.004.html.
[18] DANELLJAN M，ROBINSON A，KHAN F S，et al.Beyond correlation filters：earning continuous convolution operators for visual tracking[C]//European Conference on Computer Vision（ECCV），2016：472-488.
[19] DANELLJAN M，BHAT G，KHAN F S，et al.ECO：efficient convolution operators for tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2017：6931-6939.
[20] 李宗民，付红姣，刘玉杰，等.融入深度特征的多模板相关滤波跟踪算法[J].计算机辅助设计与图形学学报，2019，31（5）：792-799.
LI Z M，FU H J，LIU Y J，et al.Multi-template correlation filter tracking based on deep feature[J].Journal of Computer-Aided Design and Graphics，2019，31（5）：792-799.
[21] 魏永强，杨小军.深度特征的核相关滤波视觉跟踪[J].计算机工程与应用，2020，56（15）：147-152.
WEI Y Q，YANG X J.Kernel correlation filtering visual tracking of deep feature[J].Computer Engineering and Applications，2020，56（15）：147-152.
[22] 张晓玄，高美凤.特征融合的核相关滤波目标跟踪[J].小型微型计算机系统，2017，38（10）：2385-2389.
ZHANG X X，GAO M F.Kernel correlation filter target tracking based on feature fusion[J].Journal of Chinese Computer Systems，2017，38（10）：2385-2389.
[23] WANG M M，LIU Y，HUANG Z Y.Large margin object tracking with circulant feature maps[C]//IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2017：4800-4808.
[24] WU Y，LI M J，YANG M H.Online object tracking：abenchmark[C]//IEEE Conference on Computer Vision and Pattern Recognition（CVPR），2017：2411-2418.
[25] WU Y，LI M J，YANG M H.Object tracking benchmark[J].IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，37（9）：1834-1848.