Multi-frame Surveillance of Correlation Filter in UAV Object Tracking

doi:10.3778/j.issn.1002-8331.2009-0064

Abstract

Abstract:

Object tracking is one of the key technologies of UAV. UAV object tracking is easy to cause tracking drift or lose due to the influence of scene such as camera motion and scale change. This paper proposes an algorithm, that is multi-frame surveillance of correlation filter in UAV object tracking. By adding multiple frames of information, monitoring the change rate of the response graph according to the aberration of the view. The tracker’s recognition ability is improved effectively. The clipping matrix is used to import the real negative samples, multiple historical frames information is added to improve the robustness of the filter. The Euclidean norm is introduced to define the aberration of response graph, by supervising the change of the aberration to prevent tracking drift, the exact position of the object is obtained. According to the similarity the object model is updated. Compared with other algorithms on the UAV123 and VisDrone2019 datasets. The results show that the algorithm has favourable tracking robustness and precision in camera motion, scale change and other scenes.

Key words: computer vision, object tracking, Unmanned Aerial Vehicle（UAV）, background-aware correlation filters, Euclidean norm, multi-frame surveillance

摘要：

目标跟踪是无人机的关键技术之一。无人机目标跟踪容易因相机运动、尺度变化等场景的影响，导致跟踪漂移或丢失。提出一种多帧监督的相关滤波无人机目标跟踪算法，加入多帧信息，根据视图的像差监督响应图变化率，有效地提高跟踪器的识别能力。采用裁剪矩阵引入真实负样本，并加入多个历史帧信息提高滤波器的鲁棒性。采用欧几里德范数定义响应图的像差，通过监督像差的变化防止跟踪漂移，得到目标的准确位置。根据相似度进行目标模型更新。在UAV123和VisDrone2019数据集上与其他算法对比实验。结果显示该算法在相机运动、尺度变化等场景具有良好的跟踪鲁棒性和精度。

关键词: 计算机视觉, 目标跟踪, 无人机, 背景感知相关滤波, 欧几里德范数, 多帧监督

LIN Shubin, WU Guishan, XU Jiayun, YANG Wenyuan. Multi-frame Surveillance of Correlation Filter in UAV Object Tracking[J]. Computer Engineering and Applications, 2021, 57(24): 152-160.

林淑彬，吴贵山，许甲云，杨文元. 多帧监督的相关滤波无人机目标跟踪[J]. 计算机工程与应用, 2021, 57(24): 152-160.

References

[1] DU D，QI Y，YU H，et al.The unmanned aerial vehicle benchmark：object detection and tracking[C]//European Conference on Computer Vision（ECCV 2018），2018：375-391.
[2] 吴贵山，林淑彬，杨文元.多特征融合的次峰抑制无人机目标跟踪[J].计算机工程与应用，2020，56（14）：104-110.
WU G S，LIN S B，YANG W Y.Sub-peak suppression of multi-feature fusion in UAV object tracking[J].Computer Engineering and Applications，2020，56（14）：104-110.
[3] 龚健雅，季顺平.摄影测量与深度学习[J].测绘学报，2018，47（6）：693-704.
GONG J Y，JI S P.Photogrammetry and deep learning[J].Acta Geodaetica et Cartographica Sinica，2018，47（6）：693-704.
[4] OLIVARES-MENDEZ M A，FU C H，LUDIVIG P，et al.Towards an autonomous vision-based unmanned aerial system against wildlife poachers[J].Sensors，2015，15（12）：31362-31391.
[5] ZUO W M，WU X H，LIN L，et al.Learning support correlation filters for visual tracking[J].IEEE Transactions on Pattern Analysis Machine Intelligence，2019，41（5）：1158-1172.
[6] 朱华勇，牛轶峰，沈林成，等.无人机系统自主控制技术研究现状与发展趋势[J].国防科技大学学报，2010，32（3）：115-120.
ZHU H Y，NIU Y F，SHEN L C，et al.State of the art and trends of autonomous control of UAV systems[J].Journal of National University of Defense Technology，2010，32（3）：115-120.
[7] 费运巧，刘文萍，骆有庆，等.森林病虫害监测中的无人机图像分割算法比较[J].计算机工程与应用，2017，53（8）：216-223.
FEI Y Q，LIU W P，LUO Y Q，et al.Comparison of algorithms for unmanned aerial vehicle image segmentation in monitoring forest diseases and insect pests[J].Computer Engineering and Applications，2017，53（8）：216-223.
[8] ZHU J，WANG D，LU H.Learning temporal-spatial consistency correlation filter for visual tracking[J].Science，2020，50（1）：128-150.
[9] ZHANG K，LI X，SONG H，et al.Visual tracking using spatio-temporally nonlocally regularized correlation filter[J].Pattern Recognition，2018，83：185-195.
[10] MUELLER M，SMITH N，GHANEM B.Context-aware correlation filter tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition，2017：1387-1395.
[11] BOLME D S，BEVERIDGE J R，DRAPER B A，et al.Visual object tracking using adaptive correlation filters[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition，2010：2544-2550.
[12] DANELLJAN M，HAGER G，KHAN F S.Learning spatially regularized correlation filters for visual tracking[C]//IEEE International Conference on Computer Vision，2015：4310-4318.
[13] LI F，TIAN C，ZUO W，et al.Learning spatial-temporal regularized correlation filters for visual tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition，2018：4904-4913.
[14] 陆惟见，尚振宏，刘辉，等.基于多模板的鲁棒运动目标跟踪方法[J].传感器与微系统，2018，37（2）：53-56.
LU W J，SHANG Z H，LIU H，et al.Robust moving object tracking method based on multi-template[J].Transducer and Microsystem Technologies，2018，37（2）：53-56.
[15] 谢颍晓，蔡敬菊，张建林.基于时空采样网络的相关滤波目标跟踪算法[J].国外电子测量技术，2020，39（1）：88-92.
XIE Y X，CAI J J，ZHANG J L.Tracking algorithm of correlation filter via spatiotemporal sampling networks[J].Foreign Electronic Measurement Technology，2020，39（1）：88-92.
[16] FU C H，ZHANG Y Q，HUANG Z Y，et al.Part-based background-aware tracking for UAV with convolutional features[J].IEEE Access，2019，7：79997-80010.
[17] WANG Y，LUO X，DING L，et al.Adaptive sampling for UAV tracking[J].Neural Computing and Applications，2019，31（9）：5029-5043.
[18] LI Y，FU C，DING F，et al.Augmented memory for correlation filters in real-time UAV tracking[J].arXiv：1909.
10989，2019.
[19] HUANG Z，FU C，LI Y，et al.Learning aberrance repressed correlation filters for real-time UAV tracking[C]//IEEE International Conference on Computer Vision，2019：2891-2900.
[20] GALOOGAHI H K，FAGG A，LUCEY S.Learning background-aware correlation filters for visual tracking[C]//IEEE International Conference on Computer Vision，2017：1144-1152.
[21] LI Y M，FU C，DING F Q，et al.Autotrack：towards high-performance visual tracking for UAV with automatic spatio-temporal regularization[C]//IEEE Conference on Computer Vision and Pattern Recognition，2020.
[22] NAM H，HAN B.Learning multi-domain convolutional neural networks for visual tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition，2016：4293-4302.
[23] BERTINETTO L，VALMADRE J，HENRIQUES J F，et al.Fully-convolutional siamese networks for object tracking[C]//Proceedings of the European Conference on Computer Vision，2016：850-865.
[24] VALMADRE J，BERTINETTO L，HENRIQUES J F，et al.End-to-end representation learning for correlation filter based tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition，2017：2805-2813.
[25] FU C H，HUANG Z Y，LI Y M，et al.Boundary effect-aware visual tracking for UAV with online enhanced background learning and multi-frame consensus verification[C]//Computer Vision and Pattern Recognition，2019.
[26] MUELLER M，SMITH N，GHANEM B，et al.A benchmark and simulator for uav tracking[C]//European Conference on Computer Vision，2016：445-461.
[27] DANELLJAN M B G，KHAN F S.ECO：efficient convolution operators for tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition，2016：6638-6646.
[28] WANG N，ZHOU W，TIAN Q，et al.Multi-cue correlation filters for robust visual tracking[C]//IEEE Conference on Computer Vision and Pattern Recognition，2018：4844-4853.
[29] FU C，LIN F，LI Y，et al.Correlation filter-based visual tracking for UAV with online multi-feature learning[J].Remote Sensing，2019，11（5）.