AutoTrack: Towards High-Performance Visual Tracking for UAV with Automatic Spatio-Temporal Regularization
Not on the map. Why?
Abstract (arXiv)
Most existing trackers based on discriminative correlation filters (DCF) try to introduce predefined regularization term to improve the learning of target objects, e.g., by suppressing background learning or by restricting change rate of correlation filters. However, predefined parameters introduce much effort in tuning them and they still fail to adapt to new situations that the designer did not think of. In this work, a novel approach is proposed to online automatically and adaptively learn spatio-temporal regularization term. Spatially local response map variation is introduced as spatial regularization to make DCF focus on the learning of trust-worthy parts of the object, and global response map variation determines the updating rate of the filter. Extensive experiments on four UAV benchmarks have proven the superiority of our method compared to the state-of-the-art CPU- and GPU-based trackers, with a speed of ~60 frames per second running on a single CPU. Our tracker is additionally proposed to be applied in UAV localization. Considerable tests in the indoor practical scenarios have proven the effectiveness and versatility of our localization method. The code is available at https://github.com/vision4robotics/AutoTrack.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 14; 2023: 11; 2024: 9; 2025: 5; 2026: 7.
62 papers.
Sort:
By area:
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2022Transforming Model Prediction for Trackingcited by 117
- 2021HiFT: Hierarchical Feature Transformer for Aerial Trackingcited by 72
- 2022TCTrack: Temporal Contexts for Aerial Trackingcited by 69
- 2022Unsupervised Domain Adaptation for Nighttime Aerial Trackingcited by 56
- 2021Visual Object Tracking with Discriminative Filters and Siamese Networks: A Survey and Outlookcited by 45
- 2021SiamAPN++: Siamese Attentional Aggregation Network for Real-Time UAV Trackingcited by 38
- 2021All-Day Object Tracking for Unmanned Aerial Vehiclecited by 28
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Trackingcited by 26
- 2023Towards Real-World Visual Tracking with Temporal Contextscited by 26
- 2025Similarity-Guided Layer-Adaptive Vision Transformer for UAV Trackingcited by 22
- 2025Learning Occlusion-Robust Vision Transformers for Real-Time UAV Trackingcited by 22
38 more
- 2022The State of Aerial Surveillance: A Surveycited by 20
- 2023SGDViT: Saliency-Guided Dynamic Vision Transformer for UAV Trackingcited by 20
- 2021ADTrack: Target-Aware Dual Filter Learning for Real-Time Anti-Dark UAV Trackingcited by 17
- 2023SAM-DA: UAV Tracks Anything at Night with SAM-Powered Domain Adaptationcited by 17
- 2021Siamese Transformer Pyramid Networks for Real-Time UAV Trackingcited by 15
- 2022Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysiscited by 11
- 2021Learning Residue-Aware Correlation Filters and Refining Scale Estimates with the GrabCut for Real-Time UAV Trackingcited by 9
- 2021A Simple and Strong Baseline for Universal Targeted Attacks on Siamese Visual Trackingcited by 9
- 2023Towards Discriminative Representations with Contrastive Instances for Real-Time UAV Trackingcited by 9
- 2024Progressive Representation Learning for Real-Time UAV Trackingcited by 9
- 2022Rank-Based Filter Pruning for Real-Time UAV Trackingcited by 8
- 2023VoxDet: Voxel Learning for Novel Instance Detectioncited by 8
- 2022Local Perception-Aware Transformer for Aerial Trackingcited by 6
- 2021Predictive Visual Tracking: A New Benchmark and Baseline Approachcited by 5
- 2022Ad2Attack: Adaptive Adversarial Attack on Real-Time UAV Trackingcited by 5
- 2022PVT++: A Simple End-to-End Latency-Aware Visual Tracking Frameworkcited by 5
- 2023Learning Disentangled Representation with Mutual Information Maximization for Real-Time UAV Trackingcited by 5
- 2022GUSOT: Green and Unsupervised Single Object Tracking for Long Video Sequencescited by 4
- 2023BACTrack: Building Appearance Collection for Aerial Trackingcited by 4
- 2026UAV-Track VLA: Embodied Aerial Tracking via Vision-Language-Action Modelscited by 4
- 2021UAV-ReID: A Benchmark on Unmanned Aerial Vehicle Re-identification in Video Imagerycited by 3
- 2021Equivalence of Correlation Filter and Convolution Filter in Visual Trackingcited by 3
- 2023Continuity-Aware Latent Interframe Information Mining for Reliable UAV Trackingcited by 3
- 2024Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Trackercited by 3
- 2024Multi-step Temporal Modeling for UAV Trackingcited by 3
- 2022Single Object Tracking Research: A Surveycited by 2
- 2023Mutual-Learning Knowledge Distillation for Nighttime UAV Trackingcited by 2
- 2024Benchmarking the Robustness of UAV Tracking Against Common Corruptionscited by 2
- 2024Low-Light Object Tracking: A Benchmarkcited by 2
- 2022Siamese Object Tracking for Vision-Based UAM Approaching with Pairwise Scale-Channel Attentioncited by 1
- 2024DaDiff: Domain-aware Diffusion Model for Nighttime UAV Trackingcited by 1
- 2024Learning an Adaptive and View-Invariant Vision Transformer for Real-Time UAV Trackingcited by 1
- 2025TrackingMiM: Efficient Mamba-in-Mamba Serialization for Real-time UAV Object Trackingcited by 1
- 2025Dynamic Semantic-Aware Correlation Modeling for UAV Trackingcited by 1
- 2026Layer-Guided UAV Tracking: Enhancing Efficiency and Occlusion Robustnesscited by 1
- 2026CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Trackingcited by 1
- 2021Tracking Based Semi-Automatic Annotation for Scene Text Videoscited by 0
- 2021SiamReID: Confuser Aware Siamese Tracker with Re-identification Featurecited by 0
50 most cited of 62 All 62 (JSON)
- 2026SBMVTrack: Spike-Budgeted Multi-View Learning for Power-Efficient UAV Tracking21 Sep 2026
- 2026CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Tracking16 Jul 2026
- 2026Banshee: Target Switch Attacks on Gimbal-Stabilized Visual Tracking Systems via Acoustic Injection10 Jul 2026
- 2026Dual-branch Distilled Transformer for Efficient Asymmetric UAV Tracking27 May 2026
- 2026UAV-Track VLA: Embodied Aerial Tracking via Vision-Language-Action Models2 Apr 2026
- 2026STATrack: A Target-Aware Fully Spiking Neural Network for Efficient UAV Tracking29 Mar 2026
- 2026Layer-Guided UAV Tracking: Enhancing Efficiency and Occlusion Robustness14 Feb 2026
- 2025Dynamic Semantic-Aware Correlation Modeling for UAV Tracking24 Oct 2025
- 2025DPTrack:Directional Kernel-Guided Prompt Learning for Robust Nighttime Aerial Tracking17 Oct 2025
- 2025TrackingMiM: Efficient Mamba-in-Mamba Serialization for Real-time UAV Object Tracking2 Jul 2025
- 2025Learning Occlusion-Robust Vision Transformers for Real-Time UAV Tracking12 Apr 2025
- 2025Similarity-Guided Layer-Adaptive Vision Transformer for UAV Tracking9 Mar 2025
38 more
- 2024Learning an Adaptive and View-Invariant Vision Transformer for Real-Time UAV Tracking28 Dec 2024
- 2024DaDiff: Domain-aware Diffusion Model for Nighttime UAV Tracking16 Oct 2024
- 2024Progressive Representation Learning for Real-Time UAV Tracking25 Sep 2024
- 2024Low-Light Object Tracking: A Benchmark21 Aug 2024
- 2024Learning Motion Blur Robust Vision Transformers for Real-Time UAV Tracking7 Jul 2024
- 2024Benchmarking the Robustness of UAV Tracking Against Common Corruptions18 Mar 2024
- 2024Online Multi-spectral Neuron Tracing10 Mar 2024
- 2024Multi-step Temporal Modeling for UAV Tracking7 Mar 2024
- 2024Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Tracker9 Jan 2024
- 2023Mutual-Learning Knowledge Distillation for Nighttime UAV Tracking13 Dec 2023
- 2023BACTrack: Building Appearance Collection for Aerial Tracking11 Dec 2023
- 2023Unsupervised Green Object Tracker (GOT) without Offline Pre-training16 Sep 2023
- 2023Towards Discriminative Representations with Contrastive Instances for Real-Time UAV Tracking22 Aug 2023
- 2023Towards Real-World Visual Tracking with Temporal Contexts20 Aug 2023
- 2023Learning Disentangled Representation with Mutual Information Maximization for Real-Time UAV Tracking20 Aug 2023
- 2023SAM-DA: UAV Tracks Anything at Night with SAM-Powered Domain Adaptation3 Jul 2023
- 2023VoxDet: Voxel Learning for Novel Instance Detection26 May 2023
- 2023Continuity-Aware Latent Interframe Information Mining for Reliable UAV Tracking8 Mar 2023
- 2023SGDViT: Saliency-Guided Dynamic Vision Transformer for UAV Tracking8 Mar 2023
- 2023Self-Supervised RGB-T Tracking with Cross-Input Consistency26 Jan 2023
- 2022Siamese Object Tracking for Vision-Based UAM Approaching with Pairwise Scale-Channel Attention26 Nov 2022
- 2022PVT++: A Simple End-to-End Latency-Aware Visual Tracking Framework21 Nov 2022
- 2022Local Perception-Aware Transformer for Aerial Tracking1 Aug 2022
- 2022GUSOT: Green and Unsupervised Single Object Tracking for Long Video Sequences15 Jul 2022
- 2022Rank-Based Filter Pruning for Real-Time UAV Tracking5 Jul 2022
- 2022Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysis9 May 2022
- 2022Sparse Regularized Correlation Filter for UAV Object Tracking with adaptive Contextual Learning and Keyfilter Selection7 May 2022
- 2022Single Object Tracking Research: A Survey25 Apr 2022
- 2022Transforming Model Prediction for Tracking21 Mar 2022
- 2022Unsupervised Domain Adaptation for Nighttime Aerial Tracking20 Mar 2022
- 2022TCTrack: Temporal Contexts for Aerial Tracking3 Mar 2022
- 2022Ad2Attack: Adaptive Adversarial Attack on Real-Time UAV Tracking3 Mar 2022
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Tracking19 Jan 2022
- 2022The State of Aerial Surveillance: A Survey9 Jan 2022
- 2021Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking28 Dec 2021
- 2021Visual Object Tracking with Discriminative Filters and Siamese Networks: A Survey and Outlook6 Dec 2021
- 2021Siamese Transformer Pyramid Networks for Real-Time UAV Tracking17 Oct 2021
- 2021HiFT: Hierarchical Feature Transformer for Aerial Tracking31 Jul 2021
50 newest of 62 All 62 (JSON)
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2022Transforming Model Prediction for Trackingcited by 117
- 2021HiFT: Hierarchical Feature Transformer for Aerial Trackingcited by 72
- 2022TCTrack: Temporal Contexts for Aerial Trackingcited by 69
- 2022Unsupervised Domain Adaptation for Nighttime Aerial Trackingcited by 56
- 2021Visual Object Tracking with Discriminative Filters and Siamese Networks: A Survey and Outlookcited by 45
- 2021SiamAPN++: Siamese Attentional Aggregation Network for Real-Time UAV Trackingcited by 38
- 2021All-Day Object Tracking for Unmanned Aerial Vehiclecited by 28
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Trackingcited by 26
- 2023Towards Real-World Visual Tracking with Temporal Contextscited by 26
- 2025Similarity-Guided Layer-Adaptive Vision Transformer for UAV Trackingcited by 22
- 2025Learning Occlusion-Robust Vision Transformers for Real-Time UAV Trackingcited by 22
12 most cited of 58 All 58 (JSON)
- 2026SBMVTrack: Spike-Budgeted Multi-View Learning for Power-Efficient UAV Tracking21 Sep 2026
- 2026Banshee: Target Switch Attacks on Gimbal-Stabilized Visual Tracking Systems via Acoustic Injection10 Jul 2026
- 2026Dual-branch Distilled Transformer for Efficient Asymmetric UAV Tracking27 May 2026
- 2026STATrack: A Target-Aware Fully Spiking Neural Network for Efficient UAV Tracking29 Mar 2026
- 2026Layer-Guided UAV Tracking: Enhancing Efficiency and Occlusion Robustness14 Feb 2026
- 2025Dynamic Semantic-Aware Correlation Modeling for UAV Tracking24 Oct 2025
- 2025DPTrack:Directional Kernel-Guided Prompt Learning for Robust Nighttime Aerial Tracking17 Oct 2025
- 2025Learning Occlusion-Robust Vision Transformers for Real-Time UAV Tracking12 Apr 2025
- 2025Similarity-Guided Layer-Adaptive Vision Transformer for UAV Tracking9 Mar 2025
- 2024Learning an Adaptive and View-Invariant Vision Transformer for Real-Time UAV Tracking28 Dec 2024
- 2024Progressive Representation Learning for Real-Time UAV Tracking25 Sep 2024
- 2024Low-Light Object Tracking: A Benchmark21 Aug 2024
12 newest of 58 All 58 (JSON)