GlobalTrack: A Simple and Strong Baseline for Long-term Tracking
Not on the map. Why?
Abstract (arXiv)
A key capability of a long-term tracker is to search for targets in very large areas (typically the entire image) to handle possible target absences or tracking failures. However, currently there is a lack of such a strong baseline for global instance search. In this work, we aim to bridge this gap. Specifically, we propose GlobalTrack, a pure global instance search based tracker that makes no assumption on the temporal consistency of the target's positions and scales. GlobalTrack is developed based on two-stage object detectors, and it is able to perform full-image and multi-scale search of arbitrary instances with only a single query as the guide. We further propose a cross-query loss to improve the robustness of our approach against distractors. With no online learning, no punishment on position or scale changes, no scale smoothing and no trajectory refinement, our pure global instance search based tracker achieves comparable, sometimes much better performance on four large-scale tracking benchmarks (i.e., 52.1% AUC on LaSOT, 63.8% success rate on TLP, 60.3% MaxGM on OxUvA and 75.4% normalized precision on TrackingNet), compared to state-of-the-art approaches that typically require complex post-processing. More importantly, our tracker runs without cumulative errors, i.e., any type of temporary tracking failures will not affect its performance on future frames, making it ideal for long-term tracking. We hope this work will be a strong baseline for long-term tracking and will stimulate future works in this area. Code is available at https://github.com/huanglianghua/GlobalTrack.
Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 12; 2023: 8; 2024: 7; 2025: 8; 2026: 6.
57 papers.
Sort:
By area:
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 126
- 2022Transforming Model Prediction for Trackingcited by 117
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 91
- 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
- 2021Anti-UAV: A Large Multi-Modal Benchmark for UAV Trackingcited by 31
- 2023EgoTracks: A Long-term Egocentric Visual Object Tracking Datasetcited by 27
- 2023All in One: Exploring Unified Vision-Language Tracking with Multi-Modal Alignmentcited by 27
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Trackingcited by 26
38 more
- 2022Visual Object Tracking in First Person Visioncited by 25
- 2024Mamba-FETrack: Frame-Event Tracking via State Space Modelcited by 22
- 2021Is First Person Vision Challenging for Object Tracking?cited by 21
- 2022Global Instance Tracking: Locating Target More Like Humanscited by 18
- 2021Dynamic Attention guided Multi-Trajectory Analysis for Single Object Trackingcited by 17
- 2024BioDrone: A Bionic Drone-based Single Object Tracking Benchmark for Robust Visioncited by 13
- 2021Distractor-Aware Fast Tracking via Dynamic Convolutions and MOT Philosophycited by 11
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baselinecited by 11
- 2022Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysiscited by 11
- 2022Beyond SOT: Tracking Multiple Generic Objects at Oncecited by 11
- 2023Siamese-DETR for Generic Multi-Object Trackingcited by 11
- 2022SOTVerse: A User-defined Task Space of Single Object Trackingcited by 10
- 2022Global Tracking via Ensemble of Local Trackerscited by 8
- 2025CST Anti-UAV: A Thermal Infrared Benchmark for Tiny UAV Tracking in Complex Scenescited by 8
- 2021Tracking by Joint Local and Global Search: A Target-aware Attention based Approachcited by 7
- 2021Cross-Modal Object Tracking: Modality-Aware Representations and A Unified Benchmarkcited by 7
- 2023RGB-T Tracking Based on Mixed Attentioncited by 7
- 2023Z-GMOT: Zero-shot Generic Multiple Object Trackingcited by 7
- 2023Prototype-based Cross-Modal Object Trackingcited by 7
- 2023Tracking Skiers from the Top to the Bottomcited by 6
- 2025FocusTrack: A Self-Adaptive Local Sampling Algorithm for Efficient Anti-UAV Trackingcited by 5
- 2023FastBlend: a Powerful Model-Free Toolkit Making Video Stylization Easiercited by 3
- 2024Multi-step Temporal Modeling for UAV Trackingcited by 3
- 2025A Simple Detector with Frame Dynamics is a Strong Trackercited by 3
- 2021Updatable Siamese Tracker with Two-stage One-shot Learningcited by 2
- 2022CoCoLoT: Combining Complementary Trackers in Long-Term Visual Trackingcited by 2
- 2024TP-GMOT: Tracking Generic Multiple Object by Textual Prompt with Motion-Appearance Cost (MAC) SORTcited by 2
- 2025COST: Contrastive One-Stage Transformer for Vision-Language Small Object Trackingcited by 2
- 2025UniSOT: A Unified Framework for Multi-Modality Single Object Trackingcited by 2
- 2021Deep Convolutional Correlation Iterative Particle Filter for Visual Trackingcited by 1
- 2021Rank-based verification for long-term face tracking in crowded scenescited by 1
- 2024Multi-attention Associate Prediction Network for Visual Trackingcited by 1
- 2024DINTR: Tracking via Diffusion-based Interpolationcited by 1
- 2025UAUTrack: Towards Unified Multimodal Anti-UAV Visual Trackingcited by 1
- 2026AR2-4FV: Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View Videoscited by 1
- 2021Single Object Tracking through a Fast and Effective Single-Multiple Model Convolutional Neural Networkcited by 0
- 2021Recursive Least-Squares Estimator-Aided Online Learning for Visual Trackingcited by 0
- 2024POPCat: Propagation of particles for complex annotation taskscited by 0
50 most cited of 57 All 57 (JSON)
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026Counterfactual Motion Reliability Learning for Robust UAV Tracking25 Jul 2026
- 2026Cross-Modal UAV Object Tracking: State-Aware Representation Learning and A Unified Benchmark21 Jul 2026
- 2026Reference-based Category Discovery: Unsupervised Object Detection with Category Awareness6 May 2026
- 2026AR2-4FV: Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View Videos8 Mar 2026
- 2026GOT-JEPA: Generic Object Tracking with Model Adaptation and Occlusion Handling using Joint-Embedding Predictive Architecture16 Feb 2026
- 2025Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation4 Dec 2025
- 2025UAUTrack: Towards Unified Multimodal Anti-UAV Visual Tracking2 Dec 2025
- 2025UniSOT: A Unified Framework for Multi-Modality Single Object Tracking3 Nov 2025
- 2025CST Anti-UAV: A Thermal Infrared Benchmark for Tiny UAV Tracking in Complex Scenes31 Jul 2025
- 2025Class Agnostic Instance-level Descriptor for Visual Instance Search20 Jun 2025
- 2025A Simple Detector with Frame Dynamics is a Strong Tracker8 May 2025
38 more
- 2025FocusTrack: A Self-Adaptive Local Sampling Algorithm for Efficient Anti-UAV Tracking18 Apr 2025
- 2025COST: Contrastive One-Stage Transformer for Vision-Language Small Object Tracking2 Apr 2025
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2024TP-GMOT: Tracking Generic Multiple Object by Textual Prompt with Motion-Appearance Cost (MAC) SORT4 Sep 2024
- 2024POPCat: Propagation of particles for complex annotation tasks24 Jun 2024
- 2024Mamba-FETrack: Frame-Event Tracking via State Space Model28 Apr 2024
- 2024Multi-attention Associate Prediction Network for Visual Tracking25 Mar 2024
- 2024Multi-step Temporal Modeling for UAV Tracking7 Mar 2024
- 2024BioDrone: A Bionic Drone-based Single Object Tracking Benchmark for Robust Vision7 Feb 2024
- 2023Prototype-based Cross-Modal Object Tracking22 Dec 2023
- 2023Tracking Skiers from the Top to the Bottom15 Dec 2023
- 2023FastBlend: a Powerful Model-Free Toolkit Making Video Stylization Easier15 Nov 2023
- 2023Siamese-DETR for Generic Multi-Object Tracking27 Oct 2023
- 2023All in One: Exploring Unified Vision-Language Tracking with Multi-Modal Alignment7 Jul 2023
- 2023Z-GMOT: Zero-shot Generic Multiple Object Tracking28 May 2023
- 2023RGB-T Tracking Based on Mixed Attention9 Apr 2023
- 2023EgoTracks: A Long-term Egocentric Visual Object Tracking Dataset9 Jan 2023
- 2022Beyond SOT: Tracking Multiple Generic Objects at Once22 Dec 2022
- 2022Visual Object Tracking in First Person Vision27 Sep 2022
- 2022Towards Grand Unification of Object Tracking14 Jul 2022
- 2022Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysis9 May 2022
- 2022CoCoLoT: Combining Complementary Trackers in Long-Term Visual Tracking9 May 2022
- 2022SOTVerse: A User-defined Task Space of Single Object Tracking15 Apr 2022
- 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baseline8 Apr 2022
- 2022Global Tracking via Ensemble of Local Trackers30 Mar 2022
- 2022Transforming Model Prediction for Tracking21 Mar 2022
- 2022Global Instance Tracking: Locating Target More Like Humans26 Feb 2022
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baseline11 Feb 2022
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Tracking19 Jan 2022
- 2021Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking28 Dec 2021
- 2021Cross-Modal Object Tracking: Modality-Aware Representations and A Unified Benchmark8 Nov 2021
- 2021Is First Person Vision Challenging for Object Tracking?31 Aug 2021
- 2021Learn to Match: Automatic Matching Network Design for Visual Tracking2 Aug 2021
- 2021Rank-based verification for long-term face tracking in crowded scenes28 Jul 2021
- 2021Deep Convolutional Correlation Iterative Particle Filter for Visual Tracking7 Jul 2021
- 2021Tracking by Joint Local and Global Search: A Target-aware Attention based Approach9 Jun 2021
- 2021Updatable Siamese Tracker with Two-stage One-shot Learning30 Apr 2021
- 2021Distractor-Aware Fast Tracking via Dynamic Convolutions and MOT Philosophy25 Apr 2021
50 newest of 57 All 57 (JSON)
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baselinecited by 11
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baseline11 Feb 2022
- 2024Mamba-FETrack: Frame-Event Tracking via State Space Modelcited by 22
- 2024Mamba-FETrack: Frame-Event Tracking via State Space Model28 Apr 2024
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 126
- 2022Transforming Model Prediction for Trackingcited by 117
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 91
- 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
- 2021Anti-UAV: A Large Multi-Modal Benchmark for UAV Trackingcited by 31
- 2023EgoTracks: A Long-term Egocentric Visual Object Tracking Datasetcited by 27
- 2023All in One: Exploring Unified Vision-Language Tracking with Multi-Modal Alignmentcited by 27
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Trackingcited by 26
12 most cited of 53 All 53 (JSON)
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026Counterfactual Motion Reliability Learning for Robust UAV Tracking25 Jul 2026
- 2026Cross-Modal UAV Object Tracking: State-Aware Representation Learning and A Unified Benchmark21 Jul 2026
- 2026Reference-based Category Discovery: Unsupervised Object Detection with Category Awareness6 May 2026
- 2026AR2-4FV: Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View Videos8 Mar 2026
- 2026GOT-JEPA: Generic Object Tracking with Model Adaptation and Occlusion Handling using Joint-Embedding Predictive Architecture16 Feb 2026
- 2025Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation4 Dec 2025
- 2025UAUTrack: Towards Unified Multimodal Anti-UAV Visual Tracking2 Dec 2025
- 2025UniSOT: A Unified Framework for Multi-Modality Single Object Tracking3 Nov 2025
- 2025CST Anti-UAV: A Thermal Infrared Benchmark for Tiny UAV Tracking in Complex Scenes31 Jul 2025
- 2025Class Agnostic Instance-level Descriptor for Visual Instance Search20 Jun 2025
- 2025A Simple Detector with Frame Dynamics is a Strong Tracker8 May 2025
12 newest of 53 All 53 (JSON)