Global Instance Tracking: Locating Target More Like Humans
Not on the map. Why?
Abstract (arXiv)
Target tracking, the essential ability of the human visual system, has been simulated by computer vision tasks. However, existing trackers perform well in austere experimental environments but fail in challenges like occlusion and fast motion. The massive gap indicates that researches only measure tracking performance rather than intelligence. How to scientifically judge the intelligence level of trackers? Distinct from decision-making problems, lacking three requirements (a challenging task, a fair environment, and a scientific evaluation procedure) makes it strenuous to answer the question. In this article, we first propose the global instance tracking (GIT) task, which is supposed to search an arbitrary user-specified instance in a video without any assumptions about camera or motion consistency, to model the human visual tracking ability. Whereafter, we construct a high-quality and large-scale benchmark VideoCube to create a challenging environment. Finally, we design a scientific evaluation procedure using human capabilities as the baseline to judge tracking intelligence. Additionally, we provide an online platform with toolkit and an updated leaderboard. Although the experimental results indicate a definite gap between trackers and humans, we expect to take a step forward to generate authentic human-like trackers. The database, toolkit, evaluation server, and baseline results are available at http://videocube.aitestunion.com.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 33 of its 72 references that are in the map. First posted on arXiv 26 Feb 2022.
Builds on
33 of 72 references.
References · 33
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 566
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 471
- 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
- 2018SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networkscited by 445
- 2019YOLACT: Real-time Instance Segmentationcited by 441
- 2019Learning Discriminative Model Prediction for Trackingcited by 344
- 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 342
- 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
- 2016ECO: Efficient Convolution Operators for Trackingcited by 239
- 2020Probabilistic Regression for Visual Trackingcited by 231
21 more
- 2020Ocean: Object-aware Anchor-free Trackingcited by 212
- 2018Markerless tracking of user-defined features with deep learningcited by 203
- 2018Distractor-aware Siamese Networks for Visual Object Trackingcited by 187
- 2019SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelinescited by 177
- 2019Siam R-CNN: Visual Tracking by Re-Detectioncited by 174
- 2019Deeper and Wider Siamese Networks for Real-Time Visual Trackingcited by 156
- 2019SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Trackingcited by 147
- 2017Need for Speed: A Benchmark for Higher Frame Rate Object Trackingcited by 137
- 2020LaSOT: A High-quality Large-scale Single Object Tracking Benchmarkcited by 130
- 2019Deep Learning in Video Multi-Object Tracking: A Surveycited by 107
- 2020High-Performance Long-Term Tracking with Meta-Updatercited by 79
- 2016Learning Spatially Regularized Correlation Filters for Visual Trackingcited by 66
- 2017Learning Background-Aware Correlation Filters for Visual Trackingcited by 65
- 2019Deep Learning for Visual Tracking: A Comprehensive Surveycited by 60
- 2019GlobalTrack: A Simple and Strong Baseline for Long-term Trackingcited by 57
- 2018Long-term Tracking in the Wild: A Benchmarkcited by 55
- 2016Discriminative Correlation Filter with Channel and Spatial Reliabilitycited by 45
- 2019'Skimming-Perusal' Tracking: A Framework for Real-Time and Robust Long-term Trackingcited by 34
- 2017DCFNet: Discriminant Correlation Filters Network for Visual Trackingcited by 11
- 2017Recurrent Filter Learning for Visual Trackingcited by 4
- 2017The NLTK FrameNet API: Designing for Discoverability with a Rich Linguistic Resourcecited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 9; 2025: 5; 2026: 2.
18 papers.
Sort:
By area:
- 2024DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLMcited by 24
- 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMscited by 16
- 2024BioDrone: A Bionic Drone-based Single Object Tracking Benchmark for Robust Visioncited by 13
- 2024RTracker: Recoverable Tracking via PN Tree Structured Memorycited by 12
- 2024DTVLT: A Multi-modal Diverse Text Benchmark for Visual Language Tracking Based on LLMcited by 12
- 2022SOTVerse: A User-defined Task Space of Single Object Trackingcited by 10
- 2024Visual Language Tracking with Multi-modal Interaction: A Robust Benchmarkcited by 10
- 2024How Texts Help? A Fine-grained Evaluation to Reveal the Role of Language in Vision-Language Trackingcited by 10
- 2025CSTrack: Enhancing RGB-X Tracking via Compact Spatiotemporal Featurescited by 10
- 2025ATCTrack: Aligning Target-Context Cues with Dynamic Target States for Robust Vision-Language Trackingcited by 10
- 2024Enhancing Vision-Language Tracking by Effectively Converting Textual Cues into Visual Cuescited by 8
- 2023Tracking Skiers from the Top to the Bottomcited by 6
6 more
- 2025MITracker: Multi-View Integration for Visual Object Trackingcited by 5
- 2024Arbitrary Time Information Modeling via Polynomial Approximation for Temporal Knowledge Graph Embeddingcited by 2
- 2024UAV (Unmanned Aerial Vehicles): Diverse Applications of UAV Datasets in Segmentation, Classification, Detection, and Trackingcited by 2
- 2025Progressive Scaling Visual Object Trackingcited by 1
- 2026Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Trackingcited by 1
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptationcited by 0
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation2 Apr 2026
- 2026Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking3 Jan 2026
- 2025ATCTrack: Aligning Target-Context Cues with Dynamic Target States for Robust Vision-Language Tracking26 Jul 2025
- 2025Progressive Scaling Visual Object Tracking26 May 2025
- 2025CSTrack: Enhancing RGB-X Tracking via Compact Spatiotemporal Features26 May 2025
- 2025MITracker: Multi-View Integration for Visual Object Tracking27 Feb 2025
- 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMs8 Jan 2025
- 2024Enhancing Vision-Language Tracking by Effectively Converting Textual Cues into Visual Cues27 Dec 2024
- 2024How Texts Help? A Fine-grained Evaluation to Reveal the Role of Language in Vision-Language Tracking23 Nov 2024
- 2024DTVLT: A Multi-modal Diverse Text Benchmark for Visual Language Tracking Based on LLM3 Oct 2024
- 2024Visual Language Tracking with Multi-modal Interaction: A Robust Benchmark13 Sep 2024
- 2024UAV (Unmanned Aerial Vehicles): Diverse Applications of UAV Datasets in Segmentation, Classification, Detection, and Tracking5 Sep 2024
6 more
- 2024DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLM20 May 2024
- 2024Arbitrary Time Information Modeling via Polynomial Approximation for Temporal Knowledge Graph Embedding1 May 2024
- 2024RTracker: Recoverable Tracking via PN Tree Structured Memory28 Mar 2024
- 2024BioDrone: A Bionic Drone-based Single Object Tracking Benchmark for Robust Vision7 Feb 2024
- 2023Tracking Skiers from the Top to the Bottom15 Dec 2023
- 2022SOTVerse: A User-defined Task Space of Single Object Tracking15 Apr 2022
- 2024DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLMcited by 24
- 2024BioDrone: A Bionic Drone-based Single Object Tracking Benchmark for Robust Visioncited by 13
- 2024RTracker: Recoverable Tracking via PN Tree Structured Memorycited by 12
- 2024DTVLT: A Multi-modal Diverse Text Benchmark for Visual Language Tracking Based on LLMcited by 12
- 2022SOTVerse: A User-defined Task Space of Single Object Trackingcited by 10
- 2024Visual Language Tracking with Multi-modal Interaction: A Robust Benchmarkcited by 10
- 2024How Texts Help? A Fine-grained Evaluation to Reveal the Role of Language in Vision-Language Trackingcited by 10
- 2025CSTrack: Enhancing RGB-X Tracking via Compact Spatiotemporal Featurescited by 10
- 2025ATCTrack: Aligning Target-Context Cues with Dynamic Target States for Robust Vision-Language Trackingcited by 10
- 2024Enhancing Vision-Language Tracking by Effectively Converting Textual Cues into Visual Cuescited by 8
- 2023Tracking Skiers from the Top to the Bottomcited by 6
- 2025MITracker: Multi-View Integration for Visual Object Trackingcited by 5
12 most cited of 17 All 17 (JSON)
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation2 Apr 2026
- 2026Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking3 Jan 2026
- 2025ATCTrack: Aligning Target-Context Cues with Dynamic Target States for Robust Vision-Language Tracking26 Jul 2025
- 2025Progressive Scaling Visual Object Tracking26 May 2025
- 2025CSTrack: Enhancing RGB-X Tracking via Compact Spatiotemporal Features26 May 2025
- 2025MITracker: Multi-View Integration for Visual Object Tracking27 Feb 2025
- 2024Enhancing Vision-Language Tracking by Effectively Converting Textual Cues into Visual Cues27 Dec 2024
- 2024How Texts Help? A Fine-grained Evaluation to Reveal the Role of Language in Vision-Language Tracking23 Nov 2024
- 2024DTVLT: A Multi-modal Diverse Text Benchmark for Visual Language Tracking Based on LLM3 Oct 2024
- 2024Visual Language Tracking with Multi-modal Interaction: A Robust Benchmark13 Sep 2024
- 2024UAV (Unmanned Aerial Vehicles): Diverse Applications of UAV Datasets in Segmentation, Classification, Detection, and Tracking5 Sep 2024
- 2024DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLM20 May 2024
12 newest of 17 All 17 (JSON)