GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
Not on the map. Why?
Abstract (arXiv)
We introduce here a large tracking database that offers an unprecedentedly wide coverage of common moving objects in the wild, called GOT-10k. Specifically, GOT-10k is built upon the backbone of WordNet structure and it populates the majority of over 560 classes of moving objects and 87 motion patterns, magnitudes wider than the most recent similar-scale counterparts. The contributions of this paper are summarized in the following: (1) GOT-10k offers over 10,000 video segments with more than 1.5 million manually labeled bounding boxes, enabling unified training and stable evaluation of deep trackers. (2) GOT-10k is by far the first video trajectory dataset that uses the semantic hierarchy of WordNet to guide class population. (3) For the first time, GOT-10k introduces the one-shot protocol for tracker evaluation, where the training and test classes are zero-overlapped. The protocol avoids biased evaluation results towards familiar objects and it promotes generalization in tracker development. (4) We conduct extensive tracking experiments with 39 typical tracking algorithms on GOT-10k and analyze their results in this paper. (5) Finally, we develop a comprehensive platform for the tracking community that offers full-featured evaluation toolkits, an online evaluation server, and a responsive leaderboard. The annotations of GOT-10k's test data are kept private to avoid tuning parameters on it. The database, toolkits, evaluation server and baseline results are available at http://got-10k.aitestunion.com.
Key facts. Cited by 475 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 77; 2022: 66; 2023: 83; 2024: 87; 2025: 89; 2026: 73.
475 papers.
Sort:
By area:
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 314
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 302
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 281
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
38 more
- 2023Visual Prompt Multi-Modal Trackingcited by 142
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 129
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 126
- 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
- 2022Backbone is All Your Need: A Simplified Architecture for Visual Object Trackingcited by 119
- 2022Transforming Model Prediction for Trackingcited by 117
- 2022Revealing the Dark Secrets of Masked Image Modelingcited by 117
- 2025Streaming Video Question-Answering with In-context Video KV-Cache Retrievalcited by 117
- 2022Global Tracking Transformerscited by 110
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 94
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2023Generalized Relation Modeling for Transformer Trackingcited by 93
- 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 92
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2021LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Searchcited by 82
- 2021Rethinking Self-supervised Correspondence Learning: A Video Frame-level Similarity Perspectivecited by 81
- 2023Robust Object Modeling for Visual Trackingcited by 80
- 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 80
- 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 78
- 2024Autoregressive Queries for Adaptive Tracking with Spatio-TemporalTransformerscited by 76
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2021HiFT: Hierarchical Feature Transformer for Aerial Trackingcited by 72
- 2023HIPTrack: Visual Tracking with Historical Promptscited by 71
- 2024Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performancecited by 70
- 2022TCTrack: Temporal Contexts for Aerial Trackingcited by 69
- 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoningcited by 68
- 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
- 2021DepthTrack : Unveiling the Power of RGBD Trackingcited by 67
- 2024A Distractor-Aware Memory for Visual Object Tracking with SAM2cited by 66
- 2023Single-Model and Any-Modality for Video Object Trackingcited by 65
- 2024OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuningcited by 65
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
- 2022Correlation-Aware Deep Trackingcited by 62
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 62
- 2024Online Video Understanding: OVBench and VideoChat-Onlinecited by 61
- 2022Prompting for Multi-Modal Trackingcited by 59
50 most cited of 475 All 475 (JSON)
- 2026SAM3RL: Memory Control via Reinforcement Learning for Visual Object Tracking14 Oct 2026
- 2026UniMergeTrack: Hierarchical Model Merging for General RGB-X Visual Object Tracking9 Oct 2026
- 2026Every View Counts: View-Consistent Panoptic Quality for Multi-view Panoptic Segmentation5 Oct 2026
- 2026When Predicting Nothing Beats SAM 3: Revisiting Evaluation in Video Object Segmentation2 Oct 2026
- 2026MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos29 Sep 2026
- 2026LoopTrack: A Simple Baseline for Parameter-Efficient Transformer Tracking27 Sep 2026
- 2026SBMVTrack: Spike-Budgeted Multi-View Learning for Power-Efficient UAV Tracking21 Sep 2026
- 2026VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models8 Sep 2026
- 2026Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking7 Sep 2026
- 2026Learning to Track from Privileged Target Appearances2 Sep 2026
- 2026Efficient Language-to-Vision Feature Injection for Referring Single-Object Tracking29 Aug 2026
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning27 Aug 2026
38 more
- 2026Video-FLAIR: Not Whether to Reason, But How27 Aug 2026
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMs20 Aug 2026
- 2026FeedbackTrack: Visual-Cortex-Inspired Cross-Frame Feedback for Transformer Tracking10 Aug 2026
- 2026Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruning2 Aug 2026
- 2026Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking1 Aug 2026
- 2026Semantic-Aware Temporal Adaptation for UAV Anti-UAV Tracking29 Jul 2026
- 2026Counterfactual Motion Reliability Learning for Robust UAV Tracking25 Jul 2026
- 2026Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generation17 Jul 2026
- 2026VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding16 Jul 2026
- 2026AE-UAV: An Air-to-Air Event-Based UAV Tracking Benchmark and a Real-Time Frequency-Domain Tracker16 Jul 2026
- 2026SpecTrack: Spectral Prompt Guided Adaptive Experts for Multispectral Object Tracking7 Jul 2026
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
- 2026Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models1 Jul 2026
- 2026SUMO: Segment and Track Any Motion with Nonlinear State Space Models29 Jun 2026
- 2026MotionAtlas: Detailed Region Captioning for Motion-Centric Videos28 Jun 2026
- 2026Efficient Spatio-Temporal Grounding with Multimodal Large Models via Second-Level Tracking and RL Verification27 Jun 2026
- 2026SENTRY: SAM2-Enhanced Neighbor-Aware and Temporally Reasoned Memory for Visual Tracking23 Jun 2026
- 20264DVLT: Dynamic Scene Understanding with Worldline-Centered Vision-Language Tracking21 Jun 2026
- 2026FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization29 May 2026
- 2026Dual-branch Distilled Transformer for Efficient Asymmetric UAV Tracking27 May 2026
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking26 May 2026
- 2026Segment Anything with Motion, Geometry, and Semantic Adaptation for Complex Nonlinear Visual Object Tracking21 May 2026
- 2026Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning21 May 2026
- 2026An Efficient Token Compression Framework for Visual Object Tracking8 May 2026
- 2026RELO: Reinforcement Learning to Localize for Visual Object Tracking8 May 2026
- 2026Boosting Self-Supervised Tracking with Contextual Prompts and Noise Learning7 May 2026
- 2026Unified Multimodal Visual Tracking with Dual Mixture-of-Experts5 May 2026
- 2026OAMVOS:2nd Report for 5th PVUW MOSE Track20 Apr 2026
- 2026Attention Is not Everything: Efficient Alternatives for Vision19 Apr 2026
- 2026Bridging Time and Space: Decoupled Spatio-Temporal Alignment for Video Grounding9 Apr 2026
- 2026PhyEdit: Towards Real-World Object Manipulation via Physically-Grounded Image Editing8 Apr 2026
- 2026ID-Sim: An Identity-Focused Similarity Metric6 Apr 2026
- 2026ComPrivDet: Efficient Privacy Object Detection in Compressed Domains Through Inference Reuse4 Apr 2026
- 2026Drift-Resilient Temporal Priors for Visual Tracking3 Apr 2026
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation2 Apr 2026
- 2026STATrack: A Target-Aware Fully Spiking Neural Network for Efficient UAV Tracking29 Mar 2026
- 2026Beyond MACs: Hardware Efficient Architecture Design for Vision Backbones27 Mar 2026
50 newest of 475 All 475 (JSON)
- 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 78
- 2024Online Video Understanding: OVBench and VideoChat-Onlinecited by 61
- 2024Elysium: Exploring Object-level Perception in Videos via MLLMcited by 48
- 2023Merlin:Empowering Multimodal LLMs with Foresight Mindscited by 46
- 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignmentcited by 29
- 2024Artemis: Towards Referential Understanding in Complex Videoscited by 25
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Modelscited by 22
- 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentationcited by 17
- 2024Teaching VLMs to Localize Specific Objects from In-context Examplescited by 6
- 2026Bridging Time and Space: Decoupled Spatio-Temporal Alignment for Video Groundingcited by 3
- 2025Enabling Disaggregated Multi-Stage MLLM Inference via GPU-Internal Scheduling and Resource Sharingcited by 1
- 2026Personalized Object Identification and Localization via In-Context Inference with Vision-Language Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models8 Sep 2026
- 2026Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models1 Jul 2026
- 2026Bridging Time and Space: Decoupled Spatio-Temporal Alignment for Video Grounding9 Apr 2026
- 2025Enabling Disaggregated Multi-Stage MLLM Inference via GPU-Internal Scheduling and Resource Sharing19 Dec 2025
- 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memory29 Sep 2025
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models10 Jan 2025
- 2024Online Video Understanding: OVBench and VideoChat-Online31 Dec 2024
- 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment26 Dec 2024
- 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentation12 Dec 2024
- 2024Teaching VLMs to Localize Specific Objects from In-context Examples20 Nov 2024
- 2024Artemis: Towards Referential Understanding in Complex Videos1 Jun 2024
- 2024Elysium: Exploring Object-level Perception in Videos via MLLM25 Mar 2024
12 newest of 13 All 13 (JSON)
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 314
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
- 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoningcited by 68
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 65
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoningcited by 14
- 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Trackingcited by 9
- 2025R^3-VQA: "Read the Room" by Video Social Reasoningcited by 6
- 2026Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMscited by 4
- 2026SPARROW: Learning Spatial Precision and Temporal Referential Consistency in Pixel-Grounded Video MLLMscited by 2
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning27 Aug 2026
- 2026Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMs20 Aug 2026
- 2026SPARROW: Learning Spatial Precision and Temporal Referential Consistency in Pixel-Grounded Video MLLMs12 Mar 2026
- 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec 2025
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perception25 Sep 2025
- 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Tracking7 Aug 2025
- 2025R^3-VQA: "Read the Room" by Video Social Reasoning7 May 2025
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr 2025
- 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoning14 Mar 2025
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Models23 May 2023
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackerscited by 24
- 2024Animate Your Motion: Turning Still Images into Dynamic Videoscited by 10
- 2025DeTrack: In-model Latent Denoising Learning for Visual Object Trackingcited by 5
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2025Towards Effective and Efficient Adversarial Defense with Diffusion Models for Robust Visual Trackingcited by 2
- 2024DaDiff: Domain-aware Diffusion Model for Nighttime UAV Trackingcited by 1
- 2025Video Forgery Detection with Optical Flow Residuals and Spatial-Temporal Consistencycited by 1
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Trackingcited by 1
- 2026Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generationcited by 0
- 2026Test-Time Noise Guided Adaptation for Realistic Autoregressive Video Generation17 Jul 2026
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking26 May 2026
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning12 Mar 2026
- 2025Video Forgery Detection with Optical Flow Residuals and Spatial-Temporal Consistency1 Aug 2025
- 2025Towards Effective and Efficient Adversarial Defense with Diffusion Models for Robust Visual Tracking31 May 2025
- 2025DeTrack: In-model Latent Denoising Learning for Visual Object Tracking5 Jan 2025
- 2024DaDiff: Domain-aware Diffusion Model for Nighttime UAV Tracking16 Oct 2024
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers11 Jul 2024
- 2024Animate Your Motion: Turning Still Images into Dynamic Videos15 Mar 2024
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baselinecited by 11
- 2024General Compression Framework for Efficient Transformer Object Trackingcited by 10
- 2021Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillationcited by 9
- 2024LoReTrack: Efficient and Accurate Low-Resolution Transformer Trackingcited by 3
- 2023Mutual-Learning Knowledge Distillation for Nighttime UAV Trackingcited by 2
- 2026FARTrack: Fast Autoregressive Visual Tracking with High Performancecited by 2
- 2026Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruningcited by 0
- 2026Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruning2 Aug 2026
- 2026FARTrack: Fast Autoregressive Visual Tracking with High Performance3 Feb 2026
- 2024General Compression Framework for Efficient Transformer Object Tracking26 Sep 2024
- 2024LoReTrack: Efficient and Accurate Low-Resolution Transformer Tracking27 May 2024
- 2023Mutual-Learning Knowledge Distillation for Nighttime UAV Tracking13 Dec 2023
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baseline11 Feb 2022
- 2021Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillation26 Mar 2021
- 2024Exploring Enhanced Contextual Information for Video-Level Object Trackingcited by 37
- 2024Robust Tracking via Mamba-based Context-aware Token Learningcited by 15
- 2024MambaVT: Spatio-Temporal Contextual Modeling for robust RGB-T Trackingcited by 14
- 2024MambaTrack: Exploiting Dual-Enhancement for Night UAV Trackingcited by 5
- 2024MambaNUT: Nighttime UAV Tracking via Mamba-based Adaptive Curriculum Learningcited by 2
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Trackingcited by 1
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking2 Feb 2026
- 2024Robust Tracking via Mamba-based Context-aware Token Learning18 Dec 2024
- 2024Exploring Enhanced Contextual Information for Video-Level Object Tracking15 Dec 2024
- 2024MambaNUT: Nighttime UAV Tracking via Mamba-based Adaptive Curriculum Learning1 Dec 2024
- 2024MambaTrack: Exploiting Dual-Enhancement for Night UAV Tracking24 Nov 2024
- 2024MambaVT: Spatio-Temporal Contextual Modeling for robust RGB-T Tracking15 Aug 2024
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 302
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 281
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
- 2023Visual Prompt Multi-Modal Trackingcited by 142
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
12 most cited of 421 All 421 (JSON)
- 2026UniMergeTrack: Hierarchical Model Merging for General RGB-X Visual Object Tracking9 Oct 2026
- 2026Every View Counts: View-Consistent Panoptic Quality for Multi-view Panoptic Segmentation5 Oct 2026
- 2026When Predicting Nothing Beats SAM 3: Revisiting Evaluation in Video Object Segmentation2 Oct 2026
- 2026MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos29 Sep 2026
- 2026LoopTrack: A Simple Baseline for Parameter-Efficient Transformer Tracking27 Sep 2026
- 2026SBMVTrack: Spike-Budgeted Multi-View Learning for Power-Efficient UAV Tracking21 Sep 2026
- 2026Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking7 Sep 2026
- 2026Learning to Track from Privileged Target Appearances2 Sep 2026
- 2026Efficient Language-to-Vision Feature Injection for Referring Single-Object Tracking29 Aug 2026
- 2026Video-FLAIR: Not Whether to Reason, But How27 Aug 2026
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026FeedbackTrack: Visual-Cortex-Inspired Cross-Frame Feedback for Transformer Tracking10 Aug 2026
12 newest of 421 All 421 (JSON)