LaSOT: A High-quality Benchmark for Large-scale Single Object Tracking
Not on the map. Why?
Abstract (arXiv)
In this paper, we present LaSOT, a high-quality benchmark for Large-scale Single Object Tracking. LaSOT consists of 1,400 sequences with more than 3.5M frames in total. Each frame in these sequences is carefully and manually annotated with a bounding box, making LaSOT the largest, to the best of our knowledge, densely annotated tracking benchmark. The average video length of LaSOT is more than 2,500 frames, and each sequence comprises various challenges deriving from the wild where target objects may disappear and re-appear again in the view. By releasing LaSOT, we expect to provide the community with a large-scale dedicated benchmark with high quality for both the training of deep trackers and the veritable evaluation of tracking algorithms. Moreover, considering the close connections of visual appearance and natural language, we enrich LaSOT by providing additional language specification, aiming at encouraging the exploration of natural linguistic feature for tracking. A thorough experimental evaluation of 35 tracking algorithms on LaSOT is presented with detailed analysis, and the results demonstrate that there is still a big room for improvements.
Key facts. Cited by 424 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 72; 2022: 55; 2023: 72; 2024: 88; 2025: 76; 2026: 61.
424 papers.
Sort:
By area:
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 348
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 328
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 278
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2023Video Understanding with Large Language Models: A Surveycited by 203
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2023Visual Prompt Multi-Modal Trackingcited by 141
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
38 more
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 124
- 2022Transforming Model Prediction for Trackingcited by 117
- 2022Revealing the Dark Secrets of Masked Image Modelingcited by 117
- 2021LasHeR: A Large-scale High-diversity Benchmark for RGBT Trackingcited by 94
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2023Generalized Relation Modeling for Transformer Trackingcited by 93
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 91
- 2021LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Searchcited by 82
- 2023Robust Object Modeling for Visual Trackingcited by 80
- 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 77
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 76
- 2024Autoregressive Queries for Adaptive Tracking with Spatio-TemporalTransformerscited by 76
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2023HIPTrack: Visual Tracking with Historical Promptscited by 71
- 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 71
- 2024Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performancecited by 70
- 2022TCTrack: Temporal Contexts for Aerial Trackingcited by 69
- 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
- 2021DepthTrack : Unveiling the Power of RGBD Trackingcited by 66
- 2022BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Videocited by 66
- 2023Single-Model and Any-Modality for Video Object Trackingcited by 64
- 2024OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuningcited by 64
- 2024A Distractor-Aware Memory for Visual Object Tracking with SAM2cited by 63
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022Correlation-Aware Deep Trackingcited by 62
- 2023Towards Unified Token Learning for Vision-Language Trackingcited by 62
- 2023Joint Visual Grounding and Tracking with Natural Language Specificationcited by 59
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
- 2022Prompting for Multi-Modal Trackingcited by 58
- 2024Online Video Understanding: OVBench and VideoChat-Onlinecited by 58
- 2023MixFormerV2: Efficient Fully Transformer Trackingcited by 56
- 2023Exploring Lightweight Hierarchical Vision Transformers for Efficient Visual Trackingcited by 53
- 2023Compact Transformer Tracker with Correlative Masked Modelingcited by 50
- 2024Explicit Visual Prompts for Visual Object Trackingcited by 50
- 2024Vitron: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editingcited by 49
50 most cited of 424 All 424 (JSON)
- 2026LoopTrack: A Simple Baseline for Parameter-Efficient Transformer Tracking27 Sep 2026
- 2026Back-Tracking from Clarity: Self-Learning to See Text from Afar26 Sep 2026
- 2026VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models8 Sep 2026
- 2026Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking7 Sep 2026
- 2026Generalist Open-World Temporal Perception6 Sep 2026
- 2026Learning to Track from Privileged Target Appearances2 Sep 2026
- 2026Efficient Language-to-Vision Feature Injection for Referring Single-Object Tracking29 Aug 2026
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026FeedbackTrack: Visual-Cortex-Inspired Cross-Frame Feedback for Transformer Tracking10 Aug 2026
- 2026Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruning2 Aug 2026
- 2026Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking1 Aug 2026
- 2026Semantic-Aware Temporal Adaptation for UAV Anti-UAV Tracking29 Jul 2026
38 more
- 2026Efficient Tracking and Understanding Object Transformations22 Jul 2026
- 2026Cross-Modal UAV Object Tracking: State-Aware Representation Learning and A Unified Benchmark21 Jul 2026
- 2026VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding16 Jul 2026
- 2026AE-UAV: An Air-to-Air Event-Based UAV Tracking Benchmark and a Real-Time Frequency-Domain Tracker16 Jul 2026
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
- 2026Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models1 Jul 2026
- 2026Dynamic Parsing and Updating Natural Language Specification using VLMs for Robust Vision-Language Tracking28 Jun 2026
- 2026SENTRY: SAM2-Enhanced Neighbor-Aware and Temporally Reasoned Memory for Visual Tracking23 Jun 2026
- 2026FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization29 May 2026
- 2026Dual-branch Distilled Transformer for Efficient Asymmetric UAV Tracking27 May 2026
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking26 May 2026
- 2026Segment Anything with Motion, Geometry, and Semantic Adaptation for Complex Nonlinear Visual Object Tracking21 May 2026
- 2026An Efficient Token Compression Framework for Visual Object Tracking8 May 2026
- 2026RELO: Reinforcement Learning to Localize for Visual Object Tracking8 May 2026
- 2026Learning to Track Instance from Single Nature Language Description8 May 2026
- 2026Boosting Self-Supervised Tracking with Contextual Prompts and Noise Learning7 May 2026
- 2026Unified Multimodal Visual Tracking with Dual Mixture-of-Experts5 May 2026
- 2026Instance-level Visual Active Tracking with Occlusion-Aware Planning23 Apr 2026
- 2026OAMVOS:2nd Report for 5th PVUW MOSE Track20 Apr 2026
- 2026Attention Is not Everything: Efficient Alternatives for Vision19 Apr 2026
- 2026STORM: End-to-End Referring Multi-Object Tracking in Videos12 Apr 2026
- 2026Drift-Resilient Temporal Priors for Visual Tracking3 Apr 2026
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation2 Apr 2026
- 2026Beyond MACs: Hardware Efficient Architecture Design for Vision Backbones27 Mar 2026
- 2026UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentation25 Mar 2026
- 2026Dual Prompt-Driven Feature Encoding for Nighttime UAV Tracking20 Mar 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2026Uni-MDTrack: Learning Decoupled Memory and Dynamic States for Parameter-Efficient Visual Tracking in All Modality15 Mar 2026
- 2026Show Me When and Where: Towards Referring Video Object Segmentation in the Wild15 Mar 2026
- 2026SPARROW: Learning Spatial Precision and Temporal Referential Consistency in Pixel-Grounded Video MLLMs12 Mar 2026
- 2026AR2-4FV: Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View Videos8 Mar 2026
- 2026EdgeDAM: Real-time Object Tracking for Mobile Devices5 Mar 2026
- 2026UETrack: A Unified and Efficient Framework for Single Object Tracking2 Mar 2026
- 2026FocusTrack: One-Stage Focus-and-Suppress Framework for 3D Point Cloud Object Tracking27 Feb 2026
- 2026SpikeTrack: A Spike-driven Framework for Efficient Visual Tracking27 Feb 2026
- 2026MUOT_3M: A 3 Million Frame Multimodal Underwater Benchmark and the MUTrack Tracking Method20 Feb 2026
- 2026Uncertainty-Guided Inference-Time Depth Adaptation for Transformer-Based Visual Tracking18 Feb 2026
- 2026GOT-JEPA: Generic Object Tracking with Model Adaptation and Occlusion Handling using Joint-Embedding Predictive Architecture16 Feb 2026
50 newest of 424 All 424 (JSON)
- 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 71
- 2024Online Video Understanding: OVBench and VideoChat-Onlinecited by 58
- 2024Elysium: Exploring Object-level Perception in Videos via MLLMcited by 48
- 2023Merlin:Empowering Multimodal LLMs with Foresight Mindscited by 46
- 2023AutoEval-Video: An Automatic Benchmark for Assessing Large Vision Language Models in Open-Ended Video Question Answeringcited by 40
- 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignmentcited by 29
- 2024Artemis: Towards Referential Understanding in Complex Videoscited by 25
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Modelscited by 22
- 2025Time Blindness: Why Video-Language Models Can't See What Humans Can?cited by 17
- 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentationcited by 16
- 2024Teaching VLMs to Localize Specific Objects from In-context Examplescited by 6
- 2026Personalized Object Identification and Localization via In-Context Inference with Vision-Language Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models8 Sep 2026
- 2026Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models1 Jul 2026
- 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memory29 Sep 2025
- 2025Time Blindness: Why Video-Language Models Can't See What Humans Can?30 May 2025
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models10 Jan 2025
- 2024Online Video Understanding: OVBench and VideoChat-Online31 Dec 2024
- 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment26 Dec 2024
- 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentation12 Dec 2024
- 2024Teaching VLMs to Localize Specific Objects from In-context Examples20 Nov 2024
- 2024Artemis: Towards Referential Understanding in Complex Videos1 Jun 2024
- 2024Elysium: Exploring Object-level Perception in Videos via MLLM25 Mar 2024
- 2023Merlin:Empowering Multimodal LLMs with Foresight Minds30 Nov 2023
12 newest of 13 All 13 (JSON)
- 2024Exploring Enhanced Contextual Information for Video-Level Object Trackingcited by 36
- 2024Robust Tracking via Mamba-based Context-aware Token Learningcited by 15
- 2024MambaVT: Spatio-Temporal Contextual Modeling for robust RGB-T Trackingcited by 14
- 2024MambaTrack: Exploiting Dual-Enhancement for Night UAV Trackingcited by 5
- 2024MambaNUT: Nighttime UAV Tracking via Mamba-based Adaptive Curriculum Learningcited by 2
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Trackingcited by 1
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking2 Feb 2026
- 2024Robust Tracking via Mamba-based Context-aware Token Learning18 Dec 2024
- 2024Exploring Enhanced Contextual Information for Video-Level Object Tracking15 Dec 2024
- 2024MambaNUT: Nighttime UAV Tracking via Mamba-based Adaptive Curriculum Learning1 Dec 2024
- 2024MambaTrack: Exploiting Dual-Enhancement for Night UAV Tracking24 Nov 2024
- 2024MambaVT: Spatio-Temporal Contextual Modeling for robust RGB-T Tracking15 Aug 2024
- 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMscited by 16
- 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Trackingcited by 9
- 2026SPARROW: Learning Spatial Precision and Temporal Referential Consistency in Pixel-Grounded Video MLLMscited by 2
- 2026SPARROW: Learning Spatial Precision and Temporal Referential Consistency in Pixel-Grounded Video MLLMs12 Mar 2026
- 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Tracking7 Aug 2025
- 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMs8 Jan 2025
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 348
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 328
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 278
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2023Video Understanding with Large Language Models: A Surveycited by 203
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2023Visual Prompt Multi-Modal Trackingcited by 141
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
12 most cited of 397 All 397 (JSON)
- 2026LoopTrack: A Simple Baseline for Parameter-Efficient Transformer Tracking27 Sep 2026
- 2026Back-Tracking from Clarity: Self-Learning to See Text from Afar26 Sep 2026
- 2026Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking7 Sep 2026
- 2026Generalist Open-World Temporal Perception6 Sep 2026
- 2026Learning to Track from Privileged Target Appearances2 Sep 2026
- 2026Efficient Language-to-Vision Feature Injection for Referring Single-Object Tracking29 Aug 2026
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026FeedbackTrack: Visual-Cortex-Inspired Cross-Frame Feedback for Transformer Tracking10 Aug 2026
- 2026Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruning2 Aug 2026
- 2026Semantic-Aware Temporal Adaptation for UAV Anti-UAV Tracking29 Jul 2026
- 2026Efficient Tracking and Understanding Object Transformations22 Jul 2026
- 2026Cross-Modal UAV Object Tracking: State-Aware Representation Learning and A Unified Benchmark21 Jul 2026
12 newest of 397 All 397 (JSON)