Long-term Tracking in the Wild: A Benchmark
Not on the map. Why?
Abstract (arXiv)
We introduce the OxUvA dataset and benchmark for evaluating single-object tracking algorithms. Benchmarks have enabled great strides in the field of object tracking by defining standardized evaluations on large sets of diverse videos. However, these works have focused exclusively on sequences that are just tens of seconds in length and in which the target is always visible. Consequently, most researchers have designed methods tailored to this "short-term" scenario, which is poorly representative of practitioners' needs. Aiming to address this disparity, we compile a long-term, large-scale tracking dataset of sequences with average length greater than two minutes and with frequent target object disappearance. The OxUvA dataset is much larger than the object tracking datasets of recent years: it comprises 366 sequences spanning 14 hours of video. We assess the performance of several algorithms, considering both the ability to locate the target and to determine whether it is present or absent. Our goal is to offer the community a large and diverse benchmark to enable the design and evaluation of tracking methods ready to be used "in the wild". The project website is http://oxuva.net
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 18; 2023: 8; 2024: 5; 2025: 5; 2026: 3.
55 papers.
Sort:
By area:
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 124
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 76
- 2021STEP: Segmenting and Tracking Every Pixelcited by 72
- 2021DepthTrack : Unveiling the Power of RGBD Trackingcited by 66
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022RGBD1K: A Large-scale Dataset and Benchmark for RGB-D Object Trackingcited by 42
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentationcited by 41
38 more
- 2023Test-Time Training on Video Streamscited by 37
- 2021Anti-UAV: A Large Multi-Modal Benchmark for UAV Trackingcited by 31
- 2023EgoTracks: A Long-term Egocentric Visual Object Tracking Datasetcited by 27
- 2021Dense Unsupervised Learning for Video Segmentationcited by 26
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Trackingcited by 26
- 2022Visual Object Tracking in First Person Visioncited by 25
- 2024VastTrack: Vast Category Visual Object Trackingcited by 25
- 2023Type-to-Track: Retrieve Any Object via Prompt-based Trackingcited by 24
- 2024DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLMcited by 24
- 2021Is First Person Vision Challenging for Object Tracking?cited by 21
- 2022Global Instance Tracking: Locating Target More Like Humanscited by 18
- 2021Dynamic Attention guided Multi-Trajectory Analysis for Single Object Trackingcited by 17
- 2021Modelling Neighbor Relation in Joint Space-Time Graph for Video Correspondence Learningcited by 16
- 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMscited by 16
- 2023Semi-Supervised Visual Tracking of Marine Animals using Autonomous Underwater Vehiclescited by 15
- 2022ProContEXT: Exploring Progressive Context Transformer for Trackingcited by 14
- 2022SiamMask: A Framework for Fast Online Object Tracking and Segmentationcited by 13
- 2022Spatial-then-Temporal Self-Supervised Learning for Video Correspondencecited by 13
- 2021Distractor-Aware Fast Tracking via Dynamic Convolutions and MOT Philosophycited by 11
- 2022Tracking Small and Fast Moving Objects: A Benchmarkcited by 11
- 2022Beyond SOT: Tracking Multiple Generic Objects at Oncecited by 11
- 2022SOTVerse: A User-defined Task Space of Single Object Trackingcited by 10
- 2023360VOT: A New Benchmark Dataset for Omnidirectional Visual Object Trackingcited by 10
- 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Trackingcited by 9
- 2022Global Tracking via Ensemble of Local Trackerscited by 8
- 2024360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videoscited by 8
- 2022In-N-Out Generative Learning for Dense Unsupervised Video Segmentationcited by 7
- 2021Video Annotation for Visual Tracking via Selection and Refinementcited by 5
- 2021TDIOT: Target-driven Inference for Deep Video Object Trackingcited by 4
- 2022Single Object Tracking: A Survey of Methods, Datasets, and Evaluation Metricscited by 4
- 2021Benchmarking Deep Trackers on Aerial Videoscited by 2
- 2022Single Object Tracking Research: A Surveycited by 2
- 2023PlanarTrack: A Large-scale Challenging Benchmark for Planar Object Trackingcited by 2
- 2025COST: Contrastive One-Stage Transformer for Vision-Language Small Object Trackingcited by 2
- 2025An HMM-based framework for identity-aware long-term multi-object tracking from sparse and uncertain identification: use case on long-term tracking in livestockcited by 1
- 2025PlanarTrack: A high-quality and challenging benchmark for large-scale planar object trackingcited by 1
- 2021Recursive Least-Squares Estimator-Aided Online Learning for Visual Trackingcited by 0
- 2022MONCE Tracking Metrics: a comprehensive quantitative performance evaluation methodology for object trackingcited by 0
50 most cited of 55 All 55 (JSON)
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation2 Apr 2026
- 2026Show Me When and Where: Towards Referring Video Object Segmentation in the Wild15 Mar 2026
- 2026MUOT_3M: A 3 Million Frame Multimodal Underwater Benchmark and the MUTrack Tracking Method20 Feb 2026
- 2025PlanarTrack: A high-quality and challenging benchmark for large-scale planar object tracking27 Oct 2025
- 2025An HMM-based framework for identity-aware long-term multi-object tracking from sparse and uncertain identification: use case on long-term tracking in livestock12 Sep 2025
- 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Tracking7 Aug 2025
- 2025COST: Contrastive One-Stage Transformer for Vision-Language Small Object Tracking2 Apr 2025
- 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMs8 Jan 2025
- 2024OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB9 Oct 2024
- 2024DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLM20 May 2024
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentation30 Apr 2024
- 2024360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos22 Apr 2024
38 more
- 2024VastTrack: Vast Category Visual Object Tracking6 Mar 2024
- 2023Unsupervised Green Object Tracker (GOT) without Offline Pre-training16 Sep 2023
- 2023360VOT: A New Benchmark Dataset for Omnidirectional Visual Object Tracking27 Jul 2023
- 2023Test-Time Training on Video Streams11 Jul 2023
- 2023Emergent Correspondence from Image Diffusion6 Jun 2023
- 2023Type-to-Track: Retrieve Any Object via Prompt-based Tracking22 May 2023
- 2023PlanarTrack: A Large-scale Challenging Benchmark for Planar Object Tracking14 Mar 2023
- 2023Semi-Supervised Visual Tracking of Marine Animals using Autonomous Underwater Vehicles14 Feb 2023
- 2023EgoTracks: A Long-term Egocentric Visual Object Tracking Dataset9 Jan 2023
- 2022Beyond SOT: Tracking Multiple Generic Objects at Once22 Dec 2022
- 2022LVOS: A Benchmark for Long-term Video Object Segmentation18 Nov 2022
- 2022ProContEXT: Exploring Progressive Context Transformer for Tracking27 Oct 2022
- 2022Visual Object Tracking in First Person Vision27 Sep 2022
- 2022Spatial-then-Temporal Self-Supervised Learning for Video Correspondence16 Sep 2022
- 2022Tracking Small and Fast Moving Objects: A Benchmark9 Sep 2022
- 2022RGBD1K: A Large-scale Dataset and Benchmark for RGB-D Object Tracking21 Aug 2022
- 2022Towards Grand Unification of Object Tracking14 Jul 2022
- 2022SiamMask: A Framework for Fast Online Object Tracking and Segmentation5 Jul 2022
- 2022Single Object Tracking Research: A Survey25 Apr 2022
- 2022SOTVerse: A User-defined Task Space of Single Object Tracking15 Apr 2022
- 2022MONCE Tracking Metrics: a comprehensive quantitative performance evaluation methodology for object tracking11 Apr 2022
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectories8 Apr 2022
- 2022Global Tracking via Ensemble of Local Trackers30 Mar 2022
- 2022In-N-Out Generative Learning for Dense Unsupervised Video Segmentation29 Mar 2022
- 2022Global Instance Tracking: Locating Target More Like Humans26 Feb 2022
- 2022Single Object Tracking: A Survey of Methods, Datasets, and Evaluation Metrics31 Jan 2022
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Tracking19 Jan 2022
- 2021Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking28 Dec 2021
- 2021Dense Unsupervised Learning for Video Segmentation11 Nov 2021
- 2021Modelling Neighbor Relation in Joint Space-Time Graph for Video Correspondence Learning28 Sep 2021
- 2021DepthTrack : Unveiling the Power of RGBD Tracking31 Aug 2021
- 2021Is First Person Vision Challenging for Object Tracking?31 Aug 2021
- 2021Video Annotation for Visual Tracking via Selection and Refinement9 Aug 2021
- 2021Do Different Tracking Tasks Require Different Appearance Models?5 Jul 2021
- 2021A Survey on Deep Learning Technique for Video Segmentation2 Jul 2021
- 2021Distractor-Aware Fast Tracking via Dynamic Convolutions and MOT Philosophy25 Apr 2021
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmark31 Mar 2021
- 2021Learning Target Candidate Association to Keep Track of What Not to Track30 Mar 2021
50 newest of 55 All 55 (JSON)
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2023Emergent Correspondence from Image Diffusion6 Jun 2023
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 124
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 76
- 2021STEP: Segmenting and Tracking Every Pixelcited by 72
- 2021DepthTrack : Unveiling the Power of RGBD Trackingcited by 66
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022RGBD1K: A Large-scale Dataset and Benchmark for RGB-D Object Trackingcited by 42
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentationcited by 41
- 2023Test-Time Training on Video Streamscited by 37
12 most cited of 52 All 52 (JSON)
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation2 Apr 2026
- 2026Show Me When and Where: Towards Referring Video Object Segmentation in the Wild15 Mar 2026
- 2026MUOT_3M: A 3 Million Frame Multimodal Underwater Benchmark and the MUTrack Tracking Method20 Feb 2026
- 2025PlanarTrack: A high-quality and challenging benchmark for large-scale planar object tracking27 Oct 2025
- 2025An HMM-based framework for identity-aware long-term multi-object tracking from sparse and uncertain identification: use case on long-term tracking in livestock12 Sep 2025
- 2025COST: Contrastive One-Stage Transformer for Vision-Language Small Object Tracking2 Apr 2025
- 2024OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB9 Oct 2024
- 2024DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLM20 May 2024
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentation30 Apr 2024
- 2024360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos22 Apr 2024
- 2024VastTrack: Vast Category Visual Object Tracking6 Mar 2024
- 2023Unsupervised Green Object Tracker (GOT) without Offline Pre-training16 Sep 2023
12 newest of 52 All 52 (JSON)