MOT20: A benchmark for multi object tracking in crowded scenes
Not on the map. Why?
Abstract (arXiv)
Standardized benchmarks are crucial for the majority of computer vision applications. Although leaderboards and ranking tables should not be over-claimed, benchmarks often provide the most objective measure of performance and are therefore important guides for research. The benchmark for Multiple Object Tracking, MOTChallenge, was launched with the goal to establish a standardized evaluation of multiple object tracking methods. The challenge focuses on multiple people tracking, since pedestrians are well studied in the tracking community, and precise tracking and detection has high practical relevance. Since the first release, MOT15, MOT16, and MOT17 have tremendously contributed to the community by introducing a clean dataset and precise framework to benchmark multi-object trackers. In this paper, we present our MOT20benchmark, consisting of 8 new sequences depicting very crowded challenging scenes. The benchmark was presented first at the 4thBMTT MOT Challenge Workshop at the Computer Vision and Pattern Recognition Conference (CVPR) 2019, and gives to chance to evaluate state-of-the-art methods for multiple object tracking when handling extremely crowded scenarios.
Key facts. Cited by 357 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 38; 2022: 67; 2023: 75; 2024: 87; 2025: 55; 2026: 35.
357 papers.
Sort:
By area:
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 132
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 131
- 2022MeMOT: Multi-Object Tracking with Memorycited by 114
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
38 more
- 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 91
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
- 2022SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videoscited by 80
- 2021STEP: Segmenting and Tracking Every Pixelcited by 73
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 69
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 67
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2021The Multi-Temporal Urban Development SpaceNet Datasetcited by 62
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2021SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Watercited by 61
- 2022QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Trackingcited by 61
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 60
- 2024Multiple Object Tracking as ID Predictioncited by 60
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representationcited by 52
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
- 2022Simple Cues Lead to a Strong Multi-Object Trackercited by 44
- 2022Tracking Every Thing in the Wildcited by 44
- 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensationcited by 44
- 2021Learning a Proposal Classifier for Multiple Object Trackingcited by 42
- 2021TransCenter: Transformers with Dense Representations for Multiple-Object Trackingcited by 42
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2021Learnable Online Graph Representations for 3D Multi-Object Trackingcited by 38
- 2022AnimalTrack: A Benchmark for Multi-Animal Tracking in the Wildcited by 37
- 2022Tracking Objects as Pixel-wise Distributionscited by 37
- 2022How many Observations are Enough? Knowledge Distillation for Trajectory Forecastingcited by 35
- 2022Towards Discriminative Representation: Multi-view Trajectory Contrastive Learning for Online Multi-object Trackingcited by 33
- 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Associationcited by 33
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 29
- 2022SMILEtrack: SiMIlarity LEarning for Occlusion-Aware Multiple Object Trackingcited by 29
- 2023Iterative Scale-Up ExpansionIoU and Deep Features Association for Multi-Object Tracking in Sportscited by 29
- 2021MODS -- A USV-oriented object detection and obstacle segmentation benchmarkcited by 27
- 20223D Multi-Object Tracking Using Graph Neural Networks with Cross-Edge Modality Attentioncited by 27
- 2021One More Check: Making "Fake Background" Be Tracked Againcited by 25
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Trackingcited by 25
50 most cited of 357 All 357 (JSON)
- 2026The Impact of Detector Architecture, Model Scale, and Scene Density on Multi-Pedestrian Tracking14 Oct 2026
- 2026Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation1 Oct 2026
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking28 Sep 2026
- 2026Tracking-by-detection in Multi-object Tracking: Survey and Experiments8 Sep 2026
- 2026Rethinking Pre-Training and Augmentation for Zero-Shot Cross-City Object Detection25 Aug 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026GenTrack3: Hybrid Stochastic-Deterministic Online Multi-Object Tracking with Cluster-Aware Association10 Aug 2026
- 2026Incremental Optimal Assignment for Real-Time Crowd Tracking23 Jul 2026
- 2026Higher-Order Cell Tracking Transformer13 Jul 2026
- 2026WaspMOT: A Benchmark for Long-Term Multi-Object Tracking of Trichogramma Wasps9 Jul 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking22 Jun 2026
38 more
- 2026FEMOT: Multi-Object Tracking using Frame and Event Cameras12 Jun 2026
- 2026Face versus Body Tracking for Human-Robot Interaction: An Egocentric Dataset2 Jun 2026
- 2026The Kalman Evolve: Closing the Gap in Kalman Filtering via Interpretable Algorithm Discovery26 May 2026
- 2026SAMOFT: Robust Multi-Object Tracking via Region and Flow10 May 2026
- 2026Time-series Meets Complex Motion Modeling: Robust and Computational-effective Motion Predictor for Multi-object Tracking1 May 2026
- 2026GateMOT: Q-Gated Attention for Dense Object Tracking29 Apr 2026
- 2026Attention Is not Everything: Efficient Alternatives for Vision19 Apr 2026
- 2026Hypergraph-State Collaborative Reasoning for Multi-Object Tracking14 Apr 2026
- 2026IndoorCrowd: A Multi-Scene Dataset for Human Detection, Segmentation, and Tracking with an Automated Annotation Pipeline2 Apr 2026
- 2026Out of Sight, Out of Track: Adversarial Attacks on Propagation-based Multi-Object Trackers via Query State Manipulation1 Apr 2026
- 2026COVTrack++: Learning Open-Vocabulary Multi-Object Tracking from Continuous Videos via a Synergistic Paradigm25 Mar 2026
- 2026VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillation21 Mar 2026
- 2026QTrack: Query-Driven Reasoning for Multi-modal MOT14 Mar 2026
- 2026Bodhi VLM: Privacy-Alignment Modeling for Hierarchical Visual Representations in Vision Backbones and VLM Encoders via Bottom-Up and Top-Down Feature Search14 Mar 2026
- 2026FC-Track: Overlap-Aware Post-Association Correction for Online Multi-Object Tracking13 Mar 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2026Breaking Smooth-Motion Assumptions: A UAV Benchmark for Multi-Object Tracking in Complex and Adverse Conditions6 Mar 2026
- 2026PMMA: The Polytechnique Montreal Mobility Aids Dataset10 Feb 2026
- 2026UniTrack: Differentiable Graph Representation Learning for Multi-Object Tracking4 Feb 2026
- 2026See Without Decoding: Motion-Vector-Based Tracking in Compressed Video29 Jan 2026
- 2026Video Individual Counting and Tracking from Moving Drones: A Benchmark and Methods18 Jan 2026
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding15 Jan 2026
- 2026Generative Semantic Multi-Object Tracking: A Large-Scale Benchmark and an MLLM-Driven Reasoning Framework10 Jan 2026
- 2025ST-DETrack: Identity-Preserving Branch Tracking in Entangled Plant Canopies via Dual Spatiotemporal Evidence17 Dec 2025
- 2025GorillaWatch: An Automated System for In-the-Wild Gorilla Re-Identification and Population Monitoring8 Dec 2025
- 2025StableTrack: Stabilizing Multi-Object Tracking on Low-Frequency Detections25 Nov 2025
- 2025A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehicles23 Nov 2025
- 2025SatSAM2: Motion-Constrained Video Object Tracking in Satellite Imagery using Promptable SAM2 and Kalman Priors23 Nov 2025
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025PlugTrack: Multi-Perceptive Motion Analysis for Adaptive Fusion in Multi-Object Tracking17 Nov 2025
- 2025Calibrated Decomposition of Aleatoric and Epistemic Uncertainty in Deep Features for Inference-Time Adaptation15 Nov 2025
- 2025Multi-Object Tracking Retrieval with LLaVA-Video: A Training-Free Solution to MOT25-StAG Challenge5 Nov 2025
- 2025OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback1 Nov 2025
- 2025FutrTrack: A Camera-LiDAR Fusion Transformer for 3D Multiple Object Tracking22 Oct 2025
- 2025EPIPTrack: Rethinking Prompt Modeling with Explicit and Implicit Prompts for Multi-Object Tracking15 Oct 2025
- 2025SVAG-Bench: A Large-Scale Benchmark for Multi-Instance Spatio-temporal Video Action Grounding14 Oct 2025
- 2025MMOT: The First Challenging Benchmark for Drone-based Multispectral Multi-Object Tracking14 Oct 2025
- 2025A Multi-purpose Tracking Framework for Salmon Welfare Monitoring in Challenging Environments30 Sep 2025
50 newest of 357 All 357 (JSON)
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understandingcited by 1
- 2025EffOWT: Transfer Visual Language Models to Open-World Tracking Efficiently and Effectivelycited by 0
- 2025SAM2Auto: Auto Annotation Using FLASHcited by 0
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancementcited by 0
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding15 Jan 2026
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2025SAM2Auto: Auto Annotation Using FLASH9 Jun 2025
- 2025EffOWT: Transfer Visual Language Models to Open-World Tracking Efficiently and Effectively7 Apr 2025
- 2022How many Observations are Enough? Knowledge Distillation for Trajectory Forecastingcited by 35
- 2024Leveraging Foundation Models via Knowledge Distillation in Multi-Object Tracking: Distilling DINOv2 Features to FairMOTcited by 6
- 2026VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillationcited by 0
- 2026VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillation21 Mar 2026
- 2024Leveraging Foundation Models via Knowledge Distillation in Multi-Object Tracking: Distilling DINOv2 Features to FairMOT25 Jul 2024
- 2022How many Observations are Enough? Knowledge Distillation for Trajectory Forecasting9 Mar 2022
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2023DiffusionTrack: Diffusion Model For Multi-Object Tracking19 Aug 2023
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 132
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 131
- 2022MeMOT: Multi-Object Tracking with Memorycited by 114
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 91
12 most cited of 343 All 343 (JSON)
- 2026The Impact of Detector Architecture, Model Scale, and Scene Density on Multi-Pedestrian Tracking14 Oct 2026
- 2026Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation1 Oct 2026
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking28 Sep 2026
- 2026Tracking-by-detection in Multi-object Tracking: Survey and Experiments8 Sep 2026
- 2026Rethinking Pre-Training and Augmentation for Zero-Shot Cross-City Object Detection25 Aug 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026GenTrack3: Hybrid Stochastic-Deterministic Online Multi-Object Tracking with Cluster-Aware Association10 Aug 2026
- 2026Incremental Optimal Assignment for Real-Time Crowd Tracking23 Jul 2026
- 2026Higher-Order Cell Tracking Transformer13 Jul 2026
- 2026WaspMOT: A Benchmark for Long-Term Multi-Object Tracking of Trichogramma Wasps9 Jul 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking22 Jun 2026
12 newest of 343 All 343 (JSON)