MOT16: A Benchmark for Multi-Object Tracking
Not on the map. Why?
Abstract (arXiv)
Standardized benchmarks are crucial for the majority of computer vision applications. Although leaderboards and ranking tables should not be over-claimed, benchmarks often provide the most objective measure of performance and are therefore important guides for reseach. Recently, a new benchmark for Multiple Object Tracking, MOTChallenge, was launched with the goal of collecting existing and new data and creating a framework for the standardized evaluation of multiple object tracking methods. The first release of the benchmark focuses on multiple people tracking, since pedestrians are by far the most studied object in the tracking community. This paper accompanies a new release of the MOTChallenge benchmark. Unlike the initial release, all videos of MOT16 have been carefully annotated following a consistent protocol. Moreover, it not only offers a significant increase in the number of labeled boxes, but also provides multiple object classes beside pedestrians and the level of visibility for every single object of interest.
Key facts. Cited by 532 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 81; 2022: 116; 2023: 110; 2024: 120; 2025: 63; 2026: 41.
532 papers.
Sort:
By area:
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2021Associating Objects with Transformers for Video Object Segmentationcited by 226
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Video Understanding with Large Language Models: A Surveycited by 206
38 more
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2022DETRs with Hybrid Matchingcited by 150
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 132
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 131
- 2021Learning to Track with Object Permanencecited by 119
- 2022MeMOT: Multi-Object Tracking with Memorycited by 114
- 2022Global Tracking Transformerscited by 110
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
- 2024Streaming Dense Video Captioningcited by 82
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 81
- 2022SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videoscited by 80
- 2021Neural Production Systems: Learning Rule-Governed Visual Dynamicscited by 75
- 2021STEP: Segmenting and Tracking Every Pixelcited by 73
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 69
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 67
- 2022Hard to Track Objects with Irregular Motions and Similar Appearances? Make It Easier by Buffering the Matching Spacecited by 66
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2021SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Watercited by 61
- 2022QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Trackingcited by 61
- 2024Multiple Object Tracking as ID Predictioncited by 60
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021DEFT: Detection Embeddings for Trackingcited by 56
- 2021OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Associationcited by 55
- 2021RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representationcited by 52
- 2022CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking with Camera-LiDAR Fusioncited by 50
50 most cited of 532 All 532 (JSON)
- 2026MOTIP2: Spatial Priors for End-to-End Multi-Object Tracking7 Oct 2026
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments1 Oct 2026
- 2026Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation1 Oct 2026
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026PanoPed: Beyond Bounding Boxes for Sim-to-Real Panoramic Pedestrian Tracking25 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models8 Sep 2026
- 2026Tracking-by-detection in Multi-object Tracking: Survey and Experiments8 Sep 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026Data collection from highways: a geometric, class-agnostic approach to embedded vehicle counting7 Aug 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026Incremental Optimal Assignment for Real-Time Crowd Tracking23 Jul 2026
38 more
- 2026Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention20 Jul 2026
- 2026Still image and spatial-temporal tomato data enabling detection, segmentation, tracking, and video-instance segmentation using strong and weak labels16 Jul 2026
- 2026WaspMOT: A Benchmark for Long-Term Multi-Object Tracking of Trichogramma Wasps9 Jul 2026
- 2026OmniSCS: Omni Safety-Critical Scenario Synthesis for Autonomous Driving via a Fully Editable Driving World7 Jul 2026
- 2026FEMOT: Multi-Object Tracking using Frame and Event Cameras12 Jun 2026
- 2026Understanding Identity Continuity in Thermal Video through Scene-Level Consistency1 Jun 2026
- 2026Training-Free Object-Agnostic Jam Detection in Fulfillment Centers29 May 2026
- 2026Clip-level Uncertainty and Temporal-aware Active Learning for End-to-End Multi-Object Tracking11 May 2026
- 2026SAMOFT: Robust Multi-Object Tracking via Region and Flow10 May 2026
- 2026Time-series Meets Complex Motion Modeling: Robust and Computational-effective Motion Predictor for Multi-object Tracking1 May 2026
- 2026Lightweight Distillation of SAM 3 and DINOv3 for Edge-Deployable Individual-Level Livestock Monitoring and Longitudinal Visual Analytics29 Apr 2026
- 2026Attention Is not Everything: Efficient Alternatives for Vision19 Apr 2026
- 2026Towards Unconstrained Human-Object Interaction15 Apr 2026
- 2026Hypergraph-State Collaborative Reasoning for Multi-Object Tracking14 Apr 2026
- 2026STORM: End-to-End Referring Multi-Object Tracking in Videos12 Apr 2026
- 2026Intelligent Traffic Monitoring with YOLOv11: A Case Study in Real-Time Vehicle Detection5 Apr 2026
- 2026IndoorCrowd: A Multi-Scene Dataset for Human Detection, Segmentation, and Tracking with an Automated Annotation Pipeline2 Apr 2026
- 2026Single-Eye View: Monocular Real-time Perception Package for Autonomous Driving22 Mar 2026
- 2026VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillation21 Mar 2026
- 2026QTrack: Query-Driven Reasoning for Multi-modal MOT14 Mar 2026
- 2026TSDCRF: Balancing Privacy and Multi-Object Tracking via Time-Series CRF and Normalized Control Penalty14 Mar 2026
- 2026FC-Track: Overlap-Aware Post-Association Correction for Online Multi-Object Tracking13 Mar 2026
- 2026TRIAGE: Type-Routed Interventions via Aleatoric-Epistemic Gated Estimation in Robotic Manipulation and Adaptive Perception -- Don't Treat All Uncertainty the Same9 Mar 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2026Breaking Smooth-Motion Assumptions: A UAV Benchmark for Multi-Object Tracking in Complex and Adverse Conditions6 Mar 2026
- 2026Towards Driver Behavior Understanding: Weakly-Supervised Risk Perception in Driving Scenes6 Mar 2026
- 2026PPEDCRF: Privacy-Preserving Enhanced Dynamic CRF for Location-Privacy Protection for Sequence Videos with Minimal Detection Degradation2 Mar 2026
- 2026See Without Decoding: Motion-Vector-Based Tracking in Compressed Video29 Jan 2026
- 2026All-in-One Video Restoration under Smoothly Evolving Unknown Weather Degradations2 Jan 2026
- 2025RedunCut: Measurement-Driven Sampling and Accuracy Performance Modeling for Low-Cost Live Video Analytics30 Dec 2025
- 2025ST-DETrack: Identity-Preserving Branch Tracking in Entangled Plant Canopies via Dual Spatiotemporal Evidence17 Dec 2025
- 2025TUMTraf EMOT: Event-Based Multi-Object Tracking Dataset and Baseline for Traffic Scenarios16 Dec 2025
- 2025GorillaWatch: An Automated System for In-the-Wild Gorilla Re-Identification and Population Monitoring8 Dec 2025
- 2025Physical ID-Transfer Attacks against Multi-Object Tracking via Adversarial Trajectory1 Dec 2025
- 2025StableTrack: Stabilizing Multi-Object Tracking on Low-Frequency Detections25 Nov 2025
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025PlugTrack: Multi-Perceptive Motion Analysis for Adaptive Fusion in Multi-Object Tracking17 Nov 2025
- 2025Calibrated Decomposition of Aleatoric and Epistemic Uncertainty in Deep Features for Inference-Time Adaptation15 Nov 2025
50 newest of 532 All 532 (JSON)
- 2023Merlin:Empowering Multimodal LLMs with Foresight Mindscited by 46
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Modelscited by 22
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understandingcited by 1
- 2025EffOWT: Transfer Visual Language Models to Open-World Tracking Efficiently and Effectivelycited by 0
- 2025SAM2Auto: Auto Annotation Using FLASHcited by 0
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancementcited by 0
- 2026VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Modelscited by 0
- 2026VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models8 Sep 2026
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2025SAM2Auto: Auto Annotation Using FLASH9 Jun 2025
- 2025EffOWT: Transfer Visual Language Models to Open-World Tracking Efficiently and Effectively7 Apr 2025
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models10 Jan 2025
- 2023Merlin:Empowering Multimodal LLMs with Foresight Minds30 Nov 2023
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2023Diffusion Dataset Generation: Towards Closing the Sim2Real Gap for Pedestrian Detectioncited by 3
- 2024DINTR: Tracking via Diffusion-based Interpolationcited by 1
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2023DiffusionTrack: Diffusion Model For Multi-Object Tracking19 Aug 2023
- 2023Diffusion Dataset Generation: Towards Closing the Sim2Real Gap for Pedestrian Detection16 May 2023
- 2022DiffusionDet: Diffusion Model for Object Detection17 Nov 2022
- 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMscited by 16
- 2025ReaMOT: A Benchmark and Framework for Reasoning-based Multi-Object Trackingcited by 3
- 2026Clip-level Uncertainty and Temporal-aware Active Learning for End-to-End Multi-Object Trackingcited by 1
- 2026QTrack: Query-Driven Reasoning for Multi-modal MOTcited by 0
- 2026Clip-level Uncertainty and Temporal-aware Active Learning for End-to-End Multi-Object Tracking11 May 2026
- 2026QTrack: Query-Driven Reasoning for Multi-modal MOT14 Mar 2026
- 2025ReaMOT: A Benchmark and Framework for Reasoning-based Multi-Object Tracking26 May 2025
- 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMs8 Jan 2025
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Drivingcited by 19
- 2026Single-Eye View: Monocular Real-time Perception Package for Autonomous Drivingcited by 0
- 2026Single-Eye View: Monocular Real-time Perception Package for Autonomous Driving22 Mar 2026
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving28 Feb 2024
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directions21 Dec 2021
- 2019Simitate: A Hybrid Imitation Learning Benchmarkcited by 10
- 2019Simitate: A Hybrid Imitation Learning Benchmark15 May 2019
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2021Associating Objects with Transformers for Video Object Segmentationcited by 226
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
12 most cited of 507 All 507 (JSON)
- 2026MOTIP2: Spatial Priors for End-to-End Multi-Object Tracking7 Oct 2026
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments1 Oct 2026
- 2026Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation1 Oct 2026
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026PanoPed: Beyond Bounding Boxes for Sim-to-Real Panoramic Pedestrian Tracking25 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026Tracking-by-detection in Multi-object Tracking: Survey and Experiments8 Sep 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026Data collection from highways: a geometric, class-agnostic approach to embedded vehicle counting7 Aug 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026Incremental Optimal Assignment for Real-Time Crowd Tracking23 Jul 2026
- 2026Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention20 Jul 2026
12 newest of 507 All 507 (JSON)