MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectors
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose MOTRv2, a simple yet effective pipeline to bootstrap end-to-end multi-object tracking with a pretrained object detector. Existing end-to-end methods, MOTR and TrackFormer are inferior to their tracking-by-detection counterparts mainly due to their poor detection performance. We aim to improve MOTR by elegantly incorporating an extra object detector. We first adopt the anchor formulation of queries and then use an extra object detector to generate proposals as anchors, providing detection prior to MOTR. The simple modification greatly eases the conflict between joint learning detection and association tasks in MOTR. MOTRv2 keeps the query propogation feature and scales well on large-scale benchmarks. MOTRv2 ranks the 1st place (73.4% HOTA on DanceTrack) in the 1st Multiple People Tracking in Group Dance Challenge. Moreover, MOTRv2 reaches state-of-the-art performance on the BDD100K dataset. We hope this simple and effective pipeline can provide some new insights to the end-to-end MOT community. Code is available at urlhttps://github.com/megvii-research/MOTRv2.
Key facts. Cited by 148 papers in the map (data through 14 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 17 Nov 2022.
Builds on
42 of 51 references.
References · 42
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
- 2016Simple Online and Realtime Trackingcited by 868
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
30 more
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 573
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 532
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
- 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 495
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 490
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 488
- 2020Tracking Objects as Pointscited by 483
- 2020End-to-End Video Instance Segmentation with Transformerscited by 443
- 2019Tracking without bells and whistlescited by 382
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
- 2020TransTrack: Multiple Object Tracking with Transformercited by 371
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 357
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2018CrowdHuman: A Benchmark for Detecting Human in a Crowdcited by 284
- 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2015MOTChallenge 2015: Towards a Benchmark for Multi-Target Trackingcited by 133
- 2022MeMOT: Multi-Object Tracking with Memorycited by 114
- 2022Global Tracking Transformerscited by 110
- 2018Real-time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identificationcited by 96
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2022Tracking Every Thing in the Wildcited by 44
- 2022Tracking Objects as Pixel-wise Distributionscited by 37
- 2020Multi-Object Tracking with Siamese Track-RCNNcited by 14
Built on by
Citing papers per year: 2023: 25; 2024: 55; 2025: 37; 2026: 31.
148 papers.
Sort:
By area:
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
- 2023Referring Multi-Object Trackingcited by 93
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 67
- 2024Multiple Object Tracking as ID Predictioncited by 60
- 2024Matching Anything by Segmenting Anythingcited by 50
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 47
- 2023A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineeringcited by 45
- 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensationcited by 44
38 more
- 2023MOTRv3: Release-Fetch Supervision for End-to-End Multi-Object Trackingcited by 42
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
- 2023iKUN: Speak to Trackers without Retrainingcited by 32
- 2024Towards Generalizable Multi-Object Trackingcited by 23
- 2024Bootstrapping Referring Multi-Object Trackingcited by 22
- 2024Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Trackingcited by 21
- 2023Bridging the Gap Between End-to-end and Non-End-to-end Multi-Object Trackingcited by 20
- 2023SoccerNet 2023 Challenges Resultscited by 20
- 2023OmniTracker: Unifying Object Tracking by Tracking-with-Detectioncited by 19
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Drivingcited by 19
- 2024Delving into the Trajectory Long-tail Distribution for Muti-object Trackingcited by 18
- 2025SAM2MOT: A Novel Paradigm of Multi-Object Tracking by Segmentationcited by 17
- 2024AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movementscited by 15
- 2024Multi-Object Tracking in the Darkcited by 14
- 2024CLIP-VIS: Adapting CLIP for Open-Vocabulary Video Instance Segmentationcited by 13
- 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
- 2025Omnidirectional Multi-Object Trackingcited by 13
- 2023DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusionscited by 12
- 2024GoMatching: A Simple Baseline for Video Text Spotting via Long and Short Term Matchingcited by 12
- 2024Beyond MOT: Semantic Multi-Object Trackingcited by 12
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
- 2024TeamTrack: A Dataset for Multi-Sport Multi-Object Tracking in Full-pitch Videoscited by 11
- 2025OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformercited by 11
- 2024Computer Vision for Primate Behavior Analysis in the Wildcited by 10
- 2024DeconfuseTrack:Dealing with Confusion for Multi-Object Trackingcited by 9
- 2024RobMOT: Robust 3D Multi-Object Tracking by Observational Noise and State Estimation Drift Mitigation on LiDAR PointCloudcited by 9
- 2024ETTrack: Enhanced Temporal Motion Predictor for Multi-Object Trackingcited by 9
- 2024LaMOT: Language-Guided Multi-Object Trackingcited by 9
- 2024Multiview Scene Graphcited by 9
- 2024MCTR: Multi Camera Tracking Transformercited by 8
- 2023Z-GMOT: Zero-shot Generic Multiple Object Trackingcited by 7
- 2023AttMOT: Improving Multiple-Object Tracking by Introducing Auxiliary Pedestrian Attributescited by 6
- 2023Contrastive Learning for Multi-Object Tracking with Transformerscited by 6
- 2024TrackSSM: A General Motion Predictor by State-Space Modelcited by 6
- 2024Temporal-Enhanced Multimodal Transformer for Referring Multi-Object Tracking and Segmentationcited by 6
- 2025PD-SORT: Occlusion-Robust Multi-Object Tracking Using Pseudo-Depth Cuescited by 6
- 2025Cognitive Disentanglement for Referring Multi-Object Trackingcited by 6
- 2025No Train Yet Gain: Towards Generic Multi-Object Tracking in Sports and Beyondcited by 6
50 most cited of 148 All 148 (JSON)
- 2026ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking29 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Causal neural set filtering for online multi-target tracking13 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026Training-Free Long-Term Multi-Object Tracking for Sports Video Analytics16 Aug 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026The generator is the tracker: Multi-object tracking by painting persistent identity colours19 Jul 2026
- 2026HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking1 Jul 2026
- 2026MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints30 Jun 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026FEMOT: Multi-Object Tracking using Frame and Event Cameras12 Jun 2026
38 more
- 2026Selective Mask Propagation for Multi-Object Tracking11 Jun 2026
- 2026AnyMo: Scaling Any-Modality Conditional Motion Generation with Masked Modeling28 May 2026
- 2026Joint 2D-3D Segmentation and Association in Street-level Imaging26 May 2026
- 2026SAMOFT: Robust Multi-Object Tracking via Region and Flow10 May 2026
- 2026CalibFree: Self-Supervised View Feature Separation for Calibration-Free Multi-Camera Multi-Object Tracking10 May 2026
- 2026GateMOT: Q-Gated Attention for Dense Object Tracking29 Apr 2026
- 2026OmniHuman: A Large-scale Dataset and Benchmark for Human-Centric Video Generation20 Apr 2026
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Models15 Apr 2026
- 2026Radar-Informed 3D Multi-Object Tracking under Adverse Conditions15 Apr 2026
- 2026Hypergraph-State Collaborative Reasoning for Multi-Object Tracking14 Apr 2026
- 2026Dual-level Adaptation for Multi-Object Tracking: Building Test-Time Calibration from Experience and Intuition23 Mar 2026
- 2026VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillation21 Mar 2026
- 2026Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation18 Mar 2026
- 2026TRIAGE: Type-Routed Interventions via Aleatoric-Epistemic Gated Estimation in Robotic Manipulation and Adaptive Perception -- Don't Treat All Uncertainty the Same9 Mar 2026
- 2026SCATR: Mitigating New Instance Suppression in LiDAR-based Tracking-by-Attention via Second Chance Assignment and Track Query Dropout2 Mar 2026
- 2026Phys-3D: Physics-Constrained Real-Time Crowd Tracking and Counting on Railway Platforms26 Feb 2026
- 2026HiMAP: History-aware Map-occupancy Prediction with Fallback19 Feb 2026
- 2026PredMapNet: Future and Historical Reasoning for Consistent Online HD Vectorized Map Construction18 Feb 2026
- 2026AR-MOT: Autoregressive Multi-object Tracking5 Jan 2026
- 2025Training-Free Global Geometric Association for 4D LiDAR Panoptic Segmentation22 Dec 2025
- 2025LeafTrackNet: A Deep Learning Framework for Robust Leaf Tracking in Top-Down Plant Phenotyping15 Dec 2025
- 2025From Detection to Association: Learning Discriminative Object Embeddings for Multi-Object Tracking2 Dec 2025
- 2025AerialMind: Towards Referring Multi-Object Tracking in UAV Scenarios26 Nov 2025
- 2025SelfMOTR: Revisiting MOTR with Self-Generating Detection Priors25 Nov 2025
- 2025A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehicles23 Nov 2025
- 2025Tracking and Segmenting Anything in Any Modality22 Nov 2025
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025Calibrated Decomposition of Aleatoric and Epistemic Uncertainty in Deep Features for Inference-Time Adaptation15 Nov 2025
- 2025SOTFormer: A Minimal Transformer for Unified Object Tracking and Trajectory Prediction14 Nov 2025
- 2025OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback1 Nov 2025
- 2025Radar-Camera Fused Multi-Object Tracking: Online Calibration and Common Feature23 Oct 2025
- 2025MMOT: The First Challenging Benchmark for Drone-based Multispectral Multi-Object Tracking14 Oct 2025
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking10 Oct 2025
- 2025Motion-Aware Transformer for Multi-Object Tracking26 Sep 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Tracking2 Sep 2025
- 2025To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software28 Aug 2025
- 2025FastTracker: Real-Time and Accurate Visual Tracking20 Aug 2025
50 newest of 148 All 148 (JSON)
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understandingcited by 1
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancementcited by 0
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Modelscited by 0
- 2026Training-Free Semantic Multi-Object Tracking with Vision-Language Models15 Apr 2026
- 2025OmniPT: Unleashing the Potential of Large Vision Language Models for Pedestrian Tracking and Understanding21 Nov 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2023Referring Multi-Object Trackingcited by 93
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 67
- 2024Multiple Object Tracking as ID Predictioncited by 60
- 2024Matching Anything by Segmenting Anythingcited by 50
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
- 2023A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineeringcited by 45
- 2023UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensationcited by 44
- 2023MOTRv3: Release-Fetch Supervision for End-to-End Multi-Object Trackingcited by 42
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
12 most cited of 136 All 136 (JSON)
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Causal neural set filtering for online multi-target tracking13 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026Training-Free Long-Term Multi-Object Tracking for Sports Video Analytics16 Aug 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026The generator is the tracker: Multi-object tracking by painting persistent identity colours19 Jul 2026
- 2026HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking1 Jul 2026
- 2026MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints30 Jun 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026FEMOT: Multi-Object Tracking using Frame and Event Cameras12 Jun 2026
- 2026Selective Mask Propagation for Multi-Object Tracking11 Jun 2026
12 newest of 136 All 136 (JSON)