FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking
Not on the map. Why?
Abstract (arXiv)
Multi-object tracking (MOT) is an important problem in computer vision which has a wide range of applications. Formulating MOT as multi-task learning of object detection and re-ID in a single network is appealing since it allows joint optimization of the two tasks and enjoys high computation efficiency. However, we find that the two tasks tend to compete with each other which need to be carefully addressed. In particular, previous works usually treat re-ID as a secondary task whose accuracy is heavily affected by the primary detection task. As a result, the network is biased to the primary detection task which is not fair to the re-ID task. To solve the problem, we present a simple yet effective approach termed as FairMOT based on the anchor-free object detection architecture CenterNet. Note that it is not a naive combination of CenterNet and re-ID. Instead, we present a bunch of detailed designs which are critical to achieve good tracking results by thorough empirical studies. The resulting approach achieves high accuracy for both detection and tracking. The approach outperforms the state-of-the-art methods by a large margin on several public datasets. The source code and pre-trained models are released at https://github.com/ifzhang/FairMOT.
Key facts. Cited by 489 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 47; 2022: 102; 2023: 98; 2024: 110; 2025: 90; 2026: 42.
489 papers.
Sort:
By area:
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
38 more
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2022Global Tracking Transformerscited by 110
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
- 2022In Defense of Online Models for Video Instance Segmentationcited by 97
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2023Referring Multi-Object Trackingcited by 91
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2022SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videoscited by 80
- 2022Dual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identificationcited by 78
- 2022Hard to Track Objects with Irregular Motions and Similar Appearances? Make It Easier by Buffering the Matching Spacecited by 66
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2022QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Trackingcited by 61
- 2021SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Watercited by 59
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2021DEFT: Detection Embeddings for Trackingcited by 56
- 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
- 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
- 2023OVTrack: Open-Vocabulary Multiple Object Trackingcited by 53
- 2021RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representationcited by 52
- 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Drivingcited by 52
- 2022CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking with Camera-LiDAR Fusioncited by 50
- 2023PLIP: Language-Image Pre-training for Person Representation Learningcited by 49
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
- 2021Learnable Graph Matching: Incorporating Graph Partitioning with Deep Feature Learning for Multiple Object Trackingcited by 47
- 2022GIAOTracker: A comprehensive framework for MCMOT with global information and optimizing strategies in VisDrone 2021cited by 46
- 2022Simple Cues Lead to a Strong Multi-Object Trackercited by 44
- 2021Anchor-Free Person Searchcited by 42
- 2021TransCenter: Transformers with Dense Representations for Multiple-Object Trackingcited by 42
- 2023MOTRv3: Release-Fetch Supervision for End-to-End Multi-Object Trackingcited by 42
- 2022Large-Scale Pre-training for Person Re-identification with Noisy Labelscited by 41
50 most cited of 489 All 489 (JSON)
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking28 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
- 2026Tracking-by-detection in Multi-object Tracking: Survey and Experiments8 Sep 2026
- 2026BMCTrack-d: Pig re-identification and tracking via back marks in challenging camera settings3 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026PersonaDrive: Controllable Trajectory Prediction with Multi-Dimensional Driving Personas15 Aug 2026
- 2026When Fish Look Alike: Tracking Identities with Dual-branch Elasticity29 Jul 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
38 more
- 2026Achieving Text-based Person Retrieval with Any Granularity23 Jul 2026
- 2026VLA-ReID: Video-Level Association for Re-Identification in Multi-Object Tracking with Highly Similar Objects19 Jul 2026
- 2026The generator is the tracker: Multi-object tracking by painting persistent identity colours19 Jul 2026
- 2026DETRAM: End-to-end DEtection, Tracking and Recovery of HumAn Meshes10 Jul 2026
- 2026Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware9 Jul 2026
- 2026HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking1 Jul 2026
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026FEMOT: Multi-Object Tracking using Frame and Event Cameras12 Jun 2026
- 2026Does Appearance Help? A Systematic Study of Image-Based Re-Identification in Online 3D Multi-Pedestrian Tracking5 Jun 2026
- 2026IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation3 Jun 2026
- 2026Clip-level Uncertainty and Temporal-aware Active Learning for End-to-End Multi-Object Tracking11 May 2026
- 2026Time-series Meets Complex Motion Modeling: Robust and Computational-effective Motion Predictor for Multi-object Tracking1 May 2026
- 2026GateMOT: Q-Gated Attention for Dense Object Tracking29 Apr 2026
- 2026Motion-Driven Multi-Object Tracking of Model Organisms in Space Science Experiments29 Apr 2026
- 2026Efficient Online 3D Multi-Camera Multi-Object Tracking and Pose Estimation16 Apr 2026
- 2026STORM: End-to-End Referring Multi-Object Tracking in Videos12 Apr 2026
- 2026Beyond Pedestrians: Caption-Guided CLIP Framework for High-Difficulty Video-based Person Re-Identification9 Apr 2026
- 2026SCT-MOT: Enhancing Air-to-Air Multiple UAVs Tracking with Swarm-Coupled Motion and Trajectory Guidance8 Apr 2026
- 2026COVTrack++: Learning Open-Vocabulary Multi-Object Tracking from Continuous Videos via a Synergistic Paradigm25 Mar 2026
- 2026Dual-level Adaptation for Multi-Object Tracking: Building Test-Time Calibration from Experience and Intuition23 Mar 2026
- 2026VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillation21 Mar 2026
- 2026FC-Track: Overlap-Aware Post-Association Correction for Online Multi-Object Tracking13 Mar 2026
- 2026TRIAGE: Type-Routed Interventions via Aleatoric-Epistemic Gated Estimation in Robotic Manipulation and Adaptive Perception -- Don't Treat All Uncertainty the Same9 Mar 2026
- 2026AR2-4FV: Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View Videos8 Mar 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2026UniTrack: Differentiable Graph Representation Learning for Multi-Object Tracking4 Feb 2026
- 2026Video Individual Counting and Tracking from Moving Drones: A Benchmark and Methods18 Jan 2026
- 2026DeTracker: Motion-decoupled Vehicle Detection and Tracking in Unstabilized Satellite Videos14 Jan 2026
- 2026AR-MOT: Autoregressive Multi-object Tracking5 Jan 2026
- 2026Crowded Video Individual Counting Informed by Social Grouping and Spatial-Temporal Displacement Priors3 Jan 2026
- 2025Learning Association via Track-Detection Matching for Multi-Object Tracking26 Dec 2025
- 2025End-to-End 3-D Spatiotemporal Perception with Multimodal Fusion and V2X Collaboration26 Dec 2025
- 2025SPOT!: Map-Guided LLM Agent for Unsupervised Multi-CCTV Dynamic Object Tracking24 Dec 2025
- 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Driving8 Dec 2025
- 2025From Detection to Association: Learning Discriminative Object Embeddings for Multi-Object Tracking2 Dec 2025
- 2025Physical ID-Transfer Attacks against Multi-Object Tracking via Adversarial Trajectory1 Dec 2025
- 2025DM3T: Harmonizing Modalities via Diffusion for Multi-Object Tracking28 Nov 2025
- 2025SelfMOTR: Revisiting MOTR with Self-Generating Detection Priors25 Nov 2025
50 newest of 489 All 489 (JSON)
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Drivingcited by 52
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Modelcited by 0
- 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentationcited by 0
- 2025DiffusionDriveV2: Reinforcement Learning-Constrained Truncated Diffusion Modeling in End-to-End Autonomous Driving8 Dec 2025
- 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation28 Nov 2024
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving22 Nov 2024
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model28 Aug 2024
- 2023DiffusionTrack: Diffusion Model For Multi-Object Tracking19 Aug 2023
- 2026PersonaDrive: Controllable Trajectory Prediction with Multi-Dimensional Driving Personas15 Aug 2026
- 2025SpaRC-AD: A Baseline for Radar-Camera Fusion in End-to-End Autonomous Driving14 Aug 2025
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Driving30 May 2022
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
12 most cited of 473 All 473 (JSON)
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking28 Sep 2026
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
- 2026Tracking-by-detection in Multi-object Tracking: Survey and Experiments8 Sep 2026
- 2026BMCTrack-d: Pig re-identification and tracking via back marks in challenging camera settings3 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026When Fish Look Alike: Tracking Identities with Dual-branch Elasticity29 Jul 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026Achieving Text-based Person Retrieval with Any Granularity23 Jul 2026
12 newest of 473 All 473 (JSON)