Tracking Objects as Points
Not on the map. Why?
Abstract (arXiv)
Tracking has traditionally been the art of following interest points through space and time. This changed with the rise of powerful deep networks. Nowadays, tracking is dominated by pipelines that perform object detection followed by temporal association, also known as tracking-by-detection. In this paper, we present a simultaneous detection and tracking algorithm that is simpler, faster, and more accurate than the state of the art. Our tracker, CenterTrack, applies a detection model to a pair of images and detections from the prior frame. Given this minimal input, CenterTrack localizes objects and predicts their associations with the previous frame. That's it. CenterTrack is simple, online (no peeking into the future), and real-time. It achieves 67.3% MOTA on the MOT17 challenge at 22 FPS and 89.4% MOTA on the KITTI tracking benchmark at 15 FPS, setting a new state of the art on both datasets. CenterTrack is easily extended to monocular 3D tracking by regressing additional 3D attributes. Using monocular video input, it achieves 28.3% [email protected] on the newly released nuScenes 3D tracking benchmark, substantially outperforming the monocular baseline on this benchmark while running at 28 FPS.
Key facts. Cited by 483 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 79; 2022: 129; 2023: 94; 2024: 101; 2025: 50; 2026: 30.
483 papers.
Sort:
By area:
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 221
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 161
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
38 more
- 2022Learning from All Vehiclescited by 135
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2021Learning to Track with Object Permanencecited by 117
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 116
- 2022MeMOT: Multi-Object Tracking with Memorycited by 113
- 2022Global Tracking Transformerscited by 110
- 2022In Defense of Online Models for Video Instance Segmentationcited by 97
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2022MUTR3D: A Multi-camera Tracking Framework via 3D-to-2D Queriescited by 90
- 2021SG-Net: Spatial Granularity Network for One-Stage Video Instance Segmentationcited by 87
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 80
- 2022Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentationcited by 79
- 2021STEP: Segmenting and Tracking Every Pixelcited by 72
- 2023General Object Foundation Model for Images and Videos at Scalecited by 71
- 2022CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimationcited by 69
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 68
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 66
- 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perceptioncited by 65
- 2021Generic Event Boundary Detection: A Benchmark for Event Segmentationcited by 64
- 20214D Panoptic LiDAR Segmentationcited by 64
- 2022Multi-Frame Self-Supervised Depth with Transformerscited by 64
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022Unifying Short and Long-Term Tracking with Graph Hierarchiescited by 62
- 2022QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Trackingcited by 61
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2021DEFT: Detection Embeddings for Trackingcited by 56
- 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
- 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
- 2023OVTrack: Open-Vocabulary Multiple Object Trackingcited by 53
50 most cited of 483 All 483 (JSON)
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026BinoGen: Scaling egocentric binocular data for embodied visual perception and learning17 Sep 2026
- 2026GRACE: Geometry- and Ray-Aware Camera-Efficient Multi-View Pedestrian Tracking15 Sep 2026
- 2026CatchMonitor: a machine learning system for automated fish discard quantification14 Sep 2026
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026Training-Free Long-Term Multi-Object Tracking for Sports Video Analytics16 Aug 2026
- 2026When Fish Look Alike: Tracking Identities with Dual-branch Elasticity29 Jul 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026Beyond Appearance: A Multi-cue Framework and Large-scale Benchmark for Pedestrian Association and Tracking on Mobile Aerial-Ground Platforms26 Jul 2026
- 2026HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking1 Jul 2026
38 more
- 2026PS-MOT: Cultivating Instance Awareness from Point Seeds for Multi-Object Tracking29 Jun 2026
- 2026A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models27 Jun 2026
- 2026Selective Mask Propagation for Multi-Object Tracking11 Jun 2026
- 2026Driving Video Retrieval for Complex Queries with Structured Grounding8 Jun 2026
- 2026Real-Time Automatic License Plate Recognition Using YOLOv8, SORT Tracking, and Temporal Data Interpolation3 Jun 2026
- 2026Still Camouflage, Moving Illusion: View-Induced Trajectory Manipulation in Autonomous Driving12 May 2026
- 2026CalibFree: Self-Supervised View Feature Separation for Calibration-Free Multi-Camera Multi-Object Tracking10 May 2026
- 2026Time-series Meets Complex Motion Modeling: Robust and Computational-effective Motion Predictor for Multi-object Tracking1 May 2026
- 2026GateMOT: Q-Gated Attention for Dense Object Tracking29 Apr 2026
- 2026LEO: Graph Attention Network based Hybrid Multi Sensor Extended Object Fusion and Tracking for Autonomous Driving Applications2 Apr 2026
- 2026COVTrack++: Learning Open-Vocabulary Multi-Object Tracking from Continuous Videos via a Synergistic Paradigm25 Mar 2026
- 2026ForeSea: AI Forensic Search with Multi-modal Queries for Video Surveillance24 Mar 2026
- 2026Dual-level Adaptation for Multi-Object Tracking: Building Test-Time Calibration from Experience and Intuition23 Mar 2026
- 2026Sparse3DTrack: Monocular 3D Object Tracking Using Sparse Supervision18 Mar 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2026DeTracker: Motion-decoupled Vehicle Detection and Tracking in Unstabilized Satellite Videos14 Jan 2026
- 2026AR-MOT: Autoregressive Multi-object Tracking5 Jan 2026
- 2026Crowded Video Individual Counting Informed by Social Grouping and Spatial-Temporal Displacement Priors3 Jan 2026
- 2025Training-Free Global Geometric Association for 4D LiDAR Panoptic Segmentation22 Dec 2025
- 2025From Detection to Association: Learning Discriminative Object Embeddings for Multi-Object Tracking2 Dec 2025
- 2025Physical ID-Transfer Attacks against Multi-Object Tracking via Adversarial Trajectory1 Dec 2025
- 2025SelfMOTR: Revisiting MOTR with Self-Generating Detection Priors25 Nov 2025
- 2025SOTFormer: A Minimal Transformer for Unified Object Tracking and Trajectory Prediction14 Nov 2025
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking10 Oct 2025
- 2025GL-DT: Multi-UAV Detection and Tracking with Global-Local Integration10 Oct 2025
- 2025From Camera-Based Sensing to Reasoning: A Comprehensive Review Toward Proactive Vulnerable Road User Safety30 Sep 2025
- 2025Motion-Aware Transformer for Multi-Object Tracking26 Sep 2025
- 2025Lattice Boltzmann Model for Learning Real-World Pixel Dynamicity20 Sep 2025
- 2025Seg2Track-SAM2: SAM2-based Multi-object Tracking and Segmentation15 Sep 2025
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Tracking2 Sep 2025
- 2025To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software28 Aug 2025
- 2025FastTracker: Real-Time and Accurate Visual Tracking20 Aug 2025
- 2025SocialTrack: Multi-Object Tracking in Complex Urban Traffic Scenes Inspired by Social Behavior18 Aug 2025
- 2025Stable at Any Speed: Speed-Driven Multi-Object Tracking with Learnable Kalman Filtering1 Aug 2025
- 2025Querying Autonomous Vehicle Point Clouds: Enhanced by 3D Object Counting with CounterNet25 Jul 2025
- 2025Benchmarking pig detection and tracking under diverse and challenging conditions22 Jul 2025
- 2025One Graph to Track Them All: Dynamic GNNs for Single- and Multi-View Tracking11 Jul 2025
- 2025Towards Continuous Home Cage Monitoring: An Evaluation of Tracking and Identification Strategies for Laboratory Mice10 Jul 2025
50 newest of 483 All 483 (JSON)
- 2022Learning from All Vehiclescited by 135
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehiclescited by 36
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Drivingcited by 30
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Camerascited by 13
- 2026Driving Video Retrieval for Complex Queries with Structured Groundingcited by 1
- 2025Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportationcited by 0
- 2026Still Camouflage, Moving Illusion: View-Induced Trajectory Manipulation in Autonomous Drivingcited by 0
- 2026Driving Video Retrieval for Complex Queries with Structured Grounding8 Jun 2026
- 2026Still Camouflage, Moving Illusion: View-Induced Trajectory Manipulation in Autonomous Driving12 May 2026
- 2025Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportation25 Apr 2025
- 2022DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehicles13 Dec 2022
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Cameras20 Jun 2022
- 2022Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Driving30 May 2022
- 2022Learning from All Vehicles22 Mar 2022
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2023Video ControlNet: Towards Temporally Consistent Synthetic-to-Real Video Translation Using Conditional Image Diffusion Modelscited by 20
- 2024LDTrack: Dynamic People Tracking by Service Robots using Diffusion Modelscited by 3
- 2024DINTR: Tracking via Diffusion-based Interpolationcited by 1
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Modelcited by 0
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2024ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model28 Aug 2024
- 2024LDTrack: Dynamic People Tracking by Service Robots using Diffusion Models13 Feb 2024
- 2023DiffusionTrack: Diffusion Model For Multi-Object Tracking19 Aug 2023
- 2023Video ControlNet: Towards Temporally Consistent Synthetic-to-Real Video Translation Using Conditional Image Diffusion Models30 May 2023
- 2025SAM2Auto: Auto Annotation Using FLASHcited by 0
- 2025SAM2Auto: Auto Annotation Using FLASH9 Jun 2025
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 221
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identificationcited by 130
12 most cited of 464 All 464 (JSON)
- 2026LiAM-SAM: Lifecycle-Aware Memory for Robust SAM2-Based MOT23 Sep 2026
- 2026BinoGen: Scaling egocentric binocular data for embodied visual perception and learning17 Sep 2026
- 2026GRACE: Geometry- and Ray-Aware Camera-Efficient Multi-View Pedestrian Tracking15 Sep 2026
- 2026CatchMonitor: a machine learning system for automated fish discard quantification14 Sep 2026
- 2026EECTracker: Swarm Motion Prior-Guided Feature Compensation for Airborne Optical UAV Swarm Tracking14 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026Training-Free Long-Term Multi-Object Tracking for Sports Video Analytics16 Aug 2026
- 2026When Fish Look Alike: Tracking Identities with Dual-branch Elasticity29 Jul 2026
- 2026CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking28 Jul 2026
- 2026Beyond Appearance: A Multi-cue Framework and Large-scale Benchmark for Pedestrian Association and Tracking on Mobile Aerial-Ground Platforms26 Jul 2026
- 2026HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking1 Jul 2026
12 newest of 464 All 464 (JSON)