3D Multiple Object Tracking on Autonomous Driving: A Literature Review
Not on the map. Why?
Abstract (arXiv)
3D multi-object tracking (3D MOT) stands as a pivotal domain within autonomous driving, experiencing a surge in scholarly interest and commercial promise over recent years. Despite its paramount significance, 3D MOT confronts a myriad of formidable challenges, encompassing abrupt alterations in object appearances, pervasive occlusion, the presence of diminutive targets, data sparsity, missed detections, and the unpredictable initiation and termination of object motion trajectories. Countless methodologies have emerged to grapple with these issues, yet 3D MOT endures as a formidable problem that warrants further exploration. This paper undertakes a comprehensive examination, assessment, and synthesis of the research landscape in this domain, remaining attuned to the latest developments in 3D MOT while suggesting prospective avenues for future investigation. Our exploration commences with a systematic exposition of key facets of 3D MOT and its associated domains, including problem delineation, classification, methodological approaches, fundamental principles, and empirical investigations. Subsequently, we categorize these methodologies into distinct groups, dissecting each group meticulously with regard to its challenges, underlying rationale, progress, merits, and demerits. Furthermore, we present a concise recapitulation of experimental metrics and offer an overview of prevalent datasets, facilitating a quantitative comparison for a more intuitive assessment. Lastly, our deliberations culminate in a discussion of the prevailing research landscape, highlighting extant challenges and charting possible directions for 3D MOT research. We present a structured and lucid road-map to guide forthcoming endeavors in this field.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 85 of its 98 references that are in the map. First posted on arXiv 27 Sep 2023.
Builds on
85 of 98 references.
References · 85
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
38 more
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 20203D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detectioncited by 176
- 2014Multiple Object Tracking: A Literature Reviewcited by 165
- 2020EPNet: Enhancing Point Features with Image Semantics for 3D Object Detectioncited by 164
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2020CLOCs: Camera-LiDAR Object Candidates Fusion for 3D Object Detectioncited by 147
- 2020PnPNet: End-to-End Perception and Prediction with Tracking in the Loopcited by 143
- 2020Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Reviewcited by 114
- 2020GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with Multi-Feature Learningcited by 113
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
- 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2020Alpha-Refine: Boosting Tracking Performance by Precise Bounding Box Estimationcited by 81
- 2023LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross-Modal Fusioncited by 80
- 2020Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Drivingcited by 73
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 73
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2020Probabilistic 3D Multi-Object Tracking for Autonomous Drivingcited by 64
- 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2019PI-RCNN: An Efficient Multi-sensor 3D Object Detector with Point-based Attentive Cont-conv Fusion Modulecited by 56
- 2021DEFT: Detection Embeddings for Trackingcited by 56
- 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
- 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
- 2022CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking with Camera-LiDAR Fusioncited by 50
- 2020JRMOT: A Real-Time 3D Multi-Object Tracker and a New Large-Scale Datasetcited by 39
- 2021Learnable Online Graph Representations for 3D Multi-Object Trackingcited by 38
- 2020Probabilistic Tracklet Scoring and Inpainting for Multiple Object Trackingcited by 36
- 2019Complexer-YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Cloudscited by 35
- 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Associationcited by 33
- 2023Poly-MOT: A Polyhedral Framework For 3D Multi-Object Trackingcited by 32
- 2022Transformers in 3D Point Clouds: A Surveycited by 31
- 2023DetZero: Rethinking Offboard 3D Object Detection with Long-term Sequential Point Cloudscited by 31
- 2022PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?cited by 29
50 most cited of 85 All 85 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 1.
4 papers.
- 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Taskscited by 14
- 2024Street Gaussians without 3D Object Trackercited by 4
- 2025ReaMOT: A Benchmark and Framework for Reasoning-based Multi-Object Trackingcited by 3
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environmentscited by 0
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments1 Oct 2026
- 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Tasks22 Oct 2025
- 2025ReaMOT: A Benchmark and Framework for Reasoning-based Multi-Object Tracking26 May 2025
- 2024Street Gaussians without 3D Object Tracker7 Dec 2024