mlsanityData to 7 Oct 2026

3D Multiple Object Tracking on Autonomous Driving: A Literature Review

arXiv 2309.15411 ↗First posted 27 Sep 2023cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

3D multi-object tracking (3D MOT) stands as a pivotal domain within autonomous driving, experiencing a surge in scholarly interest and commercial promise over recent years. Despite its paramount significance, 3D MOT confronts a myriad of formidable challenges, encompassing abrupt alterations in object appearances, pervasive occlusion, the presence of diminutive targets, data sparsity, missed detections, and the unpredictable initiation and termination of object motion trajectories. Countless methodologies have emerged to grapple with these issues, yet 3D MOT endures as a formidable problem that warrants further exploration. This paper undertakes a comprehensive examination, assessment, and synthesis of the research landscape in this domain, remaining attuned to the latest developments in 3D MOT while suggesting prospective avenues for future investigation. Our exploration commences with a systematic exposition of key facets of 3D MOT and its associated domains, including problem delineation, classification, methodological approaches, fundamental principles, and empirical investigations. Subsequently, we categorize these methodologies into distinct groups, dissecting each group meticulously with regard to its challenges, underlying rationale, progress, merits, and demerits. Furthermore, we present a concise recapitulation of experimental metrics and offer an overview of prevalent datasets, facilitating a quantitative comparison for a more intuitive assessment. Lastly, our deliberations culminate in a discussion of the prevailing research landscape, highlighting extant challenges and charting possible directions for 3D MOT research. We present a structured and lucid road-map to guide forthcoming endeavors in this field.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 85 of its 98 references that are in the map. First posted on arXiv 27 Sep 2023.

Builds on

85 of 98 references.

References · 85

  1. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  5. 2020Center-based 3D Object Detection and Trackingcited by 1,143
  6. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
  7. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
  8. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  9. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  10. 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
  11. 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
  12. 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
38 more
  1. 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
  2. 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
  3. 20203D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detectioncited by 176
  4. 2014Multiple Object Tracking: A Literature Reviewcited by 165
  5. 2020EPNet: Enhancing Point Features with Image Semantics for 3D Object Detectioncited by 164
  6. 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
  7. 2020CLOCs: Camera-LiDAR Object Candidates Fusion for 3D Object Detectioncited by 147
  8. 2020PnPNet: End-to-End Perception and Prediction with Tracking in the Loopcited by 143
  9. 2020Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Reviewcited by 114
  10. 2020GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with Multi-Feature Learningcited by 113
  11. 20213D Object Detection for Autonomous Driving: A Surveycited by 106
  12. 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
  13. 2020MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Mapscited by 100
  14. 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
  15. 2020Alpha-Refine: Boosting Tracking Performance by Precise Bounding Box Estimationcited by 81
  16. 2023LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross-Modal Fusioncited by 80
  17. 2020Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Drivingcited by 73
  18. 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 73
  19. 2021Multiple Object Tracking with Correlation Learningcited by 67
  20. 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
  21. 2020Probabilistic 3D Multi-Object Tracking for Autonomous Drivingcited by 64
  22. 2023MotionTrack: Learning Robust Short-term and Long-term Motions for Multi-Object Trackingcited by 64
  23. 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
  24. 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
  25. 2019PI-RCNN: An Efficient Multi-sensor 3D Object Detector with Point-based Attentive Cont-conv Fusion Modulecited by 56
  26. 2021DEFT: Detection Embeddings for Trackingcited by 56
  27. 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
  28. 2023Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Trackingcited by 54
  29. 2022CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking with Camera-LiDAR Fusioncited by 50
  30. 2020JRMOT: A Real-Time 3D Multi-Object Tracker and a New Large-Scale Datasetcited by 39
  31. 2021Learnable Online Graph Representations for 3D Multi-Object Trackingcited by 38
  32. 2020Probabilistic Tracklet Scoring and Inpainting for Multiple Object Trackingcited by 36
  33. 2019Complexer-YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Cloudscited by 35
  34. 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Associationcited by 33
  35. 2023Poly-MOT: A Polyhedral Framework For 3D Multi-Object Trackingcited by 32
  36. 2022Transformers in 3D Point Clouds: A Surveycited by 31
  37. 2023DetZero: Rethinking Offboard 3D Object Detection with Long-term Sequential Point Cloudscited by 31
  38. 2022PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?cited by 29

50 most cited of 85 All 85 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.