mlsanityData to 7 Oct 2026

Radar and Camera Fusion for Object Detection and Tracking: A Comprehensive Survey

arXiv 2410.19872 ↗First posted 24 Oct 2024cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Multi-modal fusion is imperative to the implementation of reliable object detection and tracking in complex environments. Exploiting the synergy of heterogeneous modal information endows perception systems the ability to achieve more comprehensive, robust, and accurate performance. As a nucleus concern in wireless-vision collaboration, radar-camera fusion has prompted prospective research directions owing to its extensive applicability, complementarity, and compatibility. Nonetheless, there still lacks a systematic survey specifically focusing on deep fusion of radar and camera for object detection and tracking. To fill this void, we embark on an endeavor to comprehensively review radar-camera fusion in a holistic way. First, we elaborate on the fundamental principles, methodologies, and applications of radar-camera fusion perception. Next, we delve into the key techniques concerning sensor calibration, modal representation, data alignment, and fusion operation. Furthermore, we provide a detailed taxonomy covering the research topics related to object detection and tracking in the context of radar and camera technologies.Finally, we discuss the emerging perspectives in the field of radar-camera fusion perception and highlight the potential areas for future research.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 212 of its 424 references that are in the map. First posted on arXiv 24 Oct 2024.

Builds on

212 of 424 references.

References · 212

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  7. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  8. 2020End-to-End Object Detection with Transformerscited by 7,384
  9. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  10. 2017Mask R-CNNcited by 7,259
  11. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  12. 2017Squeeze-and-Excitation Networkscited by 4,763
38 more
  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  5. 2022A ConvNet for the 2020scited by 3,545
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  7. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  8. 2015Fast R-CNNcited by 2,930
  9. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  10. 2018YOLOv3: An Incremental Improvementcited by 2,652
  11. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  12. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  13. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  14. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
  15. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  16. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
  17. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
  18. 2017Deformable Convolutional Networkscited by 1,481
  19. 2016YOLO9000: Better, Faster, Strongercited by 1,429
  20. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  21. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
  22. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
  23. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  24. 2022Planning-oriented Autonomous Drivingcited by 1,068
  25. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
  26. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  27. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
  28. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
  29. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
  30. 2016Simple Online and Realtime Trackingcited by 862
  31. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  32. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
  33. 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
  34. 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
  35. 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
  36. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
  37. 2020A Survey on Visual Transformercited by 653
  38. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568

50 most cited of 212 All 212 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 7.

9 papers.

  1. 2025Synthesizing and Identifying Noise Levels in Autonomous Vehicle Camera Radar Datasetscited by 1
  2. 2026Radar-Informed 3D Multi-Object Tracking under Adverse Conditionscited by 1
  3. 2025FIN: Fast Inference Network for Map Segmentationcited by 0
  4. 2026physfusion: A Transformer-based Dual-Stream Radar and Vision Fusion Framework for Open Water Surface Object Detectioncited by 0
  5. 2026calibfusion: Transformer-Based Differentiable Calibration for Radar-Camera Fusion Detection in Water-Surface Environmentscited by 0
  6. 2026REFNet++: Multi-Task Efficient Fusion of Camera and Radar Sensor Data in Bird's-Eye Polar Viewcited by 0
  7. 2026A Camera-Cooperative ISAC Framework for Multimodal Non-Cooperative UAVs Sensingcited by 0
  8. 2026Radar Guided Camera Verification for Automatic Emergency Braking Rethinking Object Detection in Radar Camera Fusioncited by 0
  9. 2026CRISP: A Spatiotemporal Camera-Radar Backbone for Driving via Forecasting-Based World-Model Pretrainingcited by 0