mlsanityData to 14 Oct 2026

IMKD: Intensity-Aware Multi-Level Knowledge Distillation for Camera-Radar Fusion

arXiv 2512.15581 ↗First posted 17 Dec 2025cs.CV cs.LGcited by 0

On the map: Knowledge distillation → Detection and dense prediction distillation

Abstract (arXiv)

High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific features directly to each sensor, which can distort their unique characteristics and degrade their individual strengths. To address this, we introduce IMKD, a radar-camera fusion framework based on multi-level knowledge distillation that preserves each sensor's intrinsic characteristics while amplifying their complementary strengths. IMKD applies a three-stage, intensity-aware distillation strategy to enrich the fused representation across the architecture: (1) LiDAR-to-Radar intensity-aware feature distillation to enhance radar representations with fine-grained structural cues, (2) LiDAR-to-Fused feature intensity-guided distillation to selectively highlight useful geometry and depth information at the fusion level, fostering complementarity between the modalities rather than forcing them to align, and (3) Camera-Radar intensity-guided fusion mechanism that facilitates effective feature alignment and calibration. Extensive experiments on the nuScenes benchmark show that IMKD reaches 67.0% NDS and 61.0% mAP, outperforming all prior distillation-based radar-camera fusion methods. Our code and models are available at https://github.com/dfki-av/IMKD/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 61 of its 76 references that are in the map. First posted on arXiv 17 Dec 2025.

Builds on

61 of 76 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detection14 Jul
  2. 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillation28 Mar
  3. 2023DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation26 Sep
  4. 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View27 Mar
  5. 2023X3KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection3 Mar
  6. 2022BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection17 Nov
  7. 2022Structured Knowledge Distillation Towards Efficient and Compact Multi-View 3D Detection14 Nov
  8. 2022Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detection14 Nov
  9. 2022Towards Efficient 3D Object Detection with Knowledge Distillation30 May
  10. 2022PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection23 May

Other references · 51

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  5. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
  6. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  7. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
  8. 2019Objects as Pointscited by 1,175
  9. 2020Center-based 3D Object Detection and Trackingcited by 1,144
  10. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  11. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
  12. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
38 more
  1. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
  2. 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
  3. 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
  4. 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
  5. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
  6. 2021Voxel Transformer for 3D Object Detectioncited by 247
  7. 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
  8. 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
  9. 2021Probabilistic and Geometric Depth: Detecting Objects in Perspectivecited by 191
  10. 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 178
  11. 20203D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detectioncited by 176
  12. 2019MVX-Net: Multimodal VoxelNet for 3D Object Detectioncited by 163
  13. 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 161
  14. 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 150
  15. 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
  16. 2022Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Datacited by 126
  17. 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
  18. 2021AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Cloudscited by 88
  19. 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 82
  20. 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
  21. 2021LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detectorcited by 70
  22. 2022MonoDistill: Learning Spatial Features for Monocular 3D Object Detectioncited by 68
  23. 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 67
  24. 2021Object DGCNN: 3D Object Detection using Dynamic Graphscited by 58
  25. 2022Waymo Open Dataset: Panoramic Video Panoptic Segmentationcited by 58
  26. 2022LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detectioncited by 55
  27. 2022Voxel Field Fusion for 3D Object Detectioncited by 50
  28. 2020RadarNet: Exploiting Radar for Robust Perception of Dynamic Objectscited by 48
  29. 2022Bridging the View Disparity Between Radar and Camera Features for Multi-modal Fusion 3D Object Detectioncited by 46
  30. 2024Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perceptioncited by 35
  31. 2023MVFusion: Multi-View 3D Object Detection with Semantic-aligned Radar and Camera Fusioncited by 29
  32. 2024BEVCar: Camera-Radar Fusion for BEV Map and Object Segmentationcited by 27
  33. 2023HVDetFusion: A Simple and Robust Camera-Radar Fusion Frameworkcited by 18
  34. 2024CRT-Fusion: Camera, Radar, Temporal Fusion Using Motion Information for 3D Object Detectioncited by 18
  35. 2024RCBEVDet++: Toward High-accuracy Radar-Camera Fusion 3D Perception Networkcited by 11
  36. 2023SimDistill: Simulated Multi-modal Distillation for BEV 3D Object Detectioncited by 10
  37. 2025RICCARDO: Radar Hit Prediction and Convolution for Camera-Radar 3D Object Detectioncited by 9
  38. 2023StereoDistill: Pick the Cream from LiDAR for Distilling Stereo-based 3D Object Detectioncited by 7

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025RCTDistill: Cross-Modal Knowledge Distillation Framework for Radar-Camera 3D Object Detection with Temporal Fusion
  2. 2024RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features
  3. 2024SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection
  4. 2024LiRCDepth: Lightweight Radar-Camera Depth Estimation via Knowledge Distillation and Uncertainty Guidance
  5. 2025MSDNet: Efficient 4D Radar Super-Resolution via Multi-Stage Distillation
  6. 2025M^3Detection: Multi-Frame Multi-Level Feature Fusion for Multi-Modal 3D Object Detection with Camera and 4D Imaging Radar
  7. 2024LEROjD: Lidar Extended Radar-Only Object Detection
  8. 2025XD-RCDepth: Lightweight Radar-Camera Depth Estimation with Explainability-Aligned and Distribution-Aware Distillation