IMKD: Intensity-Aware Multi-Level Knowledge Distillation for Camera-Radar Fusion
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific features directly to each sensor, which can distort their unique characteristics and degrade their individual strengths. To address this, we introduce IMKD, a radar-camera fusion framework based on multi-level knowledge distillation that preserves each sensor's intrinsic characteristics while amplifying their complementary strengths. IMKD applies a three-stage, intensity-aware distillation strategy to enrich the fused representation across the architecture: (1) LiDAR-to-Radar intensity-aware feature distillation to enhance radar representations with fine-grained structural cues, (2) LiDAR-to-Fused feature intensity-guided distillation to selectively highlight useful geometry and depth information at the fusion level, fostering complementarity between the modalities rather than forcing them to align, and (3) Camera-Radar intensity-guided fusion mechanism that facilitates effective feature alignment and calibration. Extensive experiments on the nuScenes benchmark show that IMKD reaches 67.0% NDS and 61.0% mAP, outperforming all prior distillation-based radar-camera fusion methods. Our code and models are available at https://github.com/dfki-av/IMKD/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 61 of its 76 references that are in the map. First posted on arXiv 17 Dec 2025.
Builds on
61 of 76 references.
Closest ancestors · 10
Same direction, newest first
- 2024LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detection14 Jul
- 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillation28 Mar
- 2023DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation26 Sep
- 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View27 Mar
- 2023X3KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection3 Mar
- 2022BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection17 Nov
- 2022Structured Knowledge Distillation Towards Efficient and Compact Multi-View 3D Detection14 Nov
- 2022Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detection14 Nov
- 2022Towards Efficient 3D Object Detection with Knowledge Distillation30 May
- 2022PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection23 May
Other references · 51
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
- 2019Objects as Pointscited by 1,175
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
38 more
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2019Class-balanced Grouping and Sampling for Point Cloud 3D Object Detectioncited by 350
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2021Probabilistic and Geometric Depth: Detecting Objects in Perspectivecited by 191
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 178
- 20203D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detectioncited by 176
- 2019MVX-Net: Multimodal VoxelNet for 3D Object Detectioncited by 163
- 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 161
- 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 150
- 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
- 2022Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Datacited by 126
- 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 96
- 2021AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Cloudscited by 88
- 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 82
- 2024RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detectioncited by 82
- 2021LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detectorcited by 70
- 2022MonoDistill: Learning Spatial Features for Monocular 3D Object Detectioncited by 68
- 2022CRAFT: Camera-Radar 3D Object Detection with Spatio-Contextual Fusion Transformercited by 67
- 2021Object DGCNN: 3D Object Detection using Dynamic Graphscited by 58
- 2022Waymo Open Dataset: Panoramic Video Panoptic Segmentationcited by 58
- 2022LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detectioncited by 55
- 2022Voxel Field Fusion for 3D Object Detectioncited by 50
- 2020RadarNet: Exploiting Radar for Robust Perception of Dynamic Objectscited by 48
- 2022Bridging the View Disparity Between Radar and Camera Features for Multi-modal Fusion 3D Object Detectioncited by 46
- 2024Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perceptioncited by 35
- 2023MVFusion: Multi-View 3D Object Detection with Semantic-aligned Radar and Camera Fusioncited by 29
- 2024BEVCar: Camera-Radar Fusion for BEV Map and Object Segmentationcited by 27
- 2023HVDetFusion: A Simple and Robust Camera-Radar Fusion Frameworkcited by 18
- 2024CRT-Fusion: Camera, Radar, Temporal Fusion Using Motion Information for 3D Object Detectioncited by 18
- 2024RCBEVDet++: Toward High-accuracy Radar-Camera Fusion 3D Perception Networkcited by 11
- 2023SimDistill: Simulated Multi-modal Distillation for BEV 3D Object Detectioncited by 10
- 2025RICCARDO: Radar Hit Prediction and Convolution for Camera-Radar 3D Object Detectioncited by 9
- 2023StereoDistill: Pick the Cream from LiDAR for Distilling Stereo-based 3D Object Detectioncited by 7
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RCTDistill: Cross-Modal Knowledge Distillation Framework for Radar-Camera 3D Object Detection with Temporal Fusion
- 2024RadarDistill: Boosting Radar-based Object Detection Performance via Knowledge Distillation from LiDAR Features
- 2024SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection
- 2024LiRCDepth: Lightweight Radar-Camera Depth Estimation via Knowledge Distillation and Uncertainty Guidance
- 2025MSDNet: Efficient 4D Radar Super-Resolution via Multi-Stage Distillation
- 2025M^3Detection: Multi-Frame Multi-Level Feature Fusion for Multi-Modal 3D Object Detection with Camera and 4D Imaging Radar
- 2024LEROjD: Lidar Extended Radar-Only Object Detection
- 2025XD-RCDepth: Lightweight Radar-Camera Depth Estimation with Explainability-Aligned and Distribution-Aware Distillation