LiRaFusion: Deep Adaptive LiDAR-Radar Fusion for 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
We propose LiRaFusion to tackle LiDAR-radar fusion for 3D object detection to fill the performance gap of existing LiDAR-radar detectors. To improve the feature extraction capabilities from these two modalities, we design an early fusion module for joint voxel feature encoding, and a middle fusion module to adaptively fuse feature maps via a gated network. We perform extensive evaluation on nuScenes to demonstrate that LiRaFusion leverages the complementary information of LiDAR and radar effectively and achieves notable improvement over existing methods.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 18 Feb 2024.
Builds on
32 of 49 references.
References · 32
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 313
- 2022FUTR3D: A Unified Sensor Fusion Framework for 3D Detectioncited by 194
- 20203D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detectioncited by 176
20 more
- 2017PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimationcited by 170
- 2019MVX-Net: Multimodal VoxelNet for 3D Object Detectioncited by 162
- 2020CenterFusion: Center-based Radar and Camera Fusion for 3D Object Detectioncited by 159
- 2020CLOCs: Camera-LiDAR Object Candidates Fusion for 3D Object Detectioncited by 147
- 2019The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Datasetcited by 133
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2020RADIATE: A Radar Dataset for Automotive Perception in Bad Weathercited by 98
- 2020Adaptive Context-Aware Multi-Modal Network for Depth Completioncited by 69
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
- 2021RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localizationcited by 49
- 2020RadarNet: Exploiting Radar for Robust Perception of Dynamic Objectscited by 48
- 2022MotionSC: Data Set and Network for Real-Time Semantic Mapping in Dynamic Environmentscited by 40
- 2022Improved Orientation Estimation and Detection with Hybrid Object Detection Networks for Automotive Radarcited by 33
- 2022Adaptive Feature Fusion for Cooperative Perception using LiDAR Point Cloudscited by 29
- 2022aiMotive Dataset: A Multimodal Dataset for Robust Autonomous Driving with Long-Range Perceptioncited by 29
- 2023Towards Robust Robot 3D Perception in Urban Environments: The UT Campus Object Datasetcited by 28
- 2018Robust Deep Multi-modal Learning Based on Gated Information Fusion Networkcited by 18
- 2022DeepFusion: A Robust and Modular 3D Object Detector for Lidars, Cameras and Radarscited by 16
- 2021Radar Voxel Fusion for 3D Object Detectioncited by 13
- 2022Convolutional Bayesian Kernel Inference for 3D Semantic Mappingcited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 5; 2026: 4.
10 papers.
- 2024DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Darkcited by 25
- 2025LXLv2: Enhanced LiDAR Excluded Lean 3D Object Detection with Fusion of 4D Radar and Cameracited by 13
- 2025MutualForce: Mutual-Aware Enhancement for 4D Radar-LiDAR 3D Object Detectioncited by 5
- 2025Wavelet-based Multi-View Fusion of 4D Radar Tensor and Camera for Robust 3D Object Detectioncited by 4
- 2025MoRAL: Motion-aware Multi-Frame 4D Radar and LiDAR Fusion for Robust 3D Object Detectioncited by 3
- 2025Talk2PC: Enhancing 3D Visual Grounding through LiDAR and Radar Point Clouds Fusion for Autonomous Drivingcited by 0
- 2026LRC-WeatherNet: LiDAR, RADAR, and Camera Fusion Network for Real-time Weather-type Classification in Autonomous Drivingcited by 0
- 2026ATN3D: Density-Aware LiDAR-Radar Early 3D Object Detection Under Extreme Sparsitycited by 0
- 2026RAF: Reliability-Aware Fusion of Camera, LiDAR, and 4D RADAR for Robust 3D Object Detection in Adverse Weathercited by 0
- 2026If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detectioncited by 0
- 2026If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detection2 Sep 2026
- 2026RAF: Reliability-Aware Fusion of Camera, LiDAR, and 4D RADAR for Robust 3D Object Detection in Adverse Weather6 Jul 2026
- 2026ATN3D: Density-Aware LiDAR-Radar Early 3D Object Detection Under Extreme Sparsity8 Jun 2026
- 2026LRC-WeatherNet: LiDAR, RADAR, and Camera Fusion Network for Real-time Weather-type Classification in Autonomous Driving23 Mar 2026
- 2025Wavelet-based Multi-View Fusion of 4D Radar Tensor and Camera for Robust 3D Object Detection28 Dec 2025
- 2025MoRAL: Motion-aware Multi-Frame 4D Radar and LiDAR Fusion for Robust 3D Object Detection14 May 2025
- 2025Talk2PC: Enhancing 3D Visual Grounding through LiDAR and Radar Point Clouds Fusion for Autonomous Driving11 Mar 2025
- 2025LXLv2: Enhanced LiDAR Excluded Lean 3D Object Detection with Fusion of 4D Radar and Camera20 Feb 2025
- 2025MutualForce: Mutual-Aware Enhancement for 4D Radar-LiDAR 3D Object Detection17 Jan 2025
- 2024DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Dark16 Mar 2024