DeGuNet: Depth-Guided Ultra-Compact Backbones for Efficient LiDAR-Camera 3D Detection
Not on the map. Why?
Abstract (arXiv)
In autonomous driving perception, the fusion of LiDAR and camera modalities has become the dominant paradigm for 3D object detection. However, current multi-modal frameworks heavily rely on massive visual backbones pretrained on 2D semantic tasks. This reliance introduces substantial parameter redundancy and a structural misalignment, as 2D priors are ill-equipped to handle the extreme sparsity of LiDAR projections required for Bird's-Eye-View geometry. To address this, we present DeGuNet, an ultra-compact and plug-and-play image backbone explicitly designed for depth-guided representation learning. By incorporating sparsity-aware feature extraction mechanisms, DeGuNet effectively aligns multi-view images with unstructured LiDAR depth while strictly preventing invalid-region contamination. Extensive experiments on the nuScenes dataset demonstrate DeGuNet's broad plug-and-play applicability and superior efficiency. When integrated into established baselines, it fundamentally eliminates architectural redundancy, reducing GPU memory consumption by up to 66.5% and achieving a 1.16x inference speedup. Concurrently, DeGuNet delivers up to a 6.20 absolute mAP gain, establishing a new paradigm for parameter-efficient multi-modal 3D perception.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 59 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
51 of 59 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
38 more
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
- 20203DSSD: Point-based 3D Single Stage Object Detectorcited by 440
- 2019CSPNet: A New Backbone that can Enhance Learning Capability of CNNcited by 381
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
- 2017Sparsity Invariant CNNscited by 326
- 2021Voxel Transformer for 3D Object Detectioncited by 247
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 222
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2022FUTR3D: A Unified Sensor Fusion Framework for 3D Detectioncited by 194
- 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
- 2018Learning Depth with Convolutional Spatial Propagation Networkcited by 136
- 2022DeepInteraction: 3D Object Detection via Modality Interactioncited by 125
- 2022Voxel Set Transformer: A Set-to-Set Approach to 3D Object Detection from Point Cloudscited by 102
- 2022PillarNet: Real-Time and High-Performance Pillar-based 3D Object Detectioncited by 99
- 2022Fully Sparse 3D Object Detectioncited by 84
- 2023SparseFusion: Fusing Multi-Modal Sparse Representations for Multi-Sensor 3D Object Detectioncited by 83
- 2021RigNet: Repetitive Image Guided Network for Depth Completioncited by 80
- 2023UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representationcited by 74
- 2023FocalFormer3D : Focusing on Hard Instance for 3D Object Detectioncited by 58
- 2024IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detectioncited by 57
- 2023Temporal Enhanced Training of Multi-view 3D Object Detector via Historical Object Predictioncited by 49
- 2023LRRU: Long-short Range Recurrent Updating Networks for Depth Completioncited by 49
- 2022AutoAlignV2: Deformable Feature Aggregation for Dynamic Multi-Modal 3D Object Detectioncited by 46
- 2023EA-LSS: Edge-aware Lift-splat-shot Framework for 3D BEV Object Detectioncited by 38
- 2024Ray Denoising: Depth-aware Hard Negative Sampling for Multi-view 3D Object Detectioncited by 36
- 2023GraphAlign: Enhancing Accurate Feature Alignment by Graph matching for Multi-Modal 3D Object Detectioncited by 34
- 2024GraphBEV: Towards Robust BEV Feature Alignment for Multi-Modal 3D Object Detectioncited by 33
- 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detectioncited by 30
- 2023Fully Sparse Fusion for 3D Object Detectioncited by 29
- 2024LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernelscited by 15
- 2024DeepInteraction++: Multi-Modality Interaction for Autonomous Drivingcited by 15
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022Li3DeTr: A LiDAR based 3D Detection Transformer
- 2025BEVUDA++: Geometric-aware Unsupervised Domain Adaptation for Multi-View 3D Object Detection
- 2025The Devil is in the Details: Simple Remedies for Image-to-LiDAR Representation Learning
- 2023DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation
- 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View
- 2022BEV-LGKD: A Unified LiDAR-Guided Knowledge Distillation Framework for BEV 3D Object Detection
- 2024FSMDet: Vision-guided feature diffusion for fully sparse 3D detector
- 2022BEVUDA: Multi-geometric Space Alignments for Domain Adaptive BEV 3D Object Detection