mlsanityData to 14 Oct 2026

DeGuNet: Depth-Guided Ultra-Compact Backbones for Efficient LiDAR-Camera 3D Detection

arXiv 2607.12419 ↗First posted 14 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In autonomous driving perception, the fusion of LiDAR and camera modalities has become the dominant paradigm for 3D object detection. However, current multi-modal frameworks heavily rely on massive visual backbones pretrained on 2D semantic tasks. This reliance introduces substantial parameter redundancy and a structural misalignment, as 2D priors are ill-equipped to handle the extreme sparsity of LiDAR projections required for Bird's-Eye-View geometry. To address this, we present DeGuNet, an ultra-compact and plug-and-play image backbone explicitly designed for depth-guided representation learning. By incorporating sparsity-aware feature extraction mechanisms, DeGuNet effectively aligns multi-view images with unstructured LiDAR depth while strictly preventing invalid-region contamination. Extensive experiments on the nuScenes dataset demonstrate DeGuNet's broad plug-and-play applicability and superior efficiency. When integrated into established baselines, it fundamentally eliminates architectural redundancy, reducing GPU memory consumption by up to 66.5% and achieving a 1.16x inference speedup. Concurrently, DeGuNet delivers up to a 6.20 absolute mAP gain, establishing a new paradigm for parameter-efficient multi-modal 3D perception.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 59 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

51 of 59 references.

References · 51

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  6. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  8. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
  9. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  10. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  11. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
  12. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
38 more
  1. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 748
  2. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
  3. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
  4. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  5. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
  6. 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
  7. 20203DSSD: Point-based 3D Single Stage Object Detectorcited by 440
  8. 2019CSPNet: A New Backbone that can Enhance Learning Capability of CNNcited by 381
  9. 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
  10. 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
  11. 2017Sparsity Invariant CNNscited by 326
  12. 2021Voxel Transformer for 3D Object Detectioncited by 247
  13. 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
  14. 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 222
  15. 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
  16. 2022FUTR3D: A Unified Sensor Fusion Framework for 3D Detectioncited by 194
  17. 2021Embracing Single Stride 3D Object Detector with Sparse Transformercited by 193
  18. 2018Learning Depth with Convolutional Spatial Propagation Networkcited by 136
  19. 2022DeepInteraction: 3D Object Detection via Modality Interactioncited by 125
  20. 2022Voxel Set Transformer: A Set-to-Set Approach to 3D Object Detection from Point Cloudscited by 102
  21. 2022PillarNet: Real-Time and High-Performance Pillar-based 3D Object Detectioncited by 99
  22. 2022Fully Sparse 3D Object Detectioncited by 84
  23. 2023SparseFusion: Fusing Multi-Modal Sparse Representations for Multi-Sensor 3D Object Detectioncited by 83
  24. 2021RigNet: Repetitive Image Guided Network for Depth Completioncited by 80
  25. 2023UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representationcited by 74
  26. 2023FocalFormer3D : Focusing on Hard Instance for 3D Object Detectioncited by 58
  27. 2024IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detectioncited by 57
  28. 2023Temporal Enhanced Training of Multi-view 3D Object Detector via Historical Object Predictioncited by 49
  29. 2023LRRU: Long-short Range Recurrent Updating Networks for Depth Completioncited by 49
  30. 2022AutoAlignV2: Deformable Feature Aggregation for Dynamic Multi-Modal 3D Object Detectioncited by 46
  31. 2023EA-LSS: Edge-aware Lift-splat-shot Framework for 3D BEV Object Detectioncited by 38
  32. 2024Ray Denoising: Depth-aware Hard Negative Sampling for Multi-view 3D Object Detectioncited by 36
  33. 2023GraphAlign: Enhancing Accurate Feature Alignment by Graph matching for Multi-Modal 3D Object Detectioncited by 34
  34. 2024GraphBEV: Towards Robust BEV Feature Alignment for Multi-Modal 3D Object Detectioncited by 33
  35. 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detectioncited by 30
  36. 2023Fully Sparse Fusion for 3D Object Detectioncited by 29
  37. 2024LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernelscited by 15
  38. 2024DeepInteraction++: Multi-Modality Interaction for Autonomous Drivingcited by 15

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Li3DeTr: A LiDAR based 3D Detection Transformer
  2. 2025BEVUDA++: Geometric-aware Unsupervised Domain Adaptation for Multi-View 3D Object Detection
  3. 2025The Devil is in the Details: Simple Remedies for Image-to-LiDAR Representation Learning
  4. 2023DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation
  5. 2023UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View
  6. 2022BEV-LGKD: A Unified LiDAR-Guided Knowledge Distillation Framework for BEV 3D Object Detection
  7. 2024FSMDet: Vision-guided feature diffusion for fully sparse 3D detector
  8. 2022BEVUDA: Multi-geometric Space Alignments for Domain Adaptive BEV 3D Object Detection