DFuseNet: Deep Fusion of RGB and Sparse Depth Information for Image Guided Dense Depth Completion
Not on the map. Why?
Abstract (arXiv)
In this paper we propose a convolutional neural network that is designed to upsample a series of sparse range measurements based on the contextual cues gleaned from a high resolution intensity image. Our approach draws inspiration from related work on super-resolution and in-painting. We propose a novel architecture that seeks to pull contextual cues separately from the intensity image and the depth features and then fuse them later in the network. We argue that this approach effectively exploits the relationship between the two modalities and produces accurate results while respecting salient image structures. We present experimental results to demonstrate that our approach is comparable with state of the art methods and generalizes well across multiple datasets.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 8; 2023: 7; 2024: 7; 2025: 7; 2026: 1.
38 papers.
Sort:
By area:
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layerscited by 61
- 2021Learning Topology from Synthetic Data for Unsupervised Depth Completioncited by 38
- 2022Deep Depth Completion from Extremely Sparse Data: A Surveycited by 33
- 2021An Adaptive Framework for Learning Unsupervised Depth Completioncited by 30
- 2022DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completioncited by 27
- 2024Test-Time Adaptation for Depth Completioncited by 26
- 2022Monitored Distillation for Positive Congruent Depth Completioncited by 24
- 2023AugUndo: Scaling Up Augmentations for Monocular Depth Completion and Estimationcited by 15
- 2022Depth Completion using Geometry-Aware Embeddingcited by 12
- 2024Completion as Enhancement: A Degradation-Aware Selective Image Guided Network for Depth Completioncited by 12
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypescited by 11
- 2021S3: Learnable Sparse Signal Superdensity for Guided Depth Estimationcited by 10
26 more
- 2023AGG-Net: Attention Guided Gated-convolutional Network for Depth Image Completioncited by 8
- 2024RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methodscited by 8
- 2024All-day Depth Completioncited by 8
- 2022A Low Memory Footprint Quantized Neural Network for Depth Completion of Very Sparse Time-of-Flight Depth Mapscited by 6
- 2021PDC: Piecewise Depth Completion utilizing Superpixelscited by 5
- 2024UnCLe: Benchmarking Unsupervised Continual Learning for Depth Completioncited by 5
- 2023Revisiting Deformable Convolution for Depth Completioncited by 4
- 2024Stereo-LiDAR Depth Estimation with Deformable Propagation and Learned Disparity-Depth Conversioncited by 4
- 2025A Review of 3D Object Detection with Vision-Language Modelscited by 4
- 2025ETA: Energy-based Test-time Adaptation for Depth Completioncited by 4
- 2021DVMN: Dense Validity Mask Network for Depth Completioncited by 3
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximationcited by 2
- 2022How to Guide Adaptive Depth Sampling?cited by 2
- 2023Gated Cross-Attention Network for Depth Completioncited by 2
- 2021Self-Guided Instance-Aware Network for Depth Completion and Enhancementcited by 1
- 2022Non-learning Stereo-aided Depth Completion under Mis-projection via Selective Stereo Matchingcited by 1
- 2025StarryGazer: Leveraging Monocular Depth Estimation Models for Domain-Agnostic Single Depth Image Completioncited by 1
- 2022MetaComp: Learning to Adapt for Online Depth Completioncited by 0
- 2023Sparse Depth-Guided Attention for Accurate Depth Completion: A Stereo-Assisted Monitored Distillation Approachcited by 0
- 2023DEUX: Active Exploration for Learning Unsupervised Depth Perceptioncited by 0
- 2023Self-Supervised Depth Completion Guided by 3D Perception and Geometry Consistencycited by 0
- 2024Mask-adaptive Gated Convolution and Bi-directional Progressive Fusion Network for Depth Completioncited by 0
- 2025Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereocited by 0
- 2025S2ML: Spatio-Spectral Mutual Learning for Depth Completioncited by 0
- 2025MT-Depth: Multi-task Instance feature analysis for the Depth Completioncited by 0
- 2026Depth-to-Image Synthesis-Driven Generative Unguided Depth Completioncited by 0
- 2026Depth-to-Image Synthesis-Driven Generative Unguided Depth Completion5 Sep 2026
- 2025StarryGazer: Leveraging Monocular Depth Estimation Models for Domain-Agnostic Single Depth Image Completion15 Dec 2025
- 2025MT-Depth: Multi-task Instance feature analysis for the Depth Completion4 Dec 2025
- 2025S2ML: Spatio-Spectral Mutual Learning for Depth Completion8 Nov 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereo26 Jul 2025
- 2025A Review of 3D Object Detection with Vision-Language Models25 Apr 2025
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypes17 Mar 2025
- 2024Completion as Enhancement: A Degradation-Aware Selective Image Guided Network for Depth Completion26 Dec 2024
- 2024UnCLe: Benchmarking Unsupervised Continual Learning for Depth Completion23 Oct 2024
- 2024All-day Depth Completion27 May 2024
- 2024RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methods16 May 2024
26 more
- 2024Stereo-LiDAR Depth Estimation with Deformable Propagation and Learned Disparity-Depth Conversion11 Apr 2024
- 2024Test-Time Adaptation for Depth Completion5 Feb 2024
- 2024Mask-adaptive Gated Convolution and Bi-directional Progressive Fusion Network for Depth Completion15 Jan 2024
- 2023Self-Supervised Depth Completion Guided by 3D Perception and Geometry Consistency23 Dec 2023
- 2023AugUndo: Scaling Up Augmentations for Monocular Depth Completion and Estimation15 Oct 2023
- 2023Gated Cross-Attention Network for Depth Completion28 Sep 2023
- 2023DEUX: Active Exploration for Learning Unsupervised Depth Perception16 Sep 2023
- 2023AGG-Net: Attention Guided Gated-convolutional Network for Depth Image Completion4 Sep 2023
- 2023Revisiting Deformable Convolution for Depth Completion3 Aug 2023
- 2023Sparse Depth-Guided Attention for Accurate Depth Completion: A Stereo-Assisted Monitored Distillation Approach28 Mar 2023
- 2022DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completion20 Nov 2022
- 2022Non-learning Stereo-aided Depth Completion under Mis-projection via Selective Stereo Matching4 Oct 2022
- 2022MetaComp: Learning to Adapt for Online Depth Completion21 Jul 2022
- 2022A Low Memory Footprint Quantized Neural Network for Depth Completion of Very Sparse Time-of-Flight Depth Maps25 May 2022
- 2022How to Guide Adaptive Depth Sampling?20 May 2022
- 2022Deep Depth Completion from Extremely Sparse Data: A Survey11 May 2022
- 2022Monitored Distillation for Positive Congruent Depth Completion30 Mar 2022
- 2022Depth Completion using Geometry-Aware Embedding21 Mar 2022
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layers24 Aug 2021
- 2021PDC: Piecewise Depth Completion utilizing Superpixels14 Jul 2021
- 2021DVMN: Dense Validity Mask Network for Depth Completion14 Jul 2021
- 2021An Adaptive Framework for Learning Unsupervised Depth Completion6 Jun 2021
- 2021Learning Topology from Synthetic Data for Unsupervised Depth Completion6 Jun 2021
- 2021Self-Guided Instance-Aware Network for Depth Completion and Enhancement25 May 2021
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximation23 Mar 2021
- 2021S3: Learnable Sparse Signal Superdensity for Guided Depth Estimation3 Mar 2021
- 2025A Review of 3D Object Detection with Vision-Language Models25 Apr 2025
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layerscited by 61
- 2021Learning Topology from Synthetic Data for Unsupervised Depth Completioncited by 38
- 2022Deep Depth Completion from Extremely Sparse Data: A Surveycited by 33
- 2021An Adaptive Framework for Learning Unsupervised Depth Completioncited by 30
- 2022DesNet: Decomposed Scale-Consistent Network for Unsupervised Depth Completioncited by 27
- 2024Test-Time Adaptation for Depth Completioncited by 26
- 2022Monitored Distillation for Positive Congruent Depth Completioncited by 24
- 2023AugUndo: Scaling Up Augmentations for Monocular Depth Completion and Estimationcited by 15
- 2022Depth Completion using Geometry-Aware Embeddingcited by 12
- 2024Completion as Enhancement: A Degradation-Aware Selective Image Guided Network for Depth Completioncited by 12
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypescited by 11
- 2021S3: Learnable Sparse Signal Superdensity for Guided Depth Estimationcited by 10
12 most cited of 37 All 37 (JSON)
- 2026Depth-to-Image Synthesis-Driven Generative Unguided Depth Completion5 Sep 2026
- 2025StarryGazer: Leveraging Monocular Depth Estimation Models for Domain-Agnostic Single Depth Image Completion15 Dec 2025
- 2025MT-Depth: Multi-task Instance feature analysis for the Depth Completion4 Dec 2025
- 2025S2ML: Spatio-Spectral Mutual Learning for Depth Completion8 Nov 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereo26 Jul 2025
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypes17 Mar 2025
- 2024Completion as Enhancement: A Degradation-Aware Selective Image Guided Network for Depth Completion26 Dec 2024
- 2024UnCLe: Benchmarking Unsupervised Continual Learning for Depth Completion23 Oct 2024
- 2024All-day Depth Completion27 May 2024
- 2024RGB Guided ToF Imaging System: A Survey of Deep Learning-based Methods16 May 2024
- 2024Stereo-LiDAR Depth Estimation with Deformable Propagation and Learned Disparity-Depth Conversion11 Apr 2024
12 newest of 37 All 37 (JSON)