DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
In recent years, the neural implicit surface has emerged as a powerful representation for multi-view surface reconstruction due to its simplicity and state-of-the-art performance. However, reconstructing smooth and detailed surfaces in indoor scenes from multi-view images presents unique challenges. Indoor scenes typically contain large texture-less regions, making the photometric loss unreliable for optimizing the implicit surface. Previous work utilizes monocular geometry priors to improve the reconstruction in indoor scenes. However, monocular priors often contain substantial errors in thin structure regions due to domain gaps and the inherent inconsistencies when derived independently from different views. This paper presents DebSDF to address these challenges, focusing on the utilization of uncertainty in monocular priors and the bias in SDF-based volume rendering. We propose an uncertainty modeling technique that associates larger uncertainties with larger errors in the monocular priors. High-uncertainty priors are then excluded from optimization to prevent bias. This uncertainty measure also informs an importance-guided ray sampling and adaptive smoothness regularization, enhancing the learning of fine structures. We further introduce a bias-aware signed distance function to density transformation that takes into account the curvature and the angle between the view direction and the SDF normals to reconstruct fine details better. Our approach has been validated through extensive experiments on several challenging datasets, demonstrating improved qualitative and quantitative results in reconstructing thin structures in indoor scenes, thereby outperforming previous work.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 51 of its 74 references that are in the map. First posted on arXiv 29 Aug 2023.
Builds on
51 of 74 references.
References · 51
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
38 more
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 254
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 207
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
- 2019Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awarenesscited by 151
- 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 127
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 121
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
- 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
- 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
- 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 106
- 2020Fast-MVSNet: Sparse-to-Dense Multi-View Stereo With Learned Propagation and Gauss-Newton Refinementcited by 105
- 2022Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantificationcited by 73
- 2020Depth Uncertainty in Neural Networkscited by 57
- 2020Uncertainty-Aware CNNs for Depth Completion: Uncertainty from Beginning to Endcited by 55
- 2021Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentationcited by 31
- 2019RayNet: Learning Volumetric 3D Reconstruction with Ray Potentialscited by 26
- 2022Exploring Differential Geometry in Neural Implicitscited by 26
- 2021Bayesian Deep Basis Fitting for Depth Completion with Uncertaintycited by 23
- 2023HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes with Iterative Intertwined Regularizationcited by 20
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 12; 2025: 2; 2026: 2.
17 papers.
Sort:
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 81
- 2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 45
- 2023DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptationcited by 32
- 2024NeuRodin: A Two-stage Framework for High-Fidelity Neural Surface Reconstructioncited by 16
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstructioncited by 15
- 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Videocited by 12
- 2024ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstructioncited by 11
- 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphonescited by 10
- 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splatscited by 5
- 20243D StreetUnveiler with Semantic-aware 2DGS -- a simple baselinecited by 4
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstructioncited by 3
5 more
- 2025IM360: Large-scale Indoor Mapping with 360 Camerascited by 3
- 2024GURecon: Learning Detailed 3D Geometric Uncertainties for Neural Surface Reconstructioncited by 1
- 2024Prism: Semi-Supervised Multi-View Stereo with Monocular Structure Priorscited by 0
- 2026CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstructioncited by 0
- 2026NeuDonatello: Uncertainty-Aware Framework for Accurate Neural SDF Learningcited by 0
- 2026NeuDonatello: Uncertainty-Aware Framework for Accurate Neural SDF Learning27 Aug 2026
- 2026CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstruction15 Jul 2026
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstruction24 Mar 2025
- 2025IM360: Large-scale Indoor Mapping with 360 Cameras18 Feb 2025
- 2024GURecon: Learning Detailed 3D Geometric Uncertainties for Neural Surface Reconstruction19 Dec 2024
- 2024Prism: Semi-Supervised Multi-View Stereo with Monocular Structure Priors8 Dec 2024
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstruction29 Nov 2024
- 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphones28 Nov 2024
- 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splats23 Nov 2024
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLM7 Nov 2024
- 2024ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstruction22 Aug 2024
- 2024NeuRodin: A Two-stage Framework for High-Fidelity Neural Surface Reconstruction19 Aug 2024
5 more
- 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Video21 Jul 2024
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild29 May 2024
- 20243D StreetUnveiler with Semantic-aware 2DGS -- a simple baseline28 May 2024
- 2024PhyRecon: Physically Plausible Neural Scene Reconstruction25 Apr 2024
- 2023DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptation28 Nov 2023
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 81
- 2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 45
- 2023DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptationcited by 32
- 2024NeuRodin: A Two-stage Framework for High-Fidelity Neural Surface Reconstructioncited by 16
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstructioncited by 15
- 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Videocited by 12
- 2024ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstructioncited by 11
- 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphonescited by 10
- 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splatscited by 5
- 20243D StreetUnveiler with Semantic-aware 2DGS -- a simple baselinecited by 4
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstructioncited by 3
12 most cited of 17 All 17 (JSON)
- 2026NeuDonatello: Uncertainty-Aware Framework for Accurate Neural SDF Learning27 Aug 2026
- 2026CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstruction15 Jul 2026
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstruction24 Mar 2025
- 2025IM360: Large-scale Indoor Mapping with 360 Cameras18 Feb 2025
- 2024GURecon: Learning Detailed 3D Geometric Uncertainties for Neural Surface Reconstruction19 Dec 2024
- 2024Prism: Semi-Supervised Multi-View Stereo with Monocular Structure Priors8 Dec 2024
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstruction29 Nov 2024
- 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphones28 Nov 2024
- 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splats23 Nov 2024
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLM7 Nov 2024
- 2024ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstruction22 Aug 2024
- 2024NeuRodin: A Two-stage Framework for High-Fidelity Neural Surface Reconstruction19 Aug 2024
12 newest of 17 All 17 (JSON)