mlsanityData to 14 Oct 2026

DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstruction

arXiv 2308.15536 ↗First posted 29 Aug 2023cs.CVcited by 17

Not on the map. Why?

Abstract (arXiv)

In recent years, the neural implicit surface has emerged as a powerful representation for multi-view surface reconstruction due to its simplicity and state-of-the-art performance. However, reconstructing smooth and detailed surfaces in indoor scenes from multi-view images presents unique challenges. Indoor scenes typically contain large texture-less regions, making the photometric loss unreliable for optimizing the implicit surface. Previous work utilizes monocular geometry priors to improve the reconstruction in indoor scenes. However, monocular priors often contain substantial errors in thin structure regions due to domain gaps and the inherent inconsistencies when derived independently from different views. This paper presents DebSDF to address these challenges, focusing on the utilization of uncertainty in monocular priors and the bias in SDF-based volume rendering. We propose an uncertainty modeling technique that associates larger uncertainties with larger errors in the monocular priors. High-uncertainty priors are then excluded from optimization to prevent bias. This uncertainty measure also informs an importance-guided ray sampling and adaptive smoothness regularization, enhancing the learning of fine structures. We further introduce a bias-aware signed distance function to density transformation that takes into account the curvature and the angle between the view direction and the SDF normals to reconstruct fine details better. Our approach has been validated through extensive experiments on several challenging datasets, demonstrating improved qualitative and quantitative results in reconstructing thin structures in indoor scenes, thereby outperforming previous work.

Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 51 of its 74 references that are in the map. First posted on arXiv 29 Aug 2023.

Builds on

51 of 74 references.

References · 51

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  6. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  7. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  8. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  9. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  10. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  11. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  12. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
38 more
  1. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  2. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  3. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
  4. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  5. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
  6. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
  7. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
  8. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  9. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
  10. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  11. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
  12. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
  13. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  14. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
  15. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  16. 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 254
  17. 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
  18. 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 207
  19. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  20. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
  21. 2019Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awarenesscited by 151
  22. 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 127
  23. 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
  24. 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
  25. 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 121
  26. 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
  27. 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
  28. 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
  29. 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 106
  30. 2020Fast-MVSNet: Sparse-to-Dense Multi-View Stereo With Learned Propagation and Gauss-Newton Refinementcited by 105
  31. 2022Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantificationcited by 73
  32. 2020Depth Uncertainty in Neural Networkscited by 57
  33. 2020Uncertainty-Aware CNNs for Depth Completion: Uncertainty from Beginning to Endcited by 55
  34. 2021Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentationcited by 31
  35. 2019RayNet: Learning Volumetric 3D Reconstruction with Ray Potentialscited by 26
  36. 2022Exploring Differential Geometry in Neural Implicitscited by 26
  37. 2021Bayesian Deep Basis Fitting for Depth Completion with Uncertaintycited by 23
  38. 2023HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes with Iterative Intertwined Regularizationcited by 20

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 12; 2025: 2; 2026: 2.

17 papers.

Sort:

  1. 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
  2. 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 81
  3. 2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 45
  4. 2023DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptationcited by 32
  5. 2024NeuRodin: A Two-stage Framework for High-Fidelity Neural Surface Reconstructioncited by 16
  6. 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstructioncited by 15
  7. 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Videocited by 12
  8. 2024ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstructioncited by 11
  9. 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphonescited by 10
  10. 2024SplatSDF: Boosting SDF-NeRF via Architecture-Level Fusion with Gaussian Splatscited by 5
  11. 20243D StreetUnveiler with Semantic-aware 2DGS -- a simple baselinecited by 4
  12. 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstructioncited by 3
5 more
  1. 2025IM360: Large-scale Indoor Mapping with 360 Camerascited by 3
  2. 2024GURecon: Learning Detailed 3D Geometric Uncertainties for Neural Surface Reconstructioncited by 1
  3. 2024Prism: Semi-Supervised Multi-View Stereo with Monocular Structure Priorscited by 0
  4. 2026CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstructioncited by 0
  5. 2026NeuDonatello: Uncertainty-Aware Framework for Accurate Neural SDF Learningcited by 0