NC-SDF: Enhancing Indoor Scene Reconstruction Using Neural SDFs with View-Dependent Normal Compensation
Not on the map. Why?
Abstract (arXiv)
State-of-the-art neural implicit surface representations have achieved impressive results in indoor scene reconstruction by incorporating monocular geometric priors as additional supervision. However, we have observed that multi-view inconsistency between such priors poses a challenge for high-quality reconstructions. In response, we present NC-SDF, a neural signed distance field (SDF) 3D reconstruction framework with view-dependent normal compensation (NC). Specifically, we integrate view-dependent biases in monocular normal priors into the neural implicit representation of the scene. By adaptively learning and correcting the biases, our NC-SDF effectively mitigates the adverse impact of inconsistent supervision, enhancing both the global consistency and local details in the reconstructions. To further refine the details, we introduce an informative pixel sampling strategy to pay more attention to intricate geometry with higher information content. Additionally, we design a hybrid geometry modeling approach to improve the neural implicit representation. Experiments on synthetic and real-world datasets demonstrate that NC-SDF outperforms existing approaches in terms of reconstruction quality.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 41 of its 66 references that are in the map. First posted on arXiv 1 May 2024.
Builds on
41 of 66 references.
References · 41
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2017A Closer Look at Memorization in Deep Networkscited by 936
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2020Convolutional Occupancy Networkscited by 760
29 more
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2019DPSNet: End-to-end Deep Plane Sweep Stereocited by 115
- 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 107
- 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
- 2022GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstructioncited by 61
- 2019SharpNet: Fast and Accurate Recovery of Occluding Contours in Monocular Depth Estimationcited by 59
- 2023I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFscited by 42
- 2021VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusioncited by 38
- 2023HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes with Iterative Intertwined Regularizationcited by 20
- 2023CVRecon: Rethinking 3D Geometric Feature Learning For Neural Reconstructioncited by 16
- 2023SLAMesh: Real-time LiDAR Simultaneous Localization and Meshingcited by 13
- 2023Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Gridscited by 8
- 2019DR-KFS: A Differentiable Visual Similarity Metric for 3D Shape Reconstructioncited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 1.
5 papers.
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstructioncited by 15
- 2024ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstructioncited by 11
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priorscited by 1
- 2025D3-Predictor: Noise-Free Deterministic Diffusion for Dense Predictioncited by 0
- 2026CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstructioncited by 0
- 2026CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstruction15 Jul 2026
- 2025D3-Predictor: Noise-Free Deterministic Diffusion for Dense Prediction8 Dec 2025
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priors27 Oct 2025
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstruction24 Mar 2025
- 2024ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstruction22 Aug 2024