mlsanityData to 7 Oct 2026

NC-SDF: Enhancing Indoor Scene Reconstruction Using Neural SDFs with View-Dependent Normal Compensation

arXiv 2405.00340 ↗First posted 1 May 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

State-of-the-art neural implicit surface representations have achieved impressive results in indoor scene reconstruction by incorporating monocular geometric priors as additional supervision. However, we have observed that multi-view inconsistency between such priors poses a challenge for high-quality reconstructions. In response, we present NC-SDF, a neural signed distance field (SDF) 3D reconstruction framework with view-dependent normal compensation (NC). Specifically, we integrate view-dependent biases in monocular normal priors into the neural implicit representation of the scene. By adaptively learning and correcting the biases, our NC-SDF effectively mitigates the adverse impact of inconsistent supervision, enhancing both the global consistency and local details in the reconstructions. To further refine the details, we introduce an informative pixel sampling strategy to pay more attention to intricate geometry with higher information content. Additionally, we design a hybrid geometry modeling approach to improve the neural implicit representation. Experiments on synthetic and real-world datasets demonstrate that NC-SDF outperforms existing approaches in terms of reconstruction quality.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 41 of its 66 references that are in the map. First posted on arXiv 1 May 2024.

Builds on

41 of 66 references.

References · 41

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  7. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  8. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  9. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  10. 2017A Closer Look at Memorization in Deep Networkscited by 936
  11. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  12. 2020Convolutional Occupancy Networkscited by 760
29 more
  1. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  2. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  3. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
  4. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  5. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  6. 2021Neural RGB-D Surface Reconstructioncited by 312
  7. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
  8. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  9. 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
  10. 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
  11. 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
  12. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  13. 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
  14. 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
  15. 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
  16. 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
  17. 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
  18. 2019DPSNet: End-to-end Deep Plane Sweep Stereocited by 115
  19. 2021TransformerFusion: Monocular RGB Scene Reconstruction using Transformerscited by 107
  20. 2022iSDF: Real-Time Neural Signed Distance Fields for Robot Perceptioncited by 107
  21. 2022GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstructioncited by 61
  22. 2019SharpNet: Fast and Accurate Recovery of Occluding Contours in Monocular Depth Estimationcited by 59
  23. 2023I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFscited by 42
  24. 2021VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusioncited by 38
  25. 2023HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes with Iterative Intertwined Regularizationcited by 20
  26. 2023CVRecon: Rethinking 3D Geometric Feature Learning For Neural Reconstructioncited by 16
  27. 2023SLAMesh: Real-time LiDAR Simultaneous Localization and Meshingcited by 13
  28. 2023Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Gridscited by 8
  29. 2019DR-KFS: A Differentiable Visual Similarity Metric for 3D Shape Reconstructioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 1.

5 papers.