mlsanityData to 14 Oct 2026

ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstruction

arXiv 2408.12598 ↗First posted 22 Aug 2024cs.CV cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Neural implicit reconstruction via volume rendering has demonstrated its effectiveness in recovering dense 3D surfaces. However, it is non-trivial to simultaneously recover meticulous geometry and preserve smoothness across regions with differing characteristics. To address this issue, previous methods typically employ geometric priors, which are often constrained by the performance of the prior models. In this paper, we propose ND-SDF, which learns a Normal Deflection field to represent the angular deviation between the scene normal and the prior normal. Unlike previous methods that uniformly apply geometric priors on all samples, introducing significant bias in accuracy, our proposed normal deflection field dynamically learns and adapts the utilization of samples based on their specific characteristics, thereby improving both the accuracy and effectiveness of the model. Our method not only obtains smooth weakly textured regions such as walls and floors but also preserves the geometric details of complex structures. In addition, we introduce a novel ray sampling strategy based on the deflection angle to facilitate the unbiased rendering process, which significantly improves the quality and accuracy of intricate surfaces, especially on thin structures. Consistent improvements on various challenging datasets demonstrate the superiority of our method.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 22 Aug 2024.

Builds on

36 of 53 references.

References · 36

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  8. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  9. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  10. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  11. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  12. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
24 more
  1. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  2. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  3. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  4. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  5. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
  6. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  7. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
  8. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
  9. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
  10. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 221
  11. 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
  12. 2021Pixel Difference Networks for Efficient Edge Detectioncited by 168
  13. 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
  14. 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
  15. 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 73
  16. 2022IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesiscited by 50
  17. 2022Vox-Surf: Voxel-based Implicit Surface Representationcited by 49
  18. 2022PVO: Panoptic Visual Odometrycited by 26
  19. 2022iDF-SLAM: End-to-End RGB-D SLAM with Neural Implicit Mapping and Deep Feature Trackingcited by 22
  20. 2023HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes with Iterative Intertwined Regularizationcited by 20
  21. 2023DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstructioncited by 17
  22. 2024NeuRodin: A Two-stage Framework for High-Fidelity Neural Surface Reconstructioncited by 16
  23. 2024H2O-SDF: Two-phase Learning for 3D Indoor Reconstruction using Object Surface Fieldscited by 9
  24. 2024NC-SDF: Enhancing Indoor Scene Reconstruction Using Neural SDFs with View-Dependent Normal Compensationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 5; 2025: 4; 2026: 2.

11 papers.