ND-SDF: Learning Normal Deflection Fields for High-Fidelity Indoor Reconstruction
Not on the map. Why?
Abstract (arXiv)
Neural implicit reconstruction via volume rendering has demonstrated its effectiveness in recovering dense 3D surfaces. However, it is non-trivial to simultaneously recover meticulous geometry and preserve smoothness across regions with differing characteristics. To address this issue, previous methods typically employ geometric priors, which are often constrained by the performance of the prior models. In this paper, we propose ND-SDF, which learns a Normal Deflection field to represent the angular deviation between the scene normal and the prior normal. Unlike previous methods that uniformly apply geometric priors on all samples, introducing significant bias in accuracy, our proposed normal deflection field dynamically learns and adapts the utilization of samples based on their specific characteristics, thereby improving both the accuracy and effectiveness of the model. Our method not only obtains smooth weakly textured regions such as walls and floors but also preserves the geometric details of complex structures. In addition, we introduce a novel ray sampling strategy based on the deflection angle to facilitate the unbiased rendering process, which significantly improves the quality and accuracy of intricate surfaces, especially on thin structures. Consistent improvements on various challenging datasets demonstrate the superiority of our method.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 22 Aug 2024.
Builds on
36 of 53 references.
References · 36
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
24 more
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 221
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 168
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 73
- 2022IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesiscited by 50
- 2022Vox-Surf: Voxel-based Implicit Surface Representationcited by 49
- 2022PVO: Panoptic Visual Odometrycited by 26
- 2022iDF-SLAM: End-to-End RGB-D SLAM with Neural Implicit Mapping and Deep Feature Trackingcited by 22
- 2023HelixSurf: A Robust and Efficient Neural Implicit Surface Learning of Indoor Scenes with Iterative Intertwined Regularizationcited by 20
- 2023DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstructioncited by 17
- 2024NeuRodin: A Two-stage Framework for High-Fidelity Neural Surface Reconstructioncited by 16
- 2024H2O-SDF: Two-phase Learning for 3D Indoor Reconstruction using Object Surface Fieldscited by 9
- 2024NC-SDF: Enhancing Indoor Scene Reconstruction Using Neural SDFs with View-Dependent Normal Compensationcited by 5
Built on by
Citing papers per year: 2024: 5; 2025: 4; 2026: 2.
11 papers.
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
- 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulationcited by 36
- 2025CityGS-X: A Scalable Architecture for Efficient and Geometrically Accurate Large-Scale Scene Reconstructioncited by 26
- 2024GigaGS: Scaling up Planar-Based 3D Gaussians for Large Scene Surface Reconstructioncited by 20
- 2024DynaSurfGS: Dynamic Surface Reconstruction with Planar-based Gaussian Splattingcited by 19
- 2024StreetSurfGS: Scalable Urban Street Surface Reconstruction with Planar-based Gaussian Splattingcited by 19
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstructioncited by 15
- 20253DGAA: Realistic and Robust 3D Gaussian-based Adversarial Attack for Autonomous Drivingcited by 2
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priorscited by 1
- 20263D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstructioncited by 1
- 2026CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstructioncited by 0
- 2026CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstruction15 Jul 2026
- 20263D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstruction20 Mar 2026
- 2025PlanarGS: High-Fidelity Indoor 3D Gaussian Splatting Guided by Vision-Language Planar Priors27 Oct 2025
- 20253DGAA: Realistic and Robust 3D Gaussian-based Adversarial Attack for Autonomous Driving14 Jul 2025
- 2025CityGS-X: A Scalable Architecture for Efficient and Geometrically Accurate Large-Scale Scene Reconstruction29 Mar 2025
- 2025MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstruction24 Mar 2025
- 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulation21 Nov 2024
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusion31 Oct 2024
- 2024StreetSurfGS: Scalable Urban Street Surface Reconstruction with Planar-based Gaussian Splatting6 Oct 2024
- 2024GigaGS: Scaling up Planar-Based 3D Gaussians for Large Scene Surface Reconstruction10 Sep 2024
- 2024DynaSurfGS: Dynamic Surface Reconstruction with Planar-based Gaussian Splatting26 Aug 2024