Exploiting Multiple Priors for Neural 3D Indoor Reconstruction
Not on the map. Why?
Abstract (arXiv)
Neural implicit modeling permits to achieve impressive 3D reconstruction results on small objects, while it exhibits significant limitations in large indoor scenes. In this work, we propose a novel neural implicit modeling method that leverages multiple regularization strategies to achieve better reconstructions of large indoor environments, while relying only on images. A sparse but accurate depth prior is used to anchor the scene to the initial model. A dense but less accurate depth prior is also introduced, flexible enough to still let the model diverge from it to improve the estimated geometry. Then, a novel self-supervised strategy to regularize the estimated surface normals is presented. Finally, a learnable exposure compensation scheme permits to cope with challenging lighting conditions. Experimental results show that our approach produces state-of-the-art 3D reconstructions in challenging indoor scenarios.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 35 of its 45 references that are in the map. First posted on arXiv 13 Sep 2023.
Builds on
35 of 45 references.
References · 35
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
23 more
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2017Neural 3D Mesh Renderercited by 437
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2021Urban Radiance Fieldscited by 263
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 211
- 2021Implicit Neural Representations for Image Compressioncited by 161
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 20163D Shape Induction from 2D Views of Multiple Objectscited by 121
- 20223D Common Corruptions and Data Augmentationcited by 120
- 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
- 2021Learning Signed Distance Field for Multi-view Surface Reconstructioncited by 76
- 2016Unsupervised Learning of 3D Structure from Imagescited by 67
- 2023Factor Fields: A Unified Framework for Neural Fields and Beyondcited by 58
- 2021IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereocited by 56
- 2019Joint Graph-based Depth Refinement and Normal Estimationcited by 12
- 2021IB-MVS: An Iterative Algorithm for Deep Multi-View Stereo based on Binary Decisionscited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.