mlsanityData to 7 Oct 2026

Improving Neural Indoor Surface Reconstruction with Mask-Guided Adaptive Consistency Constraints

arXiv 2309.09739 ↗First posted 18 Sep 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction. Equipped with data-driven pre-trained geometric cues, these methods have demonstrated promising performance. However, inaccurate prior estimation, which is usually inevitable, can lead to suboptimal reconstruction quality, particularly in some geometrically complex regions. In this paper, we propose a two-stage training process, decouple view-dependent and view-independent colors, and leverage two novel consistency constraints to enhance detail reconstruction performance without requiring extra priors. Additionally, we introduce an essential mask scheme to adaptively influence the selection of supervision constraints, thereby improving performance in a self-supervised paradigm. Experiments on synthetic and real-world datasets show the capability of reducing the interference from prior estimation errors and achieving high-quality scene reconstruction with rich geometric details.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 41 references that are in the map. First posted on arXiv 18 Sep 2023.

Builds on

32 of 41 references.

References · 32

  1. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  2. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  4. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  5. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  6. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  7. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  8. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
  9. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  10. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  11. 2021Neural RGB-D Surface Reconstructioncited by 312
  12. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
20 more
  1. 2020State of the Art on Neural Renderingcited by 276
  2. 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
  3. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  4. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  5. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  6. 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
  7. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
  8. 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
  9. 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
  10. 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
  11. 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
  12. 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
  13. 2020Auto-Rectify Network for Unsupervised Indoor Depth Estimationcited by 39
  14. 2022RGB-Depth Fusion GAN for Indoor Depth Completioncited by 18
  15. 2023FrozenRecon: Pose-free 3D Scene Reconstruction with Frozen Depth Modelscited by 17
  16. 2023Real-Time Dense 3D Mapping of Underwater Environmentscited by 16
  17. 2022Towards 3D Scene Reconstruction from Locally Scale-Aligned Monocular Video Depthcited by 11
  18. 2020Robotic Grasping through Combined Image-Based Grasp Proposal and 3D Reconstructioncited by 9
  19. 2022NeuralRoom: Geometry-Constrained Neural Implicit Surfaces for Indoor Scene Reconstructioncited by 5
  20. 2023Efficient Implicit Neural Reconstruction Using LiDARcited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.