mlsanityData to 7 Oct 2026

Surface-Based Visibility-Guided Uncertainty for Continuous Active 3D Neural Reconstruction

arXiv 2405.02568 ↗First posted 4 May 2024cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

View selection is critical in active 3D neural reconstruction as it impacts the contents of training set and resulting final output quality. Recent view selection strategies emphasize the visibility when evaluating model uncertainty in active 3D reconstruction. However, existing approaches estimate visibility only after the model fully converges, which has confined their application primarily to non-continuous active learning settings. This paper proposes Surface-Based Visibility field (SBV) that successfully estimates the visibility-guided uncertainty in continuous active 3D neural reconstruction. During learning neural implicit surfaces, our model learns rendering uncertainties and infers surface confidence values derived from signed distance functions. It then updates surface confidences using a voxel grid, robustly deducing the surface-based visibility for uncertainties. This approach captures uncertainties across all regions, whether well-defined surfaces or ambiguous areas, ensuring accurate visibility measurement in continuous active learning. Experiments on benchmark datasets-Tanks and Temples, BlendedMVS, Blender, DTU-and the newly proposed imbalanced viewpoint dataset (ImBView) show that view selection based on SBV-guided uncertainty improves performance by up to 11.6% over existing methods, highlighting its effectiveness in challenging reconstruction scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 44 references that are in the map. First posted on arXiv 4 May 2024.

Builds on

22 of 44 references.

References · 22

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  6. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  7. 2020Neural Sparse Voxel Fieldscited by 959
  8. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  9. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  10. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  11. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  12. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
10 more
  1. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
  2. 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
  3. 2024High-quality Surface Reconstruction using Gaussian Surfelscited by 159
  4. 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 137
  5. 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 124
  6. 2023FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Informationcited by 63
  7. 2023NeU-NBV: Next Best View Planning Using Uncertainty Estimation in Image-Based Neural Renderingcited by 53
  8. 2022ActiveRMAP: Radiance Field for Active Mapping And Planningcited by 29
  9. 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observationscited by 27
  10. 2023Floaters No More: Radiance Field Gradient Scaling for Improved Near-Camera Trainingcited by 25

Built on by

Not cited yet.