Depth-NeuS: Neural Implicit Surfaces Learning for Multi-view Reconstruction Based on Depth Information Optimization
Not on the map. Why?
Abstract (arXiv)
Recently, methods for neural surface representation and rendering, for example NeuS, have shown that learning neural implicit surfaces through volume rendering is becoming increasingly popular and making good progress. However, these methods still face some challenges. Existing methods lack a direct representation of depth information, which makes object reconstruction unrestricted by geometric features, resulting in poor reconstruction of objects with texture and color features. This is because existing methods only use surface normals to represent implicit surfaces without using depth information. Therefore, these methods cannot model the detailed surface features of objects well. To address this problem, we propose a neural implicit surface learning method called Depth-NeuS based on depth information optimization for multi-view reconstruction. In this paper, we introduce depth loss to explicitly constrain SDF regression and introduce geometric consistency loss to optimize for low-texture areas. Specific experiments show that Depth-NeuS outperforms existing technologies in multiple scenarios and achieves high-quality surface reconstruction in multiple scenarios.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 30 Mar 2023.
Builds on
25 of 35 references.
References · 25
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
13 more
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
- 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 211
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
- 2019Multi-Scale Geometric Consistency Guided Multi-View Stereocited by 105
- 2023GeCoNeRF: Few-shot Neural Radiance Fields via Geometric Consistencycited by 54
- 2022RC-MVSNet: Unsupervised Multi-View Stereo with Neural Renderingcited by 30
- 2022StructNeRF: Neural Radiance Fields for Indoor Scenes with Structural Hintscited by 28
- 2023Dynamic Multi-View Scene Reconstruction Using Neural Implicit Surfacecited by 6
- 2017Dense Piecewise Planar RGB-D SLAM for Indoor Environmentscited by 2
Built on by
Citing papers per year: 2023: 2.
2 papers.