Neural Surface Reconstruction from Sparse Views Using Epipolar Geometry
Not on the map. Why?
Abstract (arXiv)
Reconstructing accurate surfaces from sparse multi-view images remains challenging due to severe geometric ambiguity and occlusions. Existing generalizable neural surface reconstruction methods primarily rely on cost volumes that summarize multi-view features using simple statistics (e.g., mean and variance), which discard critical view-dependent geometric structure and often lead to over-smoothed reconstructions. We propose EpiS, a generalizable neural surface reconstruction framework that explicitly leverages epipolar geometry for sparse-view inputs. Instead of directly regressing geometry from cost-volume statistics, EpiS uses coarse cost-volume features to guide the aggregation of fine-grained epipolar features sampled along corresponding epipolar lines across source views. An epipolar transformer fuses multi-view information, followed by ray-wise aggregation to produce SDF-aware features for surface estimation. To further mitigate information loss under sparse views, we introduce a geometry regularization strategy that leverages a pretrained monocular depth model through scale-invariant global and local constraints. Extensive experiments on DTU and BlendedMVS demonstrate that EpiS significantly outperforms state-of-the-art generalizable surface reconstruction methods under sparse-view settings, while maintaining strong generalization without per-scene optimization.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 42 of its 61 references that are in the map. First posted on arXiv 6 Jun 2024.
Builds on
42 of 61 references.
References · 42
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
30 more
- 2020Neural Sparse Voxel Fieldscited by 959
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2020Convolutional Occupancy Networkscited by 760
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2017Learning a Multi-View Stereo Machinecited by 194
- 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
- 2017SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsiscited by 128
- 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
- 2022Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstructioncited by 92
- 2021Learning Signed Distance Field for Multi-view Surface Reconstructioncited by 76
- 2022VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstructioncited by 61
- 2023DynPoint: Dynamic Neural Point For View Synthesiscited by 37
- 2023ReTR: Modeling Rendering Via Transformer for Generalizable Neural Surface Reconstructioncited by 30
- 2022DevNet: Self-supervised Monocular Depth Learning via Density Volume Constructioncited by 22
- 2024GenS: Generalizable Neural Surface Reconstruction from Multi-View Imagescited by 15
- 2020VMLoc: Variational Fusion For Learning-Based Multimodal Camera Localizationcited by 13
- 2020SurfaceNet+: An End-to-end 3D Neural Network for Very Sparse Multi-view Stereopsiscited by 13
Built on by
Citing papers per year: 2024: 2; 2025: 2.
4 papers.
- 2024AIC MLLM: Autonomous Interactive Correction MLLM for Robust Robotic Manipulationcited by 20
- 2024LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splattingcited by 17
- 2025TransDiff: Diffusion-Based Method for Manipulating Transparent Objects Using a Single RGB-D Imagecited by 7
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challengescited by 3
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challenges22 Jul 2025
- 2025TransDiff: Diffusion-Based Method for Manipulating Transparent Objects Using a Single RGB-D Image17 Mar 2025
- 2024LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splatting1 Aug 2024
- 2024AIC MLLM: Autonomous Interactive Correction MLLM for Robust Robotic Manipulation17 Jun 2024