mlsanityData to 7 Oct 2026

Neural Surface Reconstruction from Sparse Views Using Epipolar Geometry

arXiv 2406.04301 ↗First posted 6 Jun 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Reconstructing accurate surfaces from sparse multi-view images remains challenging due to severe geometric ambiguity and occlusions. Existing generalizable neural surface reconstruction methods primarily rely on cost volumes that summarize multi-view features using simple statistics (e.g., mean and variance), which discard critical view-dependent geometric structure and often lead to over-smoothed reconstructions. We propose EpiS, a generalizable neural surface reconstruction framework that explicitly leverages epipolar geometry for sparse-view inputs. Instead of directly regressing geometry from cost-volume statistics, EpiS uses coarse cost-volume features to guide the aggregation of fine-grained epipolar features sampled along corresponding epipolar lines across source views. An epipolar transformer fuses multi-view information, followed by ray-wise aggregation to produce SDF-aware features for surface estimation. To further mitigate information loss under sparse views, we introduce a geometry regularization strategy that leverages a pretrained monocular depth model through scale-invariant global and local constraints. Extensive experiments on DTU and BlendedMVS demonstrate that EpiS significantly outperforms state-of-the-art generalizable surface reconstruction methods under sparse-view settings, while maintaining strong generalization without per-scene optimization.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 42 of its 61 references that are in the map. First posted on arXiv 6 Jun 2024.

Builds on

42 of 61 references.

References · 42

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  4. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  5. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  7. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  8. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  9. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  10. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  11. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  12. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
30 more
  1. 2020Neural Sparse Voxel Fieldscited by 959
  2. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  3. 2020Convolutional Occupancy Networkscited by 760
  4. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  5. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  6. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  7. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  8. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  9. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  10. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  11. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  12. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
  13. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
  14. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  15. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  16. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
  17. 2017Learning a Multi-View Stereo Machinecited by 194
  18. 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
  19. 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
  20. 2017SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsiscited by 128
  21. 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
  22. 2022Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstructioncited by 92
  23. 2021Learning Signed Distance Field for Multi-view Surface Reconstructioncited by 76
  24. 2022VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstructioncited by 61
  25. 2023DynPoint: Dynamic Neural Point For View Synthesiscited by 37
  26. 2023ReTR: Modeling Rendering Via Transformer for Generalizable Neural Surface Reconstructioncited by 30
  27. 2022DevNet: Self-supervised Monocular Depth Learning via Density Volume Constructioncited by 22
  28. 2024GenS: Generalizable Neural Surface Reconstruction from Multi-View Imagescited by 15
  29. 2020VMLoc: Variational Fusion For Learning-Based Multimodal Camera Localizationcited by 13
  30. 2020SurfaceNet+: An End-to-end 3D Neural Network for Very Sparse Multi-view Stereopsiscited by 13

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 2.

4 papers.