mlsanityData to 14 Oct 2026

From Transparent to Opaque: Rethinking Neural Implicit Surfaces with α-NeuS

arXiv 2411.05362 ↗First posted 8 Nov 2024cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Traditional 3D shape reconstruction techniques from multi-view images, such as structure from motion and multi-view stereo, face challenges in reconstructing transparent objects. Recent advances in neural radiance fields and its variants primarily address opaque or transparent objects, encountering difficulties to reconstruct both transparent and opaque objects simultaneously. This paper introduces α-Neus -- an extension of NeuS -- that proves NeuS is unbiased for materials from fully transparent to fully opaque. We find that transparent and opaque surfaces align with the non-negative local minima and the zero iso-surface, respectively, in the learned distance field of NeuS. Traditional iso-surfacing extraction algorithms, such as marching cubes, which rely on fixed iso-values, are ill-suited for such data. We develop a method to extract the transparent and opaque surface simultaneously based on DCUDF. To validate our approach, we construct a benchmark that includes both real-world and synthetic scenes, demonstrating its practical utility and effectiveness. Our data and code are publicly available at https://github.com/728388808/alpha-NeuS.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 30 of its 44 references that are in the map. First posted on arXiv 8 Nov 2024.

Builds on

30 of 44 references.

References · 30

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  4. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  5. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  6. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
  7. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
  8. 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
  9. 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
  10. 2017Learning a Multi-View Stereo Machinecited by 194
  11. 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 122
  12. 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 121
18 more
  1. 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 76
  2. 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 69
  3. 2022NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologiescited by 63
  4. 2023NeUDF: Leaning Neural Unsigned Distance Fields with Volume Renderingcited by 41
  5. 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 33
  6. 2018Full 3D Reconstruction of Transparent Objectscited by 24
  7. 2020Differentiable Refraction-Tracing for Mesh Reconstruction of Transparent Objectscited by 23
  8. 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Coveringcited by 22
  9. 2023Looking Through the Glass: Neural Surface Reconstruction Against High Specular Reflectionscited by 19
  10. 2020Learned Dual-View Reflection Removalcited by 14
  11. 2023NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objectscited by 14
  12. 2020SurfaceNet+: An End-to-end 3D Neural Network for Very Sparse Multi-view Stereopsiscited by 13
  13. 2023Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Containercited by 10
  14. 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracingcited by 9
  15. 2023Volumetric Rendering with Baked Quadrature Fieldscited by 9
  16. 2022Polarimetric Inverse Rendering for Transparent Shapes Reconstructioncited by 8
  17. 20232S-UDF: A Novel Two-stage UDF Learning Method for Robust Non-watertight Model Reconstruction from Multi-view Imagescited by 8
  18. 2023αSurf: Implicit Surface Reconstruction for Semi-Transparent and Thin Objects with Decoupled Geometry and Opacitycited by 4

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.