NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies
Not on the map. Why?
Abstract (arXiv)
We present a novel method, called NeuralUDF, for reconstructing surfaces with arbitrary topologies from 2D images via volume rendering. Recent advances in neural rendering based reconstruction have achieved compelling results. However, these methods are limited to objects with closed surfaces since they adopt Signed Distance Function (SDF) as surface representation which requires the target shape to be divided into inside and outside. In this paper, we propose to represent surfaces as the Unsigned Distance Function (UDF) and develop a new volume rendering scheme to learn the neural UDF representation. Specifically, a new density function that correlates the property of UDF with the volume rendering scheme is introduced for robust optimization of the UDF fields. Experiments on the DTU and DeepFashion3D datasets show that our method not only enables high-quality reconstruction of non-closed shapes with complex typologies, but also achieves comparable performance to the SDF based methods on the reconstruction of closed surfaces.
Key facts. Cited by 63 papers in the map (data through 14 Oct 2026). Builds on 36 of its 58 references that are in the map. First posted on arXiv 25 Nov 2022.
Builds on
36 of 58 references.
References · 36
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2020Neural Sparse Voxel Fieldscited by 959
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
24 more
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 254
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2017Learning a Multi-View Stereo Machinecited by 194
- 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 180
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 177
- 2019SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimizationcited by 159
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 137
- 2017SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsiscited by 128
- 2021Neural Lumigraph Renderingcited by 105
- 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 103
- 2021Learning Signed Distance Field for Multi-view Surface Reconstructioncited by 76
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 76
- 2020Multi-view Depth Estimation using Epipolar Spatio-Temporal Networkscited by 59
- 2021Adaptive Surface Normal Constraint for Depth Estimationcited by 43
- 2020Occlusion-Aware Depth Estimation with Adaptive Normal Constraintscited by 41
- 20223PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologiescited by 27
- 2020SurfaceNet+: An End-to-end 3D Neural Network for Very Sparse Multi-view Stereopsiscited by 13
Built on by
Citing papers per year: 2023: 17; 2024: 27; 2025: 12; 2026: 7.
63 papers.
Sort:
By area:
- 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
- 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 41
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignmentcited by 39
- 2023Single-view 3D Scene Reconstruction with High-fidelity Shape and Texturecited by 37
- 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projectioncited by 36
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 33
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priorscited by 28
- 2023Ghost on the Shell: An Expressive Representation of General 3D Shapescited by 24
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusioncited by 23
- 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Coveringcited by 22
38 more
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
- 2024Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fieldscited by 16
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mappingcited by 15
- 2025GaussianUDF: Inferring Unsigned Distance Functions through 3D Gaussian Splattingcited by 15
- 2024Geometry Field Splatting with Gaussian Surfelscited by 13
- 20243D Neural Edge Reconstructioncited by 12
- 2025Neural Radiance Fields for the Real World: A Surveycited by 12
- 2023Digging into Depth Priors for Outdoor Neural Radiance Fieldscited by 11
- 2023CF-NeRF: Camera Parameter Free Neural Radiance Fields with Incremental Learningcited by 11
- 2024DMesh++: An Efficient Differentiable Mesh for Complex Shapescited by 11
- 2023NeuDA: Neural Deformable Anchor for High-Fidelity Implicit Surface Reconstructioncited by 10
- 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracingcited by 9
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scalingcited by 9
- 2024Neural-ABC: Neural Parametric Models for Articulated Body with Clothescited by 9
- 2024DMesh: A Differentiable Mesh Representationcited by 9
- 2025Bridging 3D Anomaly Localization and Repair via High-Quality Continuous Geometric Representationcited by 9
- 20232S-UDF: A Novel Two-stage UDF Learning Method for Robust Non-watertight Model Reconstruction from Multi-view Imagescited by 8
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
- 2025PDT: Point Distribution Transformation with Diffusion Modelscited by 8
- 2023NU-MCC: Multiview Compressive Coding with Neighborhood Decoder and Repulsive UDFcited by 7
- 2024Details Enhancement in Unsigned Distance Field Learning for High-fidelity 3D Surface Reconstructioncited by 7
- 2024A Lightweight UDF Learning Framework for 3D Reconstruction Based on Local Shape Functionscited by 7
- 2024Unsigned Orthogonal Distance Fields: An Accurate Neural Implicit Representation for Diverse 3D Shapescited by 6
- 2023Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fieldscited by 5
- 20244DRecons: 4D Neural Implicit Deformable Objects Reconstruction from a single RGB-D Camera with Geometrical and Topological Regularizationscited by 5
- 2024HashPoint: Accelerated Point Searching and Sampling for Neural Renderingcited by 4
- 2024Depth Reconstruction with Neural Signed Distance Fields in Structured Light Systemscited by 4
- 2024DCUDF2: Improving Efficiency and Accuracy in Extracting Zero Level Sets from Unsigned Distance Fieldscited by 4
- 2025Differentiable Light Transport with Gaussian Surfels via Adapted Radiosity for Efficient Relighting and Geometry Reconstructioncited by 4
- 2025NoKSR: Kernel-Free Neural Surface Reconstruction via Point Cloud Serializationcited by 3
- 2025HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguitycited by 3
- 2024Oriented-grid Encoder for 3D Implicit Representationscited by 2
- 2024From Transparent to Opaque: Rethinking Neural Implicit Surfaces with α-NeuScited by 2
- 20243D-WAG: Hierarchical Wavelet-Guided Autoregressive Generation for High-Fidelity 3D Shapescited by 2
- 2025High Resolution UDF Meshing via Iterative Networkscited by 2
- 2024High-fidelity Endoscopic Image Synthesis by Utilizing Depth-guided Neural Surfacescited by 1
- 2024Point Cloud Unsupervised Pre-training via 3D Gaussian Splattingcited by 1
- 20263D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstructioncited by 1
50 most cited of 63 All 63 (JSON)
- 2026Volume Rendering with Metric--Phase Fields for Thin Structures and Sign-Ambiguous Geometry9 Oct 2026
- 2026Convolutional Neural Shading for High-Quality 3D Reconstruction from Multi-View Images30 Jul 2026
- 2026DiffGI: Differentiable Geometry Images for High-Fidelity Thin-Shell 3D Generation15 Jul 2026
- 2026S2MDF: A Plug-And-Play Layer for Intersection-Free Multi-Object Signed Distance Fields28 May 2026
- 2026PCM-NeRF: Probabilistic Camera Modeling for Neural Radiance Fields under Pose Uncertainty20 Apr 2026
- 20263D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstruction20 Mar 2026
- 2026Patch-based Representation and Learning for Efficient Deformation Modeling8 Jan 2026
- 2025Differentiable Light Transport with Gaussian Surfels via Adapted Radiosity for Efficient Relighting and Geometry Reconstruction23 Sep 2025
- 2025High Resolution UDF Meshing via Iterative Networks21 Sep 2025
- 2025PDT: Point Distribution Transformation with Diffusion Models25 Jul 2025
- 2025HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguity30 Jun 2025
- 2025MIND: Material Interface Generation from UDFs for Non-Manifold Surface Reconstruction3 Jun 2025
38 more
- 2025Bridging 3D Anomaly Localization and Repair via High-Quality Continuous Geometric Representation30 May 2025
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling27 Mar 2025
- 2025Learning Scene-Level Signed Directional Distance Function with Ellipsoidal Priors and Neural Residuals25 Mar 2025
- 2025GaussianUDF: Inferring Unsigned Distance Functions through 3D Gaussian Splatting25 Mar 2025
- 2025NoKSR: Kernel-Free Neural Surface Reconstruction via Point Cloud Serialization18 Feb 2025
- 2025Neural Shortest Path for Surface Reconstruction from Point Clouds9 Feb 2025
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
- 2024DMesh++: An Efficient Differentiable Mesh for Complex Shapes21 Dec 2024
- 20243D-WAG: Hierarchical Wavelet-Guided Autoregressive Generation for High-Fidelity 3D Shapes28 Nov 2024
- 2024Point Cloud Unsupervised Pre-training via 3D Gaussian Splatting27 Nov 2024
- 2024Geometry Field Splatting with Gaussian Surfels26 Nov 2024
- 2024From Transparent to Opaque: Rethinking Neural Implicit Surfaces with α-NeuS8 Nov 2024
- 2024Gradient Distance Function29 Oct 2024
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Set18 Oct 2024
- 2024DCUDF2: Improving Efficiency and Accuracy in Extracting Zero Level Sets from Unsigned Distance Fields30 Aug 2024
- 2024Neural Octahedral Field: Octahedral prior for simultaneous smoothing and sharp edge regularization1 Aug 2024
- 2024A Comparative Study of Neural Surface Reconstruction for Scientific Visualization30 Jul 2024
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priors23 Jul 2024
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping4 Jul 2024
- 2024A Lightweight UDF Learning Framework for 3D Reconstruction Based on Local Shape Functions1 Jul 2024
- 20244DRecons: 4D Neural Implicit Deformable Objects Reconstruction from a single RGB-D Camera with Geometrical and Topological Regularizations14 Jun 2024
- 2024Details Enhancement in Unsigned Distance Field Learning for High-fidelity 3D Surface Reconstruction1 Jun 2024
- 20243D Neural Edge Reconstruction29 May 2024
- 2024Depth Reconstruction with Neural Signed Distance Fields in Structured Light Systems20 May 2024
- 2024HashPoint: Accelerated Point Searching and Sampling for Neural Rendering22 Apr 2024
- 2024DMesh: A Differentiable Mesh Representation20 Apr 2024
- 2024High-fidelity Endoscopic Image Synthesis by Utilizing Depth-guided Neural Surfaces20 Apr 2024
- 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading15 Apr 2024
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusion10 Apr 2024
- 2024Neural-ABC: Neural Parametric Models for Articulated Body with Clothes6 Apr 2024
- 2024Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fields24 Mar 2024
- 2024Unsigned Orthogonal Distance Fields: An Accurate Neural Implicit Representation for Diverse 3D Shapes3 Mar 2024
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scaling14 Feb 2024
- 2024Oriented-grid Encoder for 3D Implicit Representations9 Feb 2024
- 2023CF-NeRF: Camera Parameter Free Neural Radiance Fields with Incremental Learning14 Dec 2023
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Models28 Nov 2023
- 2023Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture1 Nov 2023
- 2023Ghost on the Shell: An Expressive Representation of General 3D Shapes23 Oct 2023
50 newest of 63 All 63 (JSON)
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusioncited by 23
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
- 2025PDT: Point Distribution Transformation with Diffusion Modelscited by 8
- 2026DiffGI: Differentiable Geometry Images for High-Fidelity Thin-Shell 3D Generationcited by 0
- 2026DiffGI: Differentiable Geometry Images for High-Fidelity Thin-Shell 3D Generation15 Jul 2026
- 2025PDT: Point Distribution Transformation with Diffusion Models25 Jul 2025
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusion10 Apr 2024
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Models28 Nov 2023
- 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
- 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 41
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignmentcited by 39
- 2023Single-view 3D Scene Reconstruction with High-fidelity Shape and Texturecited by 37
- 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projectioncited by 36
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 33
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priorscited by 28
- 2023Ghost on the Shell: An Expressive Representation of General 3D Shapescited by 24
- 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Coveringcited by 22
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
12 most cited of 59 All 59 (JSON)
- 2026Volume Rendering with Metric--Phase Fields for Thin Structures and Sign-Ambiguous Geometry9 Oct 2026
- 2026Convolutional Neural Shading for High-Quality 3D Reconstruction from Multi-View Images30 Jul 2026
- 2026S2MDF: A Plug-And-Play Layer for Intersection-Free Multi-Object Signed Distance Fields28 May 2026
- 2026PCM-NeRF: Probabilistic Camera Modeling for Neural Radiance Fields under Pose Uncertainty20 Apr 2026
- 20263D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstruction20 Mar 2026
- 2026Patch-based Representation and Learning for Efficient Deformation Modeling8 Jan 2026
- 2025Differentiable Light Transport with Gaussian Surfels via Adapted Radiosity for Efficient Relighting and Geometry Reconstruction23 Sep 2025
- 2025High Resolution UDF Meshing via Iterative Networks21 Sep 2025
- 2025HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguity30 Jun 2025
- 2025MIND: Material Interface Generation from UDFs for Non-Manifold Surface Reconstruction3 Jun 2025
- 2025Bridging 3D Anomaly Localization and Repair via High-Quality Continuous Geometric Representation30 May 2025
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling27 Mar 2025
12 newest of 59 All 59 (JSON)