Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projection
Not on the map. Why?
Abstract (arXiv)
Latest methods represent shapes with open surfaces using unsigned distance functions (UDFs). They train neural networks to learn UDFs and reconstruct surfaces with the gradients around the zero level set of the UDF. However, the differential networks struggle from learning the zero level set where the UDF is not differentiable, which leads to large errors on unsigned distances and gradients around the zero level set, resulting in highly fragmented and discontinuous surfaces. To resolve this problem, we propose to learn a more continuous zero level set in UDFs with level set projections. Our insight is to guide the learning of zero level set using the rest non-zero level sets via a projection procedure. Our idea is inspired from the observations that the non-zero level sets are much smoother and more continuous than the zero level set. We pull the non-zero level sets onto the zero level set with gradient constraints which align gradients over different level sets and correct unsigned distance errors on the zero level set, leading to a smoother and more continuous unsigned distance field. We conduct comprehensive experiments in surface reconstruction for point clouds, real scans or depth maps, and further explore the performance in unsupervised point cloud upsampling and unsupervised point normal estimation with the learned UDF, which demonstrate our non-trivial improvements over the state-of-the-art methods. Code is available at https://github.com/junshengzhou/LevelSetUDF .
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 75 of its 94 references that are in the map. First posted on arXiv 22 Aug 2023.
Builds on
75 of 94 references.
References · 75
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
38 more
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2020Convolutional Occupancy Networkscited by 761
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2020Local Implicit Grid Representations for 3D Scenescited by 373
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2018PU-Net: Point Cloud Upsampling Networkcited by 209
- 2021Shape As Points: A Differentiable Poisson Solvercited by 187
- 2019PU-GAN: a Point Cloud Upsampling Adversarial Networkcited by 164
- 2021SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformercited by 164
- 2020Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfacescited by 147
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2020SALD: Sign Agnostic Learning with Derivativescited by 115
- 2018Deep Geometric Prior for Surface Reconstructioncited by 110
- 2018Patch-based Progressive 3D Point Set Upsamplingcited by 101
- 2017PCPNET: Learning Local Shape Properties from Raw Point Cloudscited by 98
- 2020PMP-Net: Point Cloud Completion by Learning Multi-step Point Moving Pathscited by 97
- 2022POCO: Point Convolution for Surface Reconstructioncited by 92
- 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 77
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 76
- 2021Point Cloud Upsampling via Disentangled Refinementcited by 74
- 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 73
- 2022NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologiescited by 63
- 2020Curriculum DeepSDFcited by 62
- 2022Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priorscited by 60
- 2022PMP-Net++: Point Cloud Completion by Transformer-Enhanced Multi-step Point Moving Pathscited by 57
- 2022Surface Reconstruction from Point Clouds by Learning Predictive Context Priorscited by 54
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 47
- 20223D Shape Reconstruction from 2D Images with Disentangled Attribute Flowcited by 45
- 2022GIFS: Neural Implicit Function for General Shape Representationcited by 45
50 most cited of 75 All 75 (JSON)
Built on by
Citing papers per year: 2023: 5; 2024: 18; 2025: 12; 2026: 1.
36 papers.
Sort:
By area:
- 2024DiffGS: Functional Gaussian Splatting Diffusioncited by 51
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
- 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matchingcited by 37
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 37
- 2024Zero-Shot Scene Reconstruction from Single Images with Deep Prior Assemblycited by 35
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusioncited by 23
- 2023Learning Continuous Implicit Field with Local Distance Indicator for Arbitrary-Scale Point Cloud Upsamplingcited by 19
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mappingcited by 15
- 2025GaussianUDF: Inferring Unsigned Distance Functions through 3D Gaussian Splattingcited by 15
- 2023GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Cloudscited by 11
24 more
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priorscited by 11
- 2024MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Stepcited by 11
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scalingcited by 9
- 2024Details Enhancement in Unsigned Distance Field Learning for High-fidelity 3D Surface Reconstructioncited by 7
- 2024A Lightweight UDF Learning Framework for 3D Reconstruction Based on Local Shape Functionscited by 7
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priorscited by 7
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformationcited by 7
- 2025GAP: Gaussianize Any Point Clouds with Text Guidancecited by 7
- 2024Monge-Ampere Regularization for Learning Arbitrary Shapes from Point Cloudscited by 6
- 2024DCUDF2: Improving Efficiency and Accuracy in Extracting Zero Level Sets from Unsigned Distance Fieldscited by 4
- 2025U-CAN: Unsupervised Point Cloud Denoising with Consistency-Aware Noise2Noise Matchingcited by 3
- 2024Self-supervised Shape Completion via Involution and Implicit Correspondencescited by 2
- 20243D-WAG: Hierarchical Wavelet-Guided Autoregressive Generation for High-Fidelity 3D Shapescited by 2
- 2024Sensing Surface Patches in Volume Rendering for Inferring Signed Distance Functionscited by 2
- 2025High Resolution UDF Meshing via Iterative Networkscited by 2
- 2025GeomHair: Reconstruction of Hair Strands from Colorless 3D Scanscited by 1
- 2025A Divide-and-Conquer Approach for Global Orientation of Non-Watertight Scene-Level Point Clouds Using 0-1 Integer Optimizationcited by 1
- 2025Voronoi-Assisted Optimization for Diffusing Unsigned Distance Fields from Unoriented Pointscited by 1
- 2025Self-Supervised Implicit Attention Priors for Point Cloud Reconstructioncited by 1
- 2024DeepMIF: Deep Monotonic Implicit Fields for Large-Scale LiDAR 3D Mappingcited by 0
- 2025Neural Shortest Path for Surface Reconstruction from Point Cloudscited by 0
- 2025Polar Coordinate-Based 2D Pose Prior with Neural Distance Fieldcited by 0
- 2025MIND: Material Interface Generation from UDFs for Non-Manifold Surface Reconstructioncited by 0
- 2026Projective Normal Fields: A Convex Optimization Method for Constructing Smooth UDFscited by 0
- 2026Projective Normal Fields: A Convex Optimization Method for Constructing Smooth UDFs28 Sep 2026
- 2025Self-Supervised Implicit Attention Priors for Point Cloud Reconstruction6 Nov 2025
- 2025U-CAN: Unsupervised Point Cloud Denoising with Consistency-Aware Noise2Noise Matching29 Oct 2025
- 2025Voronoi-Assisted Optimization for Diffusing Unsigned Distance Fields from Unoriented Points14 Oct 2025
- 2025High Resolution UDF Meshing via Iterative Networks21 Sep 2025
- 2025GAP: Gaussianize Any Point Clouds with Text Guidance7 Aug 2025
- 2025MIND: Material Interface Generation from UDFs for Non-Manifold Surface Reconstruction3 Jun 2025
- 2025A Divide-and-Conquer Approach for Global Orientation of Non-Watertight Scene-Level Point Clouds Using 0-1 Integer Optimization29 May 2025
- 2025GeomHair: Reconstruction of Hair Strands from Colorless 3D Scans8 May 2025
- 2025Polar Coordinate-Based 2D Pose Prior with Neural Distance Field6 May 2025
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation31 Mar 2025
- 2025GaussianUDF: Inferring Unsigned Distance Functions through 3D Gaussian Splatting25 Mar 2025
24 more
- 2025Neural Shortest Path for Surface Reconstruction from Point Clouds9 Feb 2025
- 2024Sensing Surface Patches in Volume Rendering for Inferring Signed Distance Functions21 Dec 2024
- 20243D-WAG: Hierarchical Wavelet-Guided Autoregressive Generation for High-Fidelity 3D Shapes28 Nov 2024
- 2024MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Step2 Nov 2024
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors25 Oct 2024
- 2024DiffGS: Functional Gaussian Splatting Diffusion25 Oct 2024
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesis24 Oct 2024
- 2024Monge-Ampere Regularization for Learning Arbitrary Shapes from Point Clouds24 Oct 2024
- 2024Zero-Shot Scene Reconstruction from Single Images with Deep Prior Assembly21 Oct 2024
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Set18 Oct 2024
- 2024Self-supervised Shape Completion via Involution and Implicit Correspondences24 Sep 2024
- 2024DCUDF2: Improving Efficiency and Accuracy in Extracting Zero Level Sets from Unsigned Distance Fields30 Aug 2024
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priors23 Jul 2024
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping4 Jul 2024
- 2024A Lightweight UDF Learning Framework for 3D Reconstruction Based on Local Shape Functions1 Jul 2024
- 2024Details Enhancement in Unsigned Distance Field Learning for High-fidelity 3D Surface Reconstruction1 Jun 2024
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusion10 Apr 2024
- 2024DeepMIF: Deep Monotonic Implicit Fields for Large-Scale LiDAR 3D Mapping26 Mar 2024
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scaling14 Feb 2024
- 2023Learning Continuous Implicit Field with Local Distance Indicator for Arbitrary-Scale Point Cloud Upsampling23 Dec 2023
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Views21 Dec 2023
- 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matching7 Dec 2023
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priors17 Oct 2023
- 2023GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Clouds25 Aug 2023
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
- 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matchingcited by 37
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 37
- 2024Zero-Shot Scene Reconstruction from Single Images with Deep Prior Assemblycited by 35
- 2023Learning Continuous Implicit Field with Local Distance Indicator for Arbitrary-Scale Point Cloud Upsamplingcited by 19
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mappingcited by 15
- 2025GaussianUDF: Inferring Unsigned Distance Functions through 3D Gaussian Splattingcited by 15
- 2023GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Cloudscited by 11
- 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priorscited by 11
- 2024MultiPull: Detailing Signed Distance Functions by Pulling Multi-Level Queries at Multi-Stepcited by 11
12 most cited of 34 All 34 (JSON)
- 2026Projective Normal Fields: A Convex Optimization Method for Constructing Smooth UDFs28 Sep 2026
- 2025Self-Supervised Implicit Attention Priors for Point Cloud Reconstruction6 Nov 2025
- 2025U-CAN: Unsupervised Point Cloud Denoising with Consistency-Aware Noise2Noise Matching29 Oct 2025
- 2025Voronoi-Assisted Optimization for Diffusing Unsigned Distance Fields from Unoriented Points14 Oct 2025
- 2025High Resolution UDF Meshing via Iterative Networks21 Sep 2025
- 2025GAP: Gaussianize Any Point Clouds with Text Guidance7 Aug 2025
- 2025MIND: Material Interface Generation from UDFs for Non-Manifold Surface Reconstruction3 Jun 2025
- 2025A Divide-and-Conquer Approach for Global Orientation of Non-Watertight Scene-Level Point Clouds Using 0-1 Integer Optimization29 May 2025
- 2025GeomHair: Reconstruction of Hair Strands from Colorless 3D Scans8 May 2025
- 2025Polar Coordinate-Based 2D Pose Prior with Neural Distance Field6 May 2025
- 2025Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation31 Mar 2025
- 2025GaussianUDF: Inferring Unsigned Distance Functions through 3D Gaussian Splatting25 Mar 2025
12 newest of 34 All 34 (JSON)