Deep Implicit Surface Point Prediction Networks
Not on the map. Why?
Abstract (arXiv)
Deep neural representations of 3D shapes as implicit functions have been shown to produce high fidelity models surpassing the resolution-memory trade-off faced by the explicit representations using meshes and point clouds. However, most such approaches focus on representing closed shapes. Unsigned distance function (UDF) based approaches have been proposed recently as a promising alternative to represent both open and closed shapes. However, since the gradients of UDFs vanish on the surface, it is challenging to estimate local (differential) geometric properties like the normals and tangent planes which are needed for many downstream applications in vision and graphics. There are additional challenges in computing these properties efficiently with a low-memory footprint. This paper presents a novel approach that models such surfaces using a new class of implicit representations called the closest surface-point (CSP) representation. We show that CSP allows us to represent complex surfaces of any topology (open or closed) with high fidelity. It also allows for accurate and efficient computation of local geometric properties. We further demonstrate that it leads to efficient implementation of downstream algorithms like sphere-tracing for rendering the 3D surface as well as to create explicit mesh-based representations. Extensive experimental evaluation on the ShapeNet dataset validate the above contributions with results surpassing the state-of-the-art.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 10 Jun 2021.
Builds on
24 of 47 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2020Convolutional Occupancy Networkscited by 760
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
12 more
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
- 2019CvxNet: Learnable Convex Decompositioncited by 173
- 2020SALD: Sign Agnostic Learning with Derivativescited by 115
- 2019Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networkscited by 106
- 2019Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Eracited by 87
- 2018Robust Watertight Manifold Surface Generation Method for ShapeNet Modelscited by 58
- 2021Style-based Point Generator with Adversarial Rendering for Point Cloud Completioncited by 45
- 2017Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lightingcited by 31
- 2020Appearance Consensus Driven Self-Supervised Human Mesh Recoverycited by 27
Built on by
Citing papers per year: 2021: 5; 2022: 10; 2023: 13; 2024: 9; 2025: 1; 2026: 2.
40 papers.
Sort:
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 75
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 46
- 2022GIFS: Neural Implicit Function for General Shape Representationcited by 45
- 2023NeUDF: Leaning Neural Unsigned Distance Fields with Volume Renderingcited by 40
- 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 39
- 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projectioncited by 36
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 32
- 2023ISP: Multi-Layered Garment Draping with Implicit Sewing Patternscited by 31
- 20223PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologiescited by 27
- 2022Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Spacecited by 22
28 more
- 2021Representing 3D Shapes with Probabilistic Directed Distance Fieldscited by 21
- 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Coveringcited by 21
- 2023Neural Vector Fields: Implicit Representation by Explicit Learningcited by 16
- 2021DeepMesh: Differentiable Iso-Surface Extractioncited by 14
- 2021DeepCurrents: Learning Implicit Representations of Shapes with Boundariescited by 12
- 2023Mixing-Denoising Generalizable Occupancy Networkscited by 12
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectivescited by 9
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scalingcited by 9
- 2023SuperUDF: Self-supervised UDF Estimation for Surface Reconstructioncited by 6
- 2024Unsigned Orthogonal Distance Fields: An Accurate Neural Implicit Representation for Diverse 3D Shapescited by 6
- 2022Neural Volumetric Mesh Generatorcited by 5
- 2023MARF: The Medial Atom Ray Field Object Representationcited by 2
- 2023Neural Vector Fields: Generalizing Distance Vector Fields by Codebooks and Zero-Curl Regularizationcited by 2
- 2024A Latent Implicit 3D Shape Model for Multiple Levels of Detailcited by 2
- 2022Automated Reconstruction of 3D Open Surfaces from Sparse Point Cloudscited by 1
- 2023PU-Ray: Domain-Independent Point Cloud Upsampling via Ray Marching on Neural Implicit Surfacecited by 1
- 2024DITTO: Dual and Integrated Latent Topologies for Implicit 3D Reconstructioncited by 1
- 2024Surface Reconstruction from Point Clouds via Grid-based Intersection Predictioncited by 1
- 2024PT43D: A Probabilistic Transformer for Generating 3D Shapes from Single Highly-Ambiguous RGB Imagescited by 1
- 2022Taylor3DNet: Fast 3D Shape Inference With Landmark Points Based Taylor Seriescited by 0
- 2023Analysis of Sampling Strategies for Implicit 3D Reconstructioncited by 0
- 2023IPVNet: Learning Implicit Point-Voxel Features for Open-Surface 3D Reconstructioncited by 0
- 2024LISR: Learning Linear 3D Implicit Surface Representation Using Compactly Supported Radial Basis Functionscited by 0
- 2024Probabilistic Directed Distance Fields for Ray-Based Shape Representationscited by 0
- 2024Gradient Distance Functioncited by 0
- 2025Neural Shortest Path for Surface Reconstruction from Point Cloudscited by 0
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Drapingcited by 0
- 2026Projective Normal Fields: A Convex Optimization Method for Constructing Smooth UDFscited by 0
- 2026Projective Normal Fields: A Convex Optimization Method for Constructing Smooth UDFs28 Sep 2026
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Draping8 Feb 2026
- 2025Neural Shortest Path for Surface Reconstruction from Point Clouds9 Feb 2025
- 2024Gradient Distance Function29 Oct 2024
- 2024A Latent Implicit 3D Shape Model for Multiple Levels of Detail10 Sep 2024
- 2024PT43D: A Probabilistic Transformer for Generating 3D Shapes from Single Highly-Ambiguous RGB Images20 May 2024
- 2024Probabilistic Directed Distance Fields for Ray-Based Shape Representations13 Apr 2024
- 2024Surface Reconstruction from Point Clouds via Grid-based Intersection Prediction21 Mar 2024
- 2024DITTO: Dual and Integrated Latent Topologies for Implicit 3D Reconstruction8 Mar 2024
- 2024Unsigned Orthogonal Distance Fields: An Accurate Neural Implicit Representation for Diverse 3D Shapes3 Mar 2024
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scaling14 Feb 2024
- 2024LISR: Learning Linear 3D Implicit Surface Representation Using Compactly Supported Radial Basis Functions11 Feb 2024
28 more
- 2023Mixing-Denoising Generalizable Occupancy Networks20 Nov 2023
- 2023IPVNet: Learning Implicit Point-Voxel Features for Open-Surface 3D Reconstruction5 Nov 2023
- 2023PU-Ray: Domain-Independent Point Cloud Upsampling via Ray Marching on Neural Implicit Surface12 Oct 2023
- 2023Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Covering5 Oct 2023
- 2023Neural Vector Fields: Generalizing Distance Vector Fields by Codebooks and Zero-Curl Regularization4 Sep 2023
- 2023SuperUDF: Self-supervised UDF Estimation for Surface Reconstruction28 Aug 2023
- 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projection22 Aug 2023
- 2023MARF: The Medial Atom Ray Field Object Representation30 Jun 2023
- 2023ISP: Multi-Layered Garment Draping with Implicit Sewing Patterns23 May 2023
- 2023NeUDF: Leaning Neural Unsigned Distance Fields with Volume Rendering20 Apr 2023
- 2023Analysis of Sampling Strategies for Implicit 3D Reconstruction8 Apr 2023
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Images21 Mar 2023
- 2023Neural Vector Fields: Implicit Representation by Explicit Learning8 Mar 2023
- 2022DrapeNet: Garment Generation and Self-Supervised Draping21 Nov 2022
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectives11 Nov 2022
- 2022Automated Reconstruction of 3D Open Surfaces from Sparse Point Clouds26 Oct 2022
- 2022Neural Volumetric Mesh Generator6 Oct 2022
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimization6 Oct 2022
- 2022Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Space9 Jul 2022
- 20223PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologies31 May 2022
- 2022GIFS: Neural Implicit Function for General Shape Representation14 Apr 2022
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generation17 Mar 2022
- 2022Taylor3DNet: Fast 3D Shape Inference With Landmark Points Based Taylor Series18 Jan 2022
- 2021Representing 3D Shapes with Probabilistic Directed Distance Fields10 Dec 2021
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networks29 Nov 2021
- 2021Neural Fields in Visual Computing and Beyond22 Nov 2021
- 2021DeepCurrents: Learning Implicit Representations of Shapes with Boundaries17 Nov 2021
- 2021DeepMesh: Differentiable Iso-Surface Extraction20 Jun 2021
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 75
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 46
- 2022GIFS: Neural Implicit Function for General Shape Representationcited by 45
- 2023NeUDF: Leaning Neural Unsigned Distance Fields with Volume Renderingcited by 40
- 2022DrapeNet: Garment Generation and Self-Supervised Drapingcited by 39
- 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projectioncited by 36
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 32
- 2023ISP: Multi-Layered Garment Draping with Implicit Sewing Patternscited by 31
- 20223PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologiescited by 27
- 2022Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Spacecited by 22
12 most cited of 40 All 40 (JSON)
- 2026Projective Normal Fields: A Convex Optimization Method for Constructing Smooth UDFs28 Sep 2026
- 2026PhysDrape: Learning Explicit Forces and Collision Constraints for Physically Realistic Garment Draping8 Feb 2026
- 2025Neural Shortest Path for Surface Reconstruction from Point Clouds9 Feb 2025
- 2024Gradient Distance Function29 Oct 2024
- 2024A Latent Implicit 3D Shape Model for Multiple Levels of Detail10 Sep 2024
- 2024PT43D: A Probabilistic Transformer for Generating 3D Shapes from Single Highly-Ambiguous RGB Images20 May 2024
- 2024Probabilistic Directed Distance Fields for Ray-Based Shape Representations13 Apr 2024
- 2024Surface Reconstruction from Point Clouds via Grid-based Intersection Prediction21 Mar 2024
- 2024DITTO: Dual and Integrated Latent Topologies for Implicit 3D Reconstruction8 Mar 2024
- 2024Unsigned Orthogonal Distance Fields: An Accurate Neural Implicit Representation for Diverse 3D Shapes3 Mar 2024
- 2024DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scaling14 Feb 2024
- 2024LISR: Learning Linear 3D Implicit Surface Representation Using Compactly Supported Radial Basis Functions11 Feb 2024
12 newest of 40 All 40 (JSON)