Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Space
Not on the map. Why?
Abstract (arXiv)
We explore a new idea for learning based shape reconstruction from a point cloud, based on the recently popularized implicit neural shape representations. We cast the problem as a few-shot learning of implicit neural signed distance functions in feature space, that we approach using gradient based meta-learning. We use a convolutional encoder to build a feature space given the input point cloud. An implicit decoder learns to predict signed distance values given points represented in this feature space. Setting the input point cloud, i.e. samples from the target shape function's zero level set, as the support (i.e. context) in few-shot learning terms, we train the decoder such that it can adapt its weights to the underlying shape of this context with a few (5) tuning steps. We thus combine two types of implicit neural network conditioning mechanisms simultaneously for the first time, namely feature encoding and meta-learning. Our numerical and qualitative evaluation shows that in the context of implicit reconstruction from a sparse point cloud, our proposed strategy, i.e. meta-learning in feature space, outperforms existing alternatives, namely standard supervised learning in feature space, and meta-learning in euclidean space, while still providing fast inference.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 64 of its 82 references that are in the map. First posted on arXiv 9 Jul 2022.
Builds on
64 of 82 references.
References · 64
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
38 more
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Convolutional Occupancy Networkscited by 760
- 2020Implicit Geometric Regularization for Learning Shapescited by 707
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2017Neural 3D Mesh Renderercited by 437
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
- 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 377
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 340
- 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2020Learning Gradient Fields for Shape Generationcited by 245
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 240
- 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
- 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
- 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 2019CvxNet: Learnable Convex Decompositioncited by 173
- 2019SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimizationcited by 159
- 2020Neural-Pull: Learning Signed Distance Functions from Point Clouds by Learning to Pull Space onto Surfacescited by 146
- 2020Points2Surf: Learning Implicit Surfaces from Point Cloud Patchescited by 122
- 2020SALD: Sign Agnostic Learning with Derivativescited by 115
- 2018Deep Geometric Prior for Surface Reconstructioncited by 110
- 2021Neural Lumigraph Renderingcited by 105
- 2019Learning to Infer Implicit Surfaces without 3D Supervisioncited by 103
- 2019Learning elementary structures for 3D shape generation and matchingcited by 98
- 2020Deep Implicit Templates for 3D Shape Representationcited by 86
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2022: 2; 2023: 8; 2024: 8; 2025: 4.
22 papers.
Sort:
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignmentcited by 39
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priorscited by 28
- 2023Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise to Noise Mappingcited by 27
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearizationcited by 19
- 2024Unsupervised Occupancy Learning from Sparse Point Cloudcited by 15
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mappingcited by 15
- 2022Neural Mesh-Based Graphicscited by 12
- 2023Mixing-Denoising Generalizable Occupancy Networkscited by 12
- 2023GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Cloudscited by 11
- 2022Learning Generalizable Light Field Networks from Few Imagescited by 10
- 2023Robustifying Generalizable Implicit Shape Networks with a Tunable Non-Parametric Modelcited by 10
- 2023SCoDA: Domain Adaptive Shape Completion for Real Scanscited by 9
10 more
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priorscited by 7
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splattingcited by 7
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagerycited by 7
- 2025Anti-Aliased 2D Gaussian Splattingcited by 7
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learningcited by 5
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversariescited by 5
- 2024Toward Robust Neural Reconstruction from Sparse Point Setscited by 5
- 2025TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splattingcited by 3
- 2024APC2Mesh: Bridging the gap from occluded building faccades to full 3D modelscited by 2
- 2023HYVE: Hybrid Vertex Encoder for Neural Distance Fieldscited by 0
- 2025TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splatting16 Jun 2025
- 2025Anti-Aliased 2D Gaussian Splatting12 Jun 2025
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagery4 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
- 2024Toward Robust Neural Reconstruction from Sparse Point Sets20 Dec 2024
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors25 Oct 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learning27 Aug 2024
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearization19 Jul 2024
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping4 Jul 2024
- 2024Unsupervised Occupancy Learning from Sparse Point Cloud3 Apr 2024
- 2024APC2Mesh: Bridging the gap from occluded building faccades to full 3D models3 Apr 2024
10 more
- 2023Robustifying Generalizable Implicit Shape Networks with a Tunable Non-Parametric Model21 Nov 2023
- 2023Mixing-Denoising Generalizable Occupancy Networks20 Nov 2023
- 2023HYVE: Hybrid Vertex Encoder for Neural Distance Fields10 Oct 2023
- 2023GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Clouds25 Aug 2023
- 2023Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise to Noise Mapping2 Jun 2023
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignment19 May 2023
- 2023SCoDA: Domain Adaptive Shape Completion for Real Scans20 Apr 2023
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priors25 Mar 2023
- 2022Neural Mesh-Based Graphics10 Aug 2022
- 2022Learning Generalizable Light Field Networks from Few Images24 Jul 2022
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignmentcited by 39
- 2023Unsupervised Inference of Signed Distance Functions from Single Sparse Point Clouds without Learning Priorscited by 28
- 2023Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise to Noise Mappingcited by 27
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearizationcited by 19
- 2024Unsupervised Occupancy Learning from Sparse Point Cloudcited by 15
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mappingcited by 15
- 2022Neural Mesh-Based Graphicscited by 12
- 2023Mixing-Denoising Generalizable Occupancy Networkscited by 12
- 2023GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Cloudscited by 11
- 2022Learning Generalizable Light Field Networks from Few Imagescited by 10
- 2023Robustifying Generalizable Implicit Shape Networks with a Tunable Non-Parametric Modelcited by 10
- 2023SCoDA: Domain Adaptive Shape Completion for Real Scanscited by 9
12 most cited of 22 All 22 (JSON)
- 2025TextureSplat: Per-Primitive Texture Mapping for Reflective Gaussian Splatting16 Jun 2025
- 2025Anti-Aliased 2D Gaussian Splatting12 Jun 2025
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagery4 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
- 2024Toward Robust Neural Reconstruction from Sparse Point Sets20 Dec 2024
- 2024Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors25 Oct 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learning27 Aug 2024
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearization19 Jul 2024
- 2024Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping4 Jul 2024
- 2024Unsupervised Occupancy Learning from Sparse Point Cloud3 Apr 2024
- 2024APC2Mesh: Bridging the gap from occluded building faccades to full 3D models3 Apr 2024
12 newest of 22 All 22 (JSON)