MetaSDF: Meta-learning Signed Distance Functions
Not on the map. Why?
Abstract (arXiv)
Neural implicit shape representations are an emerging paradigm that offers many potential benefits over conventional discrete representations, including memory efficiency at a high spatial resolution. Generalizing across shapes with such neural implicit representations amounts to learning priors over the respective function space and enables geometry reconstruction from partial or noisy observations. Existing generalization methods rely on conditioning a neural network on a low-dimensional latent code that is either regressed by an encoder or jointly optimized in the auto-decoder framework. Here, we formalize learning of a shape space as a meta-learning problem and leverage gradient-based meta-learning algorithms to solve this task. We demonstrate that this approach performs on par with auto-decoder based approaches while being an order of magnitude faster at test-time inference. We further demonstrate that the proposed gradient-based method outperforms encoder-decoder based methods that leverage pooling-based set encoders.
Key facts. Cited by 214 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 42; 2022: 46; 2023: 55; 2024: 31; 2025: 25; 2026: 15.
214 papers.
Sort:
By area:
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2021Advances in Neural Renderingcited by 365
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 204
- 2023EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingScited by 191
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 183
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2021Implicit Neural Representations for Image Compressioncited by 161
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 142
38 more
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 136
- 20213D Neural Scene Representations for Visuomotor Controlcited by 110
- 2021Neural Lumigraph Renderingcited by 105
- 2023Neural Kernel Surface Reconstructioncited by 102
- 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
- 2022POCO: Point Convolution for Surface Reconstructioncited by 91
- 2023ATT3D: Amortized Text-to-3D Object Synthesiscited by 87
- 2021LOLNeRF: Learn from One Lookcited by 84
- 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
- 2022COIN++: Neural Compression Across Modalitiescited by 81
- 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 80
- 2021FoV-NeRF: Foveated Neural Radiance Fields for Virtual Realitycited by 79
- 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2022Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translationcited by 73
- 2022Unified Implicit Neural Stylizationcited by 67
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2023Deep Learning on Implicit Neural Representations of Shapescited by 62
- 2021Neural Fields as Learnable Kernels for 3D Reconstructioncited by 58
- 2022Masked Wavelet Representation for Compact Neural Radiance Fieldscited by 57
- 2022CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representationscited by 56
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 56
- 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
- 2021Generative Occupancy Fields for 3D Surface-Aware Image Synthesiscited by 51
- 2021Meta-Learning Sparse Implicit Neural Representationscited by 48
- 2021Learning Signal-Agnostic Manifolds of Neural Fieldscited by 45
- 2022A Level Set Theory for Neural Implicit Evolution under Explicit Flowscited by 42
- 2022Neural Shape Mating: Self-Supervised Object Assembly with Adversarial Shape Priorscited by 42
- 2022Generalizable Implicit Neural Representations via Instance Pattern Composerscited by 38
- 2023Dynamic Point Fieldscited by 37
- 2023Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesiscited by 37
- 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
- 2023NeMF: Inverse Volume Rendering with Neural Microflake Fieldcited by 34
- 2023VQ3D: Learning a 3D-Aware Generative Model on ImageNetcited by 32
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Viewscited by 31
- 2023SHACIRA: Scalable HAsh-grid Compression for Implicit Neural Representationscited by 31
50 most cited of 214 All 214 (JSON)
- 2026Atelier: Learning Local Self-Supervised Features for CryoEM Volumes via Hypernetworks24 Sep 2026
- 2026Implicit representations are dead. Long live explicit primitives!7 Aug 2026
- 2026From Scalars to Time Series: Rethinking Implicit Neural Representations for Time-Varying Volumetric Data23 Jul 2026
- 2026Learning Cardiac Motion Priors for Implicit Neural Representations1 Jul 2026
- 2026DSP-SLAM++: A Unified Framework for Multi-Class, High-Fidelity Object SLAM in the Wild24 Jun 2026
- 2026PatchINR: Patch-Based Implicit Neural Representations for Efficient and Scalable Inference24 Jun 2026
- 2026ForeSplat: Optimization-Aware Foresight for Feed-Forward 3D Gaussian Splatting21 May 2026
- 2026What Cohort INRs Encode and Where to Freeze Them8 May 2026
- 2026Disentangled Learning Improves Implicit Neural Representations for Medical Reconstruction5 May 2026
- 2026Implicit Neural Representations: A Signal Processing Perspective16 Apr 2026
- 2026Diff3R: Feed-forward 3D Gaussian Splatting with Uncertainty-aware Differentiable Optimization1 Apr 2026
- 2026NOIR: Neural Operator mapping for Implicit Representations13 Mar 2026
38 more
- 2026SGI: Structured 2D Gaussians for Efficient and Compact Large Image Representation8 Mar 2026
- 2026Infinite-dimensional generative diffusions via Doob's h-transform6 Feb 2026
- 2026Molecular Representations in Implicit Functional Space via Hyper-Networks29 Jan 2026
- 2025Optimizing Rank for High-Fidelity Implicit Neural Representations16 Dec 2025
- 2025CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworks6 Dec 2025
- 2025GaINeR: Geometry-Aware Implicit Network Representation25 Nov 2025
- 2025On the accuracy of implicit neural representations for cardiovascular anatomies and hemodynamic fields23 Oct 2025
- 2025Beyond Heuristics: Globally Optimal Configuration of Implicit Neural Representations27 Sep 2025
- 2025Surf3R: Rapid Surface Reconstruction from Sparse RGB Views in Seconds6 Aug 2025
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 2025MC-INR: Efficient Encoding of Multivariate Scientific Simulation Data using Meta-Learning and Clustered Implicit Neural Representations3 Jul 2025
- 2025CINeMA: Conditional Implicit Neural Multi-Modal Atlas for a Spatio-Temporal Representation of the Perinatal Brain11 Jun 2025
- 2025EqCollide: Equivariant and Collision-Aware Deformable Objects Neural Simulator6 Jun 2025
- 2025UltraBoneUDF: Self-supervised Bone Surface Reconstruction from Ultrasound Based on Neural Unsigned Distance Functions23 May 2025
- 2025Meta-learning Slice-to-Volume Reconstruction in Fetal Brain MRI using Implicit Neural Representations14 May 2025
- 2025QuickSplat: Fast 3D Surface Reconstruction via Learned Gaussian Initialization8 May 2025
- 2025SCENT: Robust Spatiotemporal Learning for Continuous Scientific Data via Scalable Conditioned Neural Fields16 Apr 2025
- 2025Meta-Continual Learning of Neural Fields8 Apr 2025
- 2025F-INR: Functional Tensor Decomposition for Implicit Neural Representations27 Mar 2025
- 2025Foundation Models Secretly Understand Neural Network Weights: Enhancing Hypernetwork Architectures with Foundation Models2 Mar 2025
- 2025MedFuncta: A Unified Framework for Learning Efficient Medical Neural Fields20 Feb 2025
- 2025Neural Chaos: A Spectral Stochastic Neural Operator17 Feb 2025
- 2025Meta-INR: Efficient Encoding of Volumetric Data via Meta-Learning Implicit Neural Representation12 Feb 2025
- 2025Geometric Neural Process Fields4 Feb 2025
- 2025Generating visual explanations from deep networks using implicit neural representations20 Jan 2025
- 2025Collaborative Imputation of Urban Time Series through Cross-city Meta-learning20 Jan 2025
- 2025Stochastic Process Learning via Operator Flow Matching7 Jan 2025
- 2025MetaNeRV: Meta Neural Representations for Videos with Spatial-Temporal Guidance5 Jan 2025
- 2024Level-Set Parameters: Novel Representation for 3D Shape Analysis18 Dec 2024
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds9 Dec 2024
- 2024Shallow Signed Distance Functions for Kinematic Collision Bodies11 Nov 2024
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplats26 Oct 2024
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphs17 Oct 2024
- 2024Optimizing 3D Geometry Reconstruction from Implicit Neural Representations16 Oct 2024
- 2024Towards General Deepfake Detection with Dynamic Curriculum15 Oct 2024
- 2024FreSh: Frequency Shifting for Accelerated Neural Representation Learning7 Oct 2024
- 2024Fast Training of Sinusoidal Neural Fields via Scaling Initialization7 Oct 2024
- 2024Learning Transferable Features for Implicit Neural Representations15 Sep 2024
50 newest of 214 All 214 (JSON)
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 56
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Viewscited by 31
- 2025Stochastic Process Learning via Operator Flow Matchingcited by 14
- 2023Meta ControlNet: Enhancing Task Adaptation via Meta Learningcited by 1
- 2026Infinite-dimensional generative diffusions via Doob's h-transformcited by 0
- 2026Infinite-dimensional generative diffusions via Doob's h-transform6 Feb 2026
- 2025Stochastic Process Learning via Operator Flow Matching7 Jan 2025
- 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplats26 Oct 2024
- 2023Meta ControlNet: Enhancing Task Adaptation via Meta Learning3 Dec 2023
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Views6 Jun 2023
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models5 Apr 2023
- 2021NEAT: Neural Attention Fields for End-to-End Autonomous Drivingcited by 174
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2021Advances in Neural Renderingcited by 365
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2021COIN: COmpression with Implicit Neural representationscited by 232
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 204
- 2023EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingScited by 191
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 183
- 2021Implicit Neural Representations for Image Compressioncited by 161
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 142
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 136
12 most cited of 205 All 205 (JSON)
- 2026Atelier: Learning Local Self-Supervised Features for CryoEM Volumes via Hypernetworks24 Sep 2026
- 2026Implicit representations are dead. Long live explicit primitives!7 Aug 2026
- 2026Learning Cardiac Motion Priors for Implicit Neural Representations1 Jul 2026
- 2026DSP-SLAM++: A Unified Framework for Multi-Class, High-Fidelity Object SLAM in the Wild24 Jun 2026
- 2026PatchINR: Patch-Based Implicit Neural Representations for Efficient and Scalable Inference24 Jun 2026
- 2026ForeSplat: Optimization-Aware Foresight for Feed-Forward 3D Gaussian Splatting21 May 2026
- 2026What Cohort INRs Encode and Where to Freeze Them8 May 2026
- 2026Disentangled Learning Improves Implicit Neural Representations for Medical Reconstruction5 May 2026
- 2026Implicit Neural Representations: A Signal Processing Perspective16 Apr 2026
- 2026Diff3R: Feed-forward 3D Gaussian Splatting with Uncertainty-aware Differentiable Optimization1 Apr 2026
- 2026NOIR: Neural Operator mapping for Implicit Representations13 Mar 2026
- 2026SGI: Structured 2D Gaussians for Efficient and Compact Large Image Representation8 Mar 2026
12 newest of 205 All 205 (JSON)