Few-shot Implicit Function Generation via Equivariance
Not on the map. Why?
Abstract (arXiv)
Implicit Neural Representations (INRs) have emerged as a powerful framework for representing continuous signals. However, generating diverse INR weights remains challenging due to limited training data. We introduce Few-shot Implicit Function Generation, a new problem setup that aims to generate diverse yet functionally consistent INR weights from only a few examples. This is challenging because even for the same signal, the optimal INRs can vary significantly depending on their initializations. To tackle this, we propose EquiGen, a framework that can generate new INRs from limited data. The core idea is that functionally similar networks can be transformed into one another through weight permutations, forming an equivariance group. By projecting these weights into an equivariant latent space, we enable diverse generation within these groups, even with few examples. EquiGen implements this through an equivariant encoder trained via contrastive learning and smooth augmentation, an equivariance-guided diffusion process, and controlled perturbations in the equivariant subspace. Experiments on 2D image and 3D shape INR datasets demonstrate that our approach effectively generates diverse INR weights while preserving their functional properties in few-shot scenarios.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 67 of its 81 references that are in the map. First posted on arXiv 3 Jan 2025.
Builds on
67 of 81 references.
References · 67
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
38 more
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2017Deep Setscited by 1,394
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2016HyperNetworkscited by 1,003
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2018Spherical CNNscited by 452
- 2018Invariant and Equivariant Graph Networkscited by 339
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 296
- 2017Data Augmentation Generative Adversarial Networkscited by 278
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 244
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
- 2023DepGraph: Towards Any Structural Pruningcited by 202
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 183
- 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2017Equivariance Through Parameter-Sharingcited by 139
- 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 134
- 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
- 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 106
- 2019Image Generation From Small Datasets via Batch Statistics Adaptationcited by 102
- 2021Parameter Prediction for Unseen Deep Architecturescited by 89
- 2022Learning to Learn with Generative Models of Neural Network Checkpointscited by 85
- 2023Permutation Equivariant Neural Functionalscited by 69
- 2018Deep Models of Interactions Across Setscited by 68
- 2022Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weightscited by 63
- 2023Deep Learning on Implicit Neural Representations of Shapescited by 62
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representations
- 2025Hyper-Transforming Latent Diffusion Models
- 2026Weight-Space Mixture-of-Experts for Implicit Neural Representation Classification
- 2024Neural Experts: Mixture of Experts for Implicit Neural Representations
- 2022Learning Symmetric Embeddings for Equivariant World Models
- 2025NeRV-Diffusion: Diffuse Implicit Neural Representations for Video Synthesis
- 2025Improving Equivariant Networks with Probabilistic Symmetry Breaking
- 2026Permutation-Equivariant Flow Matching for Alignment-Free Neural Weight Generation