mlsanityData to 7 Oct 2026

Few-shot Implicit Function Generation via Equivariance

arXiv 2501.01601 ↗First posted 3 Jan 2025cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Implicit Neural Representations (INRs) have emerged as a powerful framework for representing continuous signals. However, generating diverse INR weights remains challenging due to limited training data. We introduce Few-shot Implicit Function Generation, a new problem setup that aims to generate diverse yet functionally consistent INR weights from only a few examples. This is challenging because even for the same signal, the optimal INRs can vary significantly depending on their initializations. To tackle this, we propose EquiGen, a framework that can generate new INRs from limited data. The core idea is that functionally similar networks can be transformed into one another through weight permutations, forming an equivariance group. By projecting these weights into an equivariant latent space, we enable diverse generation within these groups, even with few examples. EquiGen implements this through an equivariant encoder trained via contrastive learning and smooth augmentation, an equivariance-guided diffusion process, and controlled perturbations in the equivariant subspace. Experiments on 2D image and 3D shape INR datasets demonstrate that our approach effectively generates diverse INR weights while preserving their functional properties in few-shot scenarios.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 67 of its 81 references that are in the map. First posted on arXiv 3 Jan 2025.

Builds on

67 of 81 references.

References · 67

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  10. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  11. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  12. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
38 more
  1. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  2. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  5. 2017Deep Setscited by 1,394
  6. 2018On the Spectral Bias of Neural Networkscited by 1,321
  7. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  8. 2016HyperNetworkscited by 1,003
  9. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  10. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  11. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
  12. 2021Neural Fields in Visual Computing and Beyondcited by 539
  13. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  14. 2018Spherical CNNscited by 452
  15. 2018Invariant and Equivariant Graph Networkscited by 339
  16. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  17. 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 296
  18. 2017Data Augmentation Generative Adversarial Networkscited by 278
  19. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
  20. 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 244
  21. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  22. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  23. 2023WIRE: Wavelet Implicit Neural Representationscited by 220
  24. 2023DepGraph: Towards Any Structural Pruningcited by 202
  25. 2022From data to functa: Your data point is a function and you can treat it like onecited by 183
  26. 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
  27. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  28. 2017Equivariance Through Parameter-Sharingcited by 139
  29. 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 134
  30. 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
  31. 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 106
  32. 2019Image Generation From Small Datasets via Batch Statistics Adaptationcited by 102
  33. 2021Parameter Prediction for Unseen Deep Architecturescited by 89
  34. 2022Learning to Learn with Generative Models of Neural Network Checkpointscited by 85
  35. 2023Permutation Equivariant Neural Functionalscited by 69
  36. 2018Deep Models of Interactions Across Setscited by 68
  37. 2022Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weightscited by 63
  38. 2023Deep Learning on Implicit Neural Representations of Shapescited by 62

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representations
  2. 2025Hyper-Transforming Latent Diffusion Models
  3. 2026Weight-Space Mixture-of-Experts for Implicit Neural Representation Classification
  4. 2024Neural Experts: Mixture of Experts for Implicit Neural Representations
  5. 2022Learning Symmetric Embeddings for Equivariant World Models
  6. 2025NeRV-Diffusion: Diffuse Implicit Neural Representations for Video Synthesis
  7. 2025Improving Equivariant Networks with Probabilistic Symmetry Breaking
  8. 2026Permutation-Equivariant Flow Matching for Alignment-Free Neural Weight Generation