mlsanityData to 7 Oct 2026

Spatial Functa: Scaling Functa to ImageNet Classification and Generation

arXiv 2302.03130 ↗First posted 6 Feb 2023cs.LG cs.CVcited by 55

Not on the map. Why?

Abstract (arXiv)

Neural fields, also known as implicit neural representations, have emerged as a powerful means to represent complex signals of various modalities. Based on this Dupont et al. (2022) introduce a framework that views neural fields as data, termed *functa*, and proposes to do deep learning directly on this dataset of neural fields. In this work, we show that the proposed framework faces limitations when scaling up to even moderately complex datasets such as CIFAR-10. We then propose *spatial functa*, which overcome these limitations by using spatially arranged latent representations of neural fields, thereby allowing us to scale up the approach to ImageNet-1k at 256x256 resolution. We demonstrate competitive performance to Vision Transformers (Steiner et al., 2022) on classification and Latent Diffusion (Rombach et al., 2022) on image generation respectively.

Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 6 Feb 2023.

Builds on

40 of 49 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  10. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  11. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  12. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
28 more
  1. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  3. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  6. 2017Decoupled Weight Decay Regularizationcited by 1,722
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  8. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  9. 2020On Layer Normalization in the Transformer Architecturecited by 906
  10. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 562
  11. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
  12. 2020Local Implicit Grid Representations for 3D Scenescited by 372
  13. 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
  14. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  15. 2019Learning Deep Transformer Models for Machine Translationcited by 309
  16. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  17. 2021NeRV: Neural Representations for Videoscited by 255
  18. 2021COIN: COmpression with Implicit Neural representationscited by 232
  19. 2022From data to functa: Your data point is a function and you can treat it like onecited by 183
  20. 2021Implicit Neural Representations for Image Compressioncited by 161
  21. 2021NeRP: Implicit Neural Representation Learning with Prior Embedding for Sparsely Sampled Image Reconstructioncited by 145
  22. 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
  23. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  24. 2021CKConv: Continuous Kernel Convolution For Sequential Datacited by 117
  25. 2021Generative Models as Distributions of Functionscited by 89
  26. 2021FlexConv: Continuous Kernel Convolutions with Differentiable Kernel Sizescited by 66
  27. 2022Scalable Neural Video Representations with Learnable Positional Featurescited by 29
  28. 2022Meta-Learning Sparse Compression Networkscited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 9; 2024: 16; 2025: 20; 2026: 10.

55 papers.

Sort:

By area:

  1. 2023Graph Metanetworks for Processing Diverse Neural Architecturescited by 55
  2. 2023Neural Functional Transformerscited by 50
  3. 2024AROMA: Preserving Spatial Structure for Latent PDE Modeling with Local Neural Fieldscited by 38
  4. 2024Online Adaptation of Language Models with a Memory of Amortized Contextscited by 35
  5. 2024Scale Equivariant Graph Metanetworkscited by 23
  6. 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fieldscited by 19
  7. 2024Space-Time Continuous PDE Forecasting using Equivariant Neural Fieldscited by 18
  8. 2023Locality-Aware Generalizable Implicit Neural Representationcited by 16
  9. 2024Monomial Matrix Group Equivariant Neural Functional Networkscited by 15
  10. 2024CINA: Conditional Implicit Neural Atlas for Spatio-Temporal Representation of Fetal Brainscited by 14
  11. 2023How to Train Neural Field Representations: A Comprehensive Study and Benchmarkcited by 12
  12. 2024Implicit-Zoo: A Large-Scale Dataset of Neural Implicit Functions for 2D Images and 3D Scenescited by 12
38 more
  1. 2023Manifold Diffusion Fieldscited by 11
  2. 2025Fit Pixels, Get Labels: Meta-learned Implicit Networks for Image Segmentationcited by 11
  3. 2023Generative Neural Fields by Mixtures of Neural Implicit Functionscited by 10
  4. 2024ASMR: Activation-sharing Multi-resolution Coordinate Networks For Efficient Inferencecited by 9
  5. 2024Latent-INR: A Flexible Framework for Implicit Representations of Videos with Discriminative Semanticscited by 9
  6. 2025End-to-End Implicit Neural Representations for Classificationcited by 7
  7. 2024Attention Beats Linear for Fast Implicit Neural Representation Generationcited by 6
  8. 2025MedFuncta: A Unified Framework for Learning Efficient Medical Neural Fieldscited by 6
  9. 2024Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guaranteescited by 5
  10. 2025GaussianVision: Vision-Language Alignment from Compressed Image Representations using 2D Gaussian Splattingcited by 5
  11. 2023Improved Positional Encoding for Implicit Neural Representation based Compact Data Representationcited by 4
  12. 2025PDEfuncta: Spectrally-Aware Neural Representation for PDE Solution Modelingcited by 4
  13. 2026Picasso: Holistic Scene Reconstruction with Physics-Constrained Samplingcited by 4
  14. 2025ARC: Anchored Representation Clouds for High-Resolution INR Classificationcited by 3
  15. 2025SCENT: Robust Spatiotemporal Learning for Continuous Scientific Data via Scalable Conditioned Neural Fieldscited by 3
  16. 2025CINeMA: Conditional Implicit Neural Multi-Modal Atlas for a Spatio-Temporal Representation of the Perinatal Braincited by 3
  17. 2023Neural Modulation Fields for Conditional Cone Beam Neural Tomographycited by 2
  18. 2024INRFlow: Flow Matching for INRs in Ambient Spacecited by 2
  19. 2025LIFT: Latent Implicit Functions for Task- and Data-Agnostic Encodingcited by 2
  20. 2025Hyper-Transforming Latent Diffusion Modelscited by 2
  21. 2025Efficient Neural Video Representation with Temporally Coherent Modulationcited by 2
  22. 2025Fourier-Modulated Implicit Neural Representation for Multispectral Satellite Image Compressioncited by 2
  23. 2025VidFuncta: Towards Generalizable Neural Representations for Ultrasound Videoscited by 2
  24. 2025Unified all-atom molecule generation with neural fieldscited by 2
  25. 2023T1: Scaling Diffusion Probabilistic Fields to High-Resolution on Unified Visual Modalitiescited by 1
  26. 2025Equivariant Eikonal Neural Networks: Grid-Free, Scalable Travel-Time Prediction on Homogeneous Spacescited by 1
  27. 2025On the accuracy of implicit neural representations for cardiovascular anatomies and hemodynamic fieldscited by 1
  28. 2026Low-Rank-Modulated Functa: Exploring the Latent Space of Implicit Neural Representations for Interpretable Ultrasound Video Analysiscited by 1
  29. 2026Neural Field Tokenizations with Hierarchy and Spatial Locality Priorscited by 1
  30. 2026Dynamic Neural Graph Encoding of Inference Processes in Deep Weight Spacecited by 1
  31. 2026NISF++: Geometrically-grounded implicit representations of 3D+time cardiac function from 2D short- and long-axis MR viewscited by 1
  32. 2024MNeRV: A Multilayer Neural Representation for Videoscited by 0
  33. 2024SegINR: Segment-wise Implicit Neural Representation for Sequence Alignment in Neural Text-to-Speechcited by 0
  34. 2024Level-Set Parameters: Novel Representation for 3D Shape Analysiscited by 0
  35. 2025Seeing the Many: Exploring Parameter Distributions Conditioned on Features in Surrogatescited by 0
  36. 2025Semi-disentangled spatiotemporal implicit neural representations of longitudinal neuroimaging data for trajectory classificationcited by 0
  37. 2025Symmetry-Aware Graph Metanetwork Autoencoders: Model Merging through Parameter Canonicalizationcited by 0
  38. 2025Metanetworks as Regulatory Operators: Learning to Edit for Requirement Compliancecited by 0

50 most cited of 55 All 55 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Sharpening Your Density Fields: Spiking Neuron Aided Fast Geometry Learning
  2. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion
  3. 2024Scaling Backwards: Minimal Synthetic Pre-training?
  4. 2024Dynamic 3D Gaussian Fields for Urban Areas
  5. 2024Image Neural Field Diffusion Models
  6. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models
  7. 2023Yin Yang Convolutional Nets: Image Manifold Extraction by the Analysis of Opposites
  8. 2022Deep Generative Models on 3D Representations: A Survey