mlsanityData to 14 Oct 2026

PDEfuncta: Spectrally-Aware Neural Representation for PDE Solution Modeling

arXiv 2506.12790 ↗First posted 15 Jun 2025cs.LG cs.NA math.NAcited by 4

Not on the map. Why?

Abstract (arXiv)

Scientific machine learning often involves representing complex solution fields that exhibit high-frequency features such as sharp transitions, fine-scale oscillations, and localized structures. While implicit neural representations (INRs) have shown promise for continuous function modeling, capturing such high-frequency behavior remains a challenge-especially when modeling multiple solution fields with a shared network. Prior work addressing spectral bias in INRs has primarily focused on single-instance settings, limiting scalability and generalization. In this work, we propose Global Fourier Modulation (GFM), a novel modulation technique that injects high-frequency information at each layer of the INR through Fourier-based reparameterization. This enables compact and accurate representation of multiple solution fields using low-dimensional latent vectors. Building upon GFM, we introduce PDEfuncta, a meta-learning framework designed to learn multi-modal solution fields and support generalization to new tasks. Through empirical studies on diverse scientific problems, we demonstrate that our method not only improves representational quality but also shows potential for forward and inverse inference tasks without the need for retraining.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 32 of its 44 references that are in the map. First posted on arXiv 15 Jun 2025.

Builds on

32 of 44 references.

References · 32

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  5. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,621
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  7. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  8. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  9. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  10. 2018On the Spectral Bias of Neural Networkscited by 1,341
  11. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  12. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
20 more
  1. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
  2. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
  3. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
  4. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
  5. 2021Factorized Fourier Neural Operatorscited by 249
  6. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 234
  7. 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 221
  8. 2023WIRE: Wavelet Implicit Neural Representationscited by 220
  9. 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
  10. 2020Neural Networks Fail to Learn Periodic Functions and How to Fix Itcited by 100
  11. 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 84
  12. 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 78
  13. 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 73
  14. 2022Overview frequency principle/spectral bias in deep learningcited by 69
  15. 2023Spatial Functa: Scaling Functa to ImageNet Classification and Generationcited by 57
  16. 2018Understanding training and generalization in deep learning by Fourier analysiscited by 44
  17. 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversioncited by 44
  18. 2024Improved Implicit Neural Representation with Fourier Reparameterized Trainingcited by 36
  19. 2024On the Benefits of Memory for Modeling Time-Dependent PDEscited by 31
  20. 2023Inducing Point Operator Transformer: A Flexible and Scalable Architecture for Solving PDEscited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.