PDEfuncta: Spectrally-Aware Neural Representation for PDE Solution Modeling
Not on the map. Why?
Abstract (arXiv)
Scientific machine learning often involves representing complex solution fields that exhibit high-frequency features such as sharp transitions, fine-scale oscillations, and localized structures. While implicit neural representations (INRs) have shown promise for continuous function modeling, capturing such high-frequency behavior remains a challenge-especially when modeling multiple solution fields with a shared network. Prior work addressing spectral bias in INRs has primarily focused on single-instance settings, limiting scalability and generalization. In this work, we propose Global Fourier Modulation (GFM), a novel modulation technique that injects high-frequency information at each layer of the INR through Fourier-based reparameterization. This enables compact and accurate representation of multiple solution fields using low-dimensional latent vectors. Building upon GFM, we introduce PDEfuncta, a meta-learning framework designed to learn multi-modal solution fields and support generalization to new tasks. Through empirical studies on diverse scientific problems, we demonstrate that our method not only improves representational quality but also shows potential for forward and inverse inference tasks without the need for retraining.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 32 of its 44 references that are in the map. First posted on arXiv 15 Jun 2025.
Builds on
32 of 44 references.
References · 32
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,621
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
20 more
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2021Factorized Fourier Neural Operatorscited by 249
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 234
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 221
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
- 2020Neural Networks Fail to Learn Periodic Functions and How to Fix Itcited by 100
- 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 84
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 78
- 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 73
- 2022Overview frequency principle/spectral bias in deep learningcited by 69
- 2023Spatial Functa: Scaling Functa to ImageNet Classification and Generationcited by 57
- 2018Understanding training and generalization in deep learning by Fourier analysiscited by 44
- 2021OpenFWI: Large-Scale Multi-Structural Benchmark Datasets for Seismic Full Waveform Inversioncited by 44
- 2024Improved Implicit Neural Representation with Fourier Reparameterized Trainingcited by 36
- 2024On the Benefits of Memory for Modeling Time-Dependent PDEscited by 31
- 2023Inducing Point Operator Transformer: A Flexible and Scalable Architecture for Solving PDEscited by 18
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025On the accuracy of implicit neural representations for cardiovascular anatomies and hemodynamic fieldscited by 1
- 2026Neural Field Tokenizations with Hierarchy and Spatial Locality Priorscited by 1
- 2026Escaping Spectral Bias without Backpropagation: Fast Implicit Neural Representations with Extreme Learning Machinescited by 0
- 2026ELMZip: Onboard Satellite Image Compression via Extreme Learning Machines for Efficient Downlinkcited by 0
- 2026ELMZip: Onboard Satellite Image Compression via Extreme Learning Machines for Efficient Downlink7 Aug 2026
- 2026Neural Field Tokenizations with Hierarchy and Spatial Locality Priors6 Jun 2026
- 2026Escaping Spectral Bias without Backpropagation: Fast Implicit Neural Representations with Extreme Learning Machines7 Feb 2026
- 2025On the accuracy of implicit neural representations for cardiovascular anatomies and hemodynamic fields23 Oct 2025