Separated-Variable Spectral Neural Networks: A Physics-Informed Learning Approach for High-Frequency PDEs
Not on the map. Why?
Abstract (arXiv)
Solving high-frequency oscillatory partial differential equations (PDEs) is a critical challenge in scientific computing, with applications in fluid mechanics, quantum mechanics, and electromagnetic wave propagation. Traditional physics-informed neural networks (PINNs) suffer from spectral bias, limiting their ability to capture high-frequency solution components. We introduce Separated-Variable Spectral Neural Networks (SV-SNN), a novel framework that addresses these limitations by integrating separation of variables with adaptive spectral methods. Our approach features three key innovations: (1) decomposition of multivariate functions into univariate function products, enabling independent spatial and temporal networks; (2) adaptive Fourier spectral features with learnable frequency parameters for high-frequency capture; and (3) theoretical framework based on singular value decomposition to quantify spectral bias. Comprehensive evaluation on benchmark problems including Heat equation, Helmholtz equation, Poisson equations and Navier-Stokes equations demonstrates that SV-SNN achieves 1-3 orders of magnitude improvement in accuracy while reducing parameter count by over 90% and training time by 60%. These results establish SV-SNN as an effective solution to the spectral bias problem in neural PDE solving. The implementation will be made publicly available upon acceptance at https://github.com/xgxgnpu/SV-SNN.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
20 of 36 references.
References · 20
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
- 2019DeepXDE: A deep learning library for solving differential equationscited by 619
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
- 2022Message Passing Neural PDE Solverscited by 386
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 284
- 2020Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networkscited by 166
8 more
- 2024Numerical analysis of physics-informed neural networks and related models in physics-informed machine learningcited by 39
- 2021Spectral Bias in Practice: The Role of Function Frequency in Generalizationcited by 37
- 2017Training-image based geostatistical inversion using a spatial generative adversarial neural networkcited by 32
- 2022On the Activation Function Dependence of the Spectral Bias of Neural Networkscited by 28
- 2024Binary structured physics-informed neural networks for solving equations with rapidly changing solutionscited by 8
- 2023Physics-informed neural wavefields with Gabor basis functionscited by 5
- 2024Frequency-adaptive Multi-scale Deep Neural Networkscited by 5
- 2024Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precisioncited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Gradient Scaling Effects in Adaptive Spectral PINNs for Stiff Nonlinear ODEscited by 1
- 2026Multi-Scale Separable Fourier Neural Networks for Solving High-Frequency PDEscited by 0
- 2026Frequency Shift Physics-Informed Extreme Learning Machine for Solving High-Frequency Partial Differential Equationscited by 0
- 2026Frequency Shift Physics-Informed Extreme Learning Machine for Solving High-Frequency Partial Differential Equations2 Jul 2026
- 2026Multi-Scale Separable Fourier Neural Networks for Solving High-Frequency PDEs29 May 2026
- 2026Gradient Scaling Effects in Adaptive Spectral PINNs for Stiff Nonlinear ODEs6 May 2026