mlsanityData to 14 Oct 2026

Separated-Variable Spectral Neural Networks: A Physics-Informed Learning Approach for High-Frequency PDEs

arXiv 2508.00628 ↗First posted 1 Aug 2025cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Solving high-frequency oscillatory partial differential equations (PDEs) is a critical challenge in scientific computing, with applications in fluid mechanics, quantum mechanics, and electromagnetic wave propagation. Traditional physics-informed neural networks (PINNs) suffer from spectral bias, limiting their ability to capture high-frequency solution components. We introduce Separated-Variable Spectral Neural Networks (SV-SNN), a novel framework that addresses these limitations by integrating separation of variables with adaptive spectral methods. Our approach features three key innovations: (1) decomposition of multivariate functions into univariate function products, enabling independent spatial and temporal networks; (2) adaptive Fourier spectral features with learnable frequency parameters for high-frequency capture; and (3) theoretical framework based on singular value decomposition to quantify spectral bias. Comprehensive evaluation on benchmark problems including Heat equation, Helmholtz equation, Poisson equations and Navier-Stokes equations demonstrates that SV-SNN achieves 1-3 orders of magnitude improvement in accuracy while reducing parameter count by over 90% and training time by 60%. These results establish SV-SNN as an effective solution to the spectral bias problem in neural PDE solving. The implementation will be made publicly available upon acceptance at https://github.com/xgxgnpu/SV-SNN.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

20 of 36 references.

References · 20

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  3. 2018On the Spectral Bias of Neural Networkscited by 1,341
  4. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  5. 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
  6. 2019DeepXDE: A deep learning library for solving differential equationscited by 619
  7. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
  8. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
  9. 2022Message Passing Neural PDE Solverscited by 386
  10. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
  11. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 284
  12. 2020Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networkscited by 166
8 more
  1. 2024Numerical analysis of physics-informed neural networks and related models in physics-informed machine learningcited by 39
  2. 2021Spectral Bias in Practice: The Role of Function Frequency in Generalizationcited by 37
  3. 2017Training-image based geostatistical inversion using a spatial generative adversarial neural networkcited by 32
  4. 2022On the Activation Function Dependence of the Spectral Bias of Neural Networkscited by 28
  5. 2024Binary structured physics-informed neural networks for solving equations with rapidly changing solutionscited by 8
  6. 2023Physics-informed neural wavefields with Gabor basis functionscited by 5
  7. 2024Frequency-adaptive Multi-scale Deep Neural Networkscited by 5
  8. 2024Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precisioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.