mlsanityData to 14 Oct 2026

Spectral-Informed Neural Networks Outperform Spectral Methods in High-dimensional PDEs

arXiv 2607.13566 ↗First posted 15 Jul 2026math.NA cs.AI cs.CEcited by 0

Not on the map. Why?

Abstract (arXiv)

For low-dimensional problems (d≤3), spectral methods can achieve exceptionally high accuracy. For middle-dimensional problems (4 ≤ d lesssim 10), spectral methods remain feasible through specific techniques such as sparse grids or hyperbolic cross. However, for high-dimensional problems (dgg 10), spectral methods suffer frome the curse of dimensionality. Physics-informed neural networks (PINNs) have emerged as a promising approach to overcome this challenge, offering scalability to high dimensions, but often suffer from limited accuracy and efficiency. Recently proposed spectral-informed neural networks (SINNs) combine spectral methods with PINNs, operating directly in the spectral domain to avoid spatial derivative computations and to reduce memory consumption. In this work, we introduce Modified SINNs, which integrate coefficient decay scaling and basis embeddings motivated by harmonic analysis to enhance accuracy in high-dimensional problems and enable accurate approximation of unknown spectral coefficients. Numerical experiments on steady and time-dependent partial differential equations demonstrate that Modified SINNs outperform sparse grid spectral methods on middle-dimensional problems with incomplete spectral information and achieve superior accuracy compared to PINNs on high-dimensional problems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 53 references that are in the map. First posted on arXiv 15 Jul 2026.

Builds on

11 of 53 references.

References · 11

  1. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
  2. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 583
  3. 2017Solving high-dimensional partial differential equations using deep learningcited by 556
  4. 2021CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Methodcited by 93
  5. 2024PirateNets: Physics-informed Deep Learning with Residual Adaptive Networkscited by 72
  6. 2024Stochastic Taylor Derivative Estimator: Efficient amortization for arbitrary differential operatorscited by 20
  7. 2024Spectral Informed Neural Network: An Efficient and Low-Memory PINNcited by 6
  8. 2023From continuous-time formulations to discretization schemes: tensor trains and robust regression for BSDEs and parabolic PDEscited by 5
  9. 2022Compressive Fourier collocation methods for high-dimensional diffusion equations with periodic boundary conditionscited by 2
  10. 2013Sparse approximation and recovery by greedy algorithms in Banach spacescited by 1
  11. 2024Sinc Kolmogorov-Arnold network and its application for solving PDEs with singularitiescited by 1

Built on by

Not cited yet.