mlsanityData to 14 Oct 2026

Stochastic Adaptive Fourier Decomposition for Operator Learning

arXiv 2610.04241 ↗First posted 3 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Fourier Neural Operators (FNOs) offer an efficient paradigm for solving partial differential equations (PDEs). However, FNOs rely on a fixed Fourier basis and hard frequency truncation, which inherently limit their ability to model non-periodic, localized, and fine-scale solution structures. We propose the Stochastic Adaptive Fourier Decomposition Neural Operator (SAFDNO), a spectral neural operator that replaces predefined Fourier modes with an adaptive Takenaka-Malmquist (TM) orthonormal system derived from the theory of Stochastic Adaptive Fourier Decomposition (SAFD). Instead of performing an expensive greedy pole search in classical SAFD, SAFDNO amortizes stochastic pole selection through a neural pole predictor and constructs the adaptive TM system directly from latent features. The resulting operator performs learned filtering on coefficients of analytic branches in the Hardy space with respect to the input-adaptive TM system, preserving the global receptive field of spectral operators while providing a more flexible representation than using fixed spectral bases. Across nine PDE benchmark problems, SAFDNO achieves the best performance on all six regular-grid problems among strong neural operator baselines, with especially notable gains on Darcy, Burgers, and Navier-Stokes, where fixed Fourier modes are often less effective at modeling localized oscillations, sharp transitions, and multiscale structures. SAFDNO also exhibits stronger zero-shot super-resolution performance and shows less performance degradation when deployed on finer discretizations. These results suggest that the input-adaptive TM system provides a promising alternative to fixed spectral representations for neural operator learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 37 references that are in the map. First posted on arXiv 3 Oct 2026.

Builds on

18 of 37 references.

References · 18

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  4. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
  5. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
  6. 2021Choose a Transformer: Fourier or Galerkincited by 343
  7. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
  8. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  9. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
  10. 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
  11. 2021Factorized Fourier Neural Operatorscited by 249
  12. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 234
6 more
  1. 2022U-NO: U-shaped Neural Operatorscited by 230
  2. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 89
  3. 2023Improved Operator Learning by Orthogonal Attentioncited by 61
  4. 2024A Library for Learning Neural Operatorscited by 38
  5. 2025Hilbert Neural Operator: Operator Learning in the Analytic Signal Domaincited by 2
  6. 2026Adaptive Mamba Neural Operatorscited by 1

Built on by

Not cited yet.