mlsanityData to 7 Oct 2026

TF-SNO: Time-Frequency Gated Spectral Neural Operators for Learning Non-Stationary Partial Differential Equations

arXiv 2606.21189 ↗First posted 19 Jun 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Non-stationary partial differential equations (PDEs) arise throughout scientific computing, where the dominant frequency content and energy distribution can drift over time. While efficient in PDE solving, many spectral neural operators apply a shared spectral response across rollout stages, leading to mismatch with time-varying spectra in non-stationary systems. To address this issue, we propose Time-Frequency Gated Spectral Neural Operator (TF-SNO), a state-adaptive framework with learnable time-frequency gating inside spectral blocks. TF-SNO extracts compact frequency-domain and physical-space statistics from the current state to generate modulation coefficients, enabling the spectral response to evolve with the dynamics. TF-SNO learns temporal variation implicitly from the evolving state without introducing an explicit time dimension or time embedding, keeping the modeling complexity low. We further embed the adaptive operator blocks to accurately capture the multi-scale features, thereby improving long-horizon stability. Experiments on six non-stationary PDE benchmarks in 1D and 2D demonstrate that TF-SNO significantly reduces prediction errors and improves robustness compared to strong baselines, with particularly clear gains in long rollout, suggesting the effectiveness of state-dependent spectral adaptation in modeling non-stationary physical systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 34 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

18 of 34 references.

References · 18

  1. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  4. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  5. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
  6. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  7. 2022U-NO: U-shaped Neural Operatorscited by 219
  8. 2023Improved Operator Learning by Orthogonal Attentioncited by 58
  9. 2024On the Benefits of Memory for Modeling Time-Dependent PDEscited by 30
  10. 2023Neural Dynamical Operator: Continuous Spatial-Temporal Model with Gradient-Based and Derivative-Free Optimization Methodscited by 14
  11. 2026Lightweight LLM Agent Memory with Small Language Modelscited by 12
  12. 2025Temporal Neural Operator for Modeling Time-Dependent Physical Phenomenacited by 8
6 more
  1. 2024CoNO: Complex Neural Operator for Continous Dynamical Physical Systemscited by 3
  2. 2025PDE Solvers Should Be Local: Fast, Stable Rollouts with Learned Local Stencilscited by 2
  3. 2026Rethinking Input Domains in Physics-Informed Neural Networks via Geometric Compactification Mappingscited by 2
  4. 2026Geometric Neural Operators via Lie Group-Constrained Latent Dynamicscited by 2
  5. 2026Autoregression-Free Neural Operators for Time-Dependent PDEscited by 2
  6. 2026From Similarity to Structure: Training-free LLM Context Compression with Hybrid Graph Priorscited by 1

Built on by

Not cited yet.