mlsanityData to 7 Oct 2026

Don't Fix the Basis -- Learn It: Spectral Representation with Adaptive Basis Learning for PDEs

arXiv 2605.10451 ↗First posted 11 May 2026cs.LG cs.NA math.FAcited by 1

Not on the map. Why?

Abstract (arXiv)

Spectral neural operators achieve strong performance for PDE learning, but rely on fixed global bases that limit their ability to represent spatially heterogeneous and multiscale dynamics. We propose Adaptive Basis Learning (ABLE), a framework that learns data-dependent spectral representations instead of relying on predefined bases. ABLE constructs a spatially adaptive Parseval frame via a learned ancillary density, enabling the operator to act in a lifted spectral space while preserving invertibility and maintaining O(Nlog N) complexity through FFT-based implementation. This shifts the source of expressivity from spectral coefficients to the representation itself, allowing the model to capture localized structures and non-translation-invariant interactions more efficiently. ABLE integrates seamlessly into existing neural operator architectures as a drop-in replacement for spectral layers. Across a range of benchmarks ABLE improves accuracy over strong baselines, with the largest gains in regimes characterized by sharp gradients and multiscale behavior. Moreover, augmenting existing models (e.g., U-FNO, HPM) with ABLE further enhances their performance, demonstrating its role as a general and complementary spectral refinement. Our results highlight that the data-driven choice of representation, rather than operator complexity alone, is a key bottleneck in neural operator design. By learning the basis itself, ABLE provides a principled and efficient framework for improving spectral methods in PDE learning.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

17 of 30 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  4. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  5. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  6. 2021Choose a Transformer: Fourier or Galerkincited by 333
  7. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
  8. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
  9. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  10. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
  11. 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
  12. 2024HAMLET: Graph Transformer Neural Operator for Partial Differential Equationscited by 24
5 more
  1. 2024Mamba Neural Operator: Who Wins? Transformers vs. State-Space Models for PDEscited by 16
  2. 2024Holistic Physics Solver: Learning PDEs in a Unified Spectral-Physical Spacecited by 10
  3. 2025FreqMoE: Dynamic Frequency Enhancement for Neural PDE Solverscited by 6
  4. 2025SAOT: An Enhanced Locality-Aware Spectral Transformer for Solving PDEscited by 6
  5. 2023A Fourier Neural Operator Approach for Modelling Exciton-Polariton Condensate Systemscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.