mlsanityData to 14 Oct 2026

Predicting Out-of-Distribution Generalization of Neural Operators via Observable Spectral Error Decomposition

arXiv 2609.23529 ↗First posted 20 Sep 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural operators have emerged as powerful surrogates for solving partial differential equations (PDEs), yet their reliability under distribution shift remains a critical barrier to deployment. Existing approaches to out-of-distribution (OOD) generalization in operator learning are largely empirical and black-box: they report aggregate error metrics without explaining why errors arise or when they will grow. We propose a structure-preserving framework that makes OOD generalization predictable and auditable. Our key idea is to parameterize the learned solution operator as a spectral filter hθ(λ) acting on the eigenvalues of the underlying elliptic operator, implemented via Chebyshev polynomial expansions and trained with a weak-form objective. This parameterization admits an exact decomposition of the energy-norm error into two observable components: a model-dependent spectral approximation term and a distribution-dependent spectral weighting term induced by the input. From this decomposition we derive three diagnostics: a conservative in-band supremum varepssup, a global RMS proxy varepsrms, and a sample-dependent effective metric varepseff(f). These diagnostics can be computed without access to ground-truth solutions. Through four controlled experiments, we show that varepseff(f)|f| consistently predicts energy error under in-distribution, in-band spectral shift, out-of-band tail, and compound shifts, whereas global metrics can be systematically misleading. Our framework shifts OOD assessment of neural operators from black-box benchmarking to operator-structure diagnostics, providing a practical route to auditable scientific machine learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 29 references that are in the map. First posted on arXiv 20 Sep 2026.

Builds on

11 of 29 references.

References · 11

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  3. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  4. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  5. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  6. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  7. 2019Invariant Risk Minimizationcited by 1,854
  8. 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
  9. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
  10. 2020In Search of Lost Domain Generalizationcited by 1,054
  11. 2021Neural Operator: Learning Maps Between Function Spacescited by 414

Built on by

Not cited yet.