Quantitative Sobolev Approximation Bounds for Neural Operators with Empirical Validation on Burgers Equation
Not on the map. Why?
Abstract (arXiv)
Neural operators have emerged as a powerful tool for learning mappings between infinite-dimensional function spaces. However, their approximation properties in Sobolev norms remain poorly quantified, even though these norms control both function values and derivatives and are the natural metrics for PDE well-posedness, stability, and generalization. We develop a functional-analytic framework for operator learning in Sobolev spaces and connect it to the numerical behavior of Fourier Neural Operators (FNOs) on a prototypical PDE. First, for a continuous nonlinear operator G: Hs(D)→ Ht(D') with s > d/2 and inputs restricted to a compact subset of Hs(D), we prove that G can be uniformly approximated in Ht-norm by a neural operator with O(varepsilon-d/s) trainable parameters. This yields an explicit complexity--error relation of the form |G-Gθ|_Ht lesssim C N-s/d. We then study the one-dimensional viscous Burgers solution operator G: u0mapsto u(·,1) on a bounded H1-ball and train FNOs with an H1-loss. Across a sweep of model sizes, we obtain test H1-errors down to O(10-7) and relative errors of order 10-3, with predictions accurately matching both solutions and spatial derivatives on held-out data. A log-log plot of Sobolev error versus parameter count exhibits an approximate power law |G-Gθ|_H1 ≈ C N-α with empirical exponent α ≈ 1.4, and long-horizon training reveals optimization instabilities in large FNOs, providing quantitative evidence that Sobolev-space approximation theory meaningfully predicts neural-operator scaling behavior.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 8 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
7 of 8 references.
References · 7
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2016Error bounds for approximations with deep ReLU networkscited by 574
- 2021Neural Operator: Learning Maps Between Function Spacescited by 414
- 2023The Parametric Complexity of Operator Learningcited by 28
- 2024Data Complexity Estimates for Operator Learningcited by 26
- 2024A Mathematical Analysis of Neural Operator Behaviorscited by 8
Built on by
Not cited yet.