Operator learning without the adjoint
Not on the map. Why?
Abstract (arXiv)
There is a mystery at the heart of operator learning: how can one recover a non-self-adjoint operator from data without probing the adjoint? Current practical approaches suggest that one can accurately recover an operator while only using data generated by the forward action of the operator without access to the adjoint. However, naively, it seems essential to sample the action of the adjoint. In this paper, we partially explain this mystery by proving that without querying the adjoint, one can approximate a family of non-self-adjoint infinite-dimensional compact operators via projection onto a Fourier basis. We then apply the result to recovering Green's functions of elliptic partial differential operators and derive an adjoint-free sample complexity bound. While existing theory justifies low sample complexity in operator learning, ours is the first adjoint-free analysis that attempts to close the gap between theory and practice.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 18 of its 71 references that are in the map. First posted on arXiv 31 Jan 2024.
Builds on
18 of 71 references.
References · 18
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
- 2014Sketching as a Tool for Numerical Linear Algebracited by 285
- 2020Rational neural networkscited by 75
- 2023A Mathematical Guide to Operator Learningcited by 74
- 2021Convergence Rates for Learning Linear Operators from Noisy Datacited by 55
- 2021Data-driven discovery of Green's functions with human-understandable deep learningcited by 43
- 2016Practical sketching algorithms for low-rank matrix approximationcited by 38
- 2021Learning elliptic partial differential equations with randomized linear algebracited by 29
6 more
- 2023Elliptic PDE learning is provably data-efficientcited by 26
- 2022Learning Green's functions associated with time-dependent partial differential equationscited by 25
- 2023Deep Operator Network Approximation Rates for Lipschitz Operatorscited by 24
- 2014On the optimality of shape and data representation in the spectral domaincited by 14
- 2021A generalization of the randomized singular value decompositioncited by 6
- 2022Model Reduction for Nonlinear Systems by Balanced Truncation of State and Gradient Covariancecited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 4.
8 papers.
- 2024Structure-Preserving Operator Learningcited by 3
- 2025Fast Generalized Neural Tangent Kernel Statistics via Trace Estimationcited by 3
- 2026SIMR-NO: A Spectrally-Informed Multi-Resolution Neural Operator for Turbulent Flow Super-Resolutioncited by 3
- 2025Rates and architectures for learning geometrically non-trivial operatorscited by 1
- 2025Query Efficient Structured Matrix Learningcited by 0
- 2026Guided Flow Matching for Forward and Inverse PDE Problems with Sparse Observations: Algorithm and Theorycited by 0
- 2026Uncovering Extreme Event Mechanisms for Prediction and Control with Sensitivity-Balanced Projectionscited by 0
- 2026Conformal Uncertainty Quantification Guarantees for Neural Operatorscited by 0
- 2026Conformal Uncertainty Quantification Guarantees for Neural Operators28 Aug 2026
- 2026Uncovering Extreme Event Mechanisms for Prediction and Control with Sensitivity-Balanced Projections4 Jun 2026
- 2026Guided Flow Matching for Forward and Inverse PDE Problems with Sparse Observations: Algorithm and Theory25 May 2026
- 2026SIMR-NO: A Spectrally-Informed Multi-Resolution Neural Operator for Turbulent Flow Super-Resolution30 Mar 2026
- 2025Rates and architectures for learning geometrically non-trivial operators10 Dec 2025
- 2025Fast Generalized Neural Tangent Kernel Statistics via Trace Estimation13 Nov 2025
- 2025Query Efficient Structured Matrix Learning25 Jul 2025
- 2024Structure-Preserving Operator Learning1 Oct 2024