mlsanityData to 7 Oct 2026

Operator learning without the adjoint

arXiv 2401.17739 ↗First posted 31 Jan 2024math.NA cs.AI cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

There is a mystery at the heart of operator learning: how can one recover a non-self-adjoint operator from data without probing the adjoint? Current practical approaches suggest that one can accurately recover an operator while only using data generated by the forward action of the operator without access to the adjoint. However, naively, it seems essential to sample the action of the adjoint. In this paper, we partially explain this mystery by proving that without querying the adjoint, one can approximate a family of non-self-adjoint infinite-dimensional compact operators via projection onto a Fourier basis. We then apply the result to recovering Green's functions of elliptic partial differential operators and derive an adjoint-free sample complexity bound. While existing theory justifies low sample complexity in operator learning, ours is the first adjoint-free analysis that attempts to close the gap between theory and practice.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 18 of its 71 references that are in the map. First posted on arXiv 31 Jan 2024.

Builds on

18 of 71 references.

References · 18

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  4. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  5. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
  6. 2014Sketching as a Tool for Numerical Linear Algebracited by 285
  7. 2020Rational neural networkscited by 75
  8. 2023A Mathematical Guide to Operator Learningcited by 74
  9. 2021Convergence Rates for Learning Linear Operators from Noisy Datacited by 55
  10. 2021Data-driven discovery of Green's functions with human-understandable deep learningcited by 43
  11. 2016Practical sketching algorithms for low-rank matrix approximationcited by 38
  12. 2021Learning elliptic partial differential equations with randomized linear algebracited by 29
6 more
  1. 2023Elliptic PDE learning is provably data-efficientcited by 26
  2. 2022Learning Green's functions associated with time-dependent partial differential equationscited by 25
  3. 2023Deep Operator Network Approximation Rates for Lipschitz Operatorscited by 24
  4. 2014On the optimality of shape and data representation in the spectral domaincited by 14
  5. 2021A generalization of the randomized singular value decompositioncited by 6
  6. 2022Model Reduction for Nonlinear Systems by Balanced Truncation of State and Gradient Covariancecited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 4.

8 papers.