mlsanityData to 14 Oct 2026

Neural means and kernel corrections for operator learning

arXiv 2609.00389 ↗First posted 8 Jul 2026cs.LG math.PR stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

We combine neural network means with exact Mat'ern kernel regressions of their residuals and of their learned features, and evaluate the pairing on two public emulation problems with published baselines: the structural-mechanics benchmark of de Hoop et al. and the OCO-2 radiative-transfer emulator of Lamminp"a"a et al. On structural mechanics the combination reaches 4.55% test error, matching the best published architecture, and 5.38% against a published 6.49% in the low-data regime. On OCO-2 it improves on the published Gaussian-process emulator on that problem's own test points, outright on two of the three spectral bands; the same kernel that trails the network tenfold on the raw state overtakes it on the network's features, and we measure why (the target's squared native-space norm drops about fortyfold at fixed effective dimension) and prove the mechanism. Where the two families tie instead, the residuals of every architecture we train correlate above 0.86 and their shared component is flat in diversity and sample size, which reads the published plateau as a property of the data. Supporting results include a second-moment identity that predicts stacking outcomes from measured correlations, an optimal-recovery certificate, and a distribution-free coverage band, the only uncertainty signal that survives our tests.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

10 of 25 references.

References · 10

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  5. 2016Distribution-Free Predictive Inference For Regressioncited by 668
  6. 2023Kernel Methods are Competitive for Operator Learningcited by 50
  7. 2018Kernel Flows: from learning kernels from data into the abysscited by 49
  8. 2024Operator Learning with Gaussian Processescited by 18
  9. 2022One-Shot Learning of Stochastic Differential Equations with Data Adapted Kernelscited by 15
  10. 2020Deep regularization and direct training of the inner layers of Neural Networks with Kernel Flowscited by 10

Built on by

Not cited yet.