# Physics-informed kernel learning

arXiv: https://arxiv.org/abs/2409.13786 · HTML: https://mlsanity.com/paper/2409.13786/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- Builds on 14 of its 39 references that are in the map.
- First posted on arXiv 20 Sep 2024.

## Builds on (most cited first, 14 of 14)

- [Characterizing possible failure modes in physics-informed neural networks](https://mlsanity.com/paper/2109.01050/) (2021)
- [When and why PINNs fail to train: A neural tangent kernel perspective](https://mlsanity.com/paper/2007.14527/) (2020)
- [Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's next](https://mlsanity.com/paper/2201.05624/) (2022)
- [Solving and Learning Nonlinear PDEs with Gaussian Processes](https://mlsanity.com/paper/2103.12959/) (2021)
- [Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs](https://mlsanity.com/paper/2006.16144/) (2020)
- [Challenges in Training PINNs: A Loss Landscape Perspective](https://mlsanity.com/paper/2402.01868/) (2024)
- [Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations](https://mlsanity.com/paper/2407.07218/) (2024)
- [Error Analysis of Kernel/GP Methods for Nonlinear and Parametric PDEs](https://mlsanity.com/paper/2305.04962/) (2023)
- [The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks](https://mlsanity.com/paper/2402.03864/) (2024)
- [Operator Learning Using Random Features: A Tool for Scientific Computing](https://mlsanity.com/paper/2408.06526/) (2024)
- [Asymptotic self-similar blow-up profile for three-dimensional axisymmetric Euler equations using neural networks](https://mlsanity.com/paper/2201.06780/) (2022)
- [Physics-informed machine learning as a kernel method](https://mlsanity.com/paper/2402.07514/) (2024)
- [Physics Informed Deep Kernel Learning](https://mlsanity.com/paper/2006.04976/) (2020)
- [Investigations on convergence behaviour of Physics Informed Neural Networks across spectral ranges and derivative orders](https://mlsanity.com/paper/2301.02790/) (2023)

## Built on by (most cited first, 11 of 11)

- [SerpentFlow: Generative Unpaired Domain Alignment via Shared-Structure Decomposition](https://mlsanity.com/paper/2601.01979/) (2026)
- [Uncertainty-Aware Diagnostics for Physics-Informed Machine Learning](https://mlsanity.com/paper/2510.26121/) (2025)
- [Learning Theory for Kernel Bilevel Optimization](https://mlsanity.com/paper/2502.08457/) (2025)
- [Understanding Generalization in Physics Informed Models through Affine Variety Dimensions](https://mlsanity.com/paper/2501.18879/) (2025)
- [Complexity Dependent Error Rates for Physics-informed Statistical Learning via the Small-ball Method](https://mlsanity.com/paper/2510.23149/) (2025)
- [Error analysis for the deep Kolmogorov method](https://mlsanity.com/paper/2508.17167/) (2025)
- [Knowledge-Informed Kernel State Reconstruction from Heterogeneous Partial Observations](https://mlsanity.com/paper/2601.22328/) (2026)
- [Multifidelity Gaussian process regression for solving nonlinear partial differential equations](https://mlsanity.com/paper/2605.10383/) (2026)
- [A PAC-Bayesian View of Generalisation for Physics-Informed Machine Learning](https://mlsanity.com/paper/2605.26341/) (2026)
- [Physics Informed Random Feature Neural Networks for Solving PDEs](https://mlsanity.com/paper/2609.16406/) (2026)
- [Fast Learning Rates for Physics-Informed Kernel Methods](https://mlsanity.com/paper/2609.18901/) (2026)

## Abstract (arXiv)

Physics-informed machine learning typically integrates physical priors into the learning process by minimizing a loss function that includes both a data-driven term and a partial differential equation (PDE) regularization. Building on the formulation of the problem as a kernel regression task, we use Fourier methods to approximate the associated kernel, and propose a tractable estimator that minimizes the physics-informed risk function. We refer to this approach as physics-informed kernel learning (PIKL). This framework provides theoretical guarantees, enabling the quantification of the physical prior's impact on convergence speed. We demonstrate the numerical performance of the PIKL estimator through simulations, both in the context of hybrid modeling and in solving PDEs. In particular, we show that PIKL can outperform physics-informed neural networks in terms of both accuracy and computation time. Additionally, we identify cases where PIKL surpasses traditional PDE solvers, particularly in scenarios with noisy boundary conditions.
