# Rethinking Physics-Informed Regression Beyond Training Loops and Bespoke Architectures

arXiv: https://arxiv.org/abs/2512.13217 · HTML: https://mlsanity.com/paper/2512.13217/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 7 of its 15 references that are in the map.
- First posted on arXiv 15 Dec 2025.

## Builds on (most cited first, 7 of 7)

- [DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators](https://mlsanity.com/paper/1910.03193/) (2019)
- [Solving and Learning Nonlinear PDEs with Gaussian Processes](https://mlsanity.com/paper/2103.12959/) (2021)
- [When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learning](https://mlsanity.com/paper/2203.16797/) (2022)
- [Physics-Informed Gaussian Process Regression Generalizes Linear PDE Solvers](https://mlsanity.com/paper/2212.12474/) (2022)
- [Numerical analysis of physics-informed neural networks and related models in physics-informed machine learning](https://mlsanity.com/paper/2402.10926/) (2024)
- [A spectrum of physics-informed Gaussian processes for regression in engineering](https://mlsanity.com/paper/2309.10656/) (2023)
- [Physics-informed Gaussian Process for Online Optimization of Particle Accelerators](https://mlsanity.com/paper/2009.03566/) (2020)

## Abstract (arXiv)

We revisit the problem of physics-informed regression, and propose a method that directly computes the state at the prediction point, simultaneously with the derivative and curvature information of the existing samples. We frame each prediction as a constrained optimisation problem, leveraging multivariate Taylor series expansions and explicitly enforcing physical laws. Each individual query can be processed with low computational cost without any pre- or re-training, in contrast to global function approximator-based solutions such as neural networks. Our comparative benchmarks on a reaction-diffusion system show competitive predictive accuracy relative to a neural network-based solution, while completely eliminating the need for long training loops, and remaining robust to changes in the sampling layout.
