# Learning nonparametric differential equations with operator-valued kernels and gradient matching

arXiv: https://arxiv.org/abs/1411.5172 · HTML: https://mlsanity.com/paper/1411.5172/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Nov 2014.

## Built on by (most cited first, 4 of 4)

- [Variational multiple shooting for Bayesian ODEs with Gaussian processes](https://mlsanity.com/paper/2106.10905/) (2021)
- [Structure-preserving Gaussian Process Dynamics](https://mlsanity.com/paper/2102.01606/) (2021)
- [Exact Inference for Continuous-Time Gaussian Process Dynamics](https://mlsanity.com/paper/2309.02351/) (2023)
- [MAGI-X: Manifold-Constrained Gaussian Process Inference for Unknown System Dynamics](https://mlsanity.com/paper/2105.12894/) (2021)

## Abstract (arXiv)

Modeling dynamical systems with ordinary differential equations implies a mechanistic view of the process underlying the dynamics. However in many cases, this knowledge is not available. To overcome this issue, we introduce a general framework for nonparametric ODE models using penalized regression in Reproducing Kernel Hilbert Spaces (RKHS) based on operator-valued kernels. Moreover, we extend the scope of gradient matching approaches to nonparametric ODE. A smooth estimate of the solution ODE is built to provide an approximation of the derivative of the ODE solution which is in turn used to learn the nonparametric ODE model. This approach benefits from the flexibility of penalized regression in RKHS allowing for ridge or (structured) sparse regression as well. Very good results are shown on 3 different ODE systems.
