mlsanityData to 7 Oct 2026

Learning dynamical systems from data: A simple cross-validation perspective, part III: Irregularly-Sampled Time Series

arXiv 2111.13037 ↗First posted 25 Nov 2021stat.ML cs.LG math.DScited by 14

Not on the map. Why?

Abstract (arXiv)

A simple and interpretable way to learn a dynamical system from data is to interpolate its vector-field with a kernel. In particular, this strategy is highly efficient (both in terms of accuracy and complexity) when the kernel is data-adapted using Kernel Flows (KF)citeOwhadi19 (which uses gradient-based optimization to learn a kernel based on the premise that a kernel is good if there is no significant loss in accuracy if half of the data is used for interpolation). Despite its previous successes, this strategy (based on interpolating the vector field driving the dynamical system) breaks down when the observed time series is not regularly sampled in time. In this work, we propose to address this problem by directly approximating the vector field of the dynamical system by incorporating time differences between observations in the (KF) data-adapted kernels. We compare our approach with the classical one over different benchmark dynamical systems and show that it significantly improves the forecasting accuracy while remaining simple, fast, and robust.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 16 of its 57 references that are in the map. First posted on arXiv 25 Nov 2021.

Builds on

16 of 57 references.

References · 16

  1. 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 230
  2. 2019Latent ODEs for Irregularly-Sampled Time Seriescited by 182
  3. 2021Solving and Learning Nonlinear PDEs with Gaussian Processescited by 128
  4. 2019Data-driven approximation of the Koopman generator: Model reduction, system identification, and controlcited by 85
  5. 2018Kernel Flows: from learning kernels from data into the abysscited by 49
  6. 2020Kernel-based approximation of the Koopman generator and Schr"odinger operatorcited by 31
  7. 2021Computational Graph Completioncited by 28
  8. 2019Machine Learning for Prediction with Missing Dynamicscited by 27
  9. 2020Learning dynamical systems from data: a simple cross-validation perspectivecited by 23
  10. 2020Consistency of Empirical Bayes And Kernel Flow For Hierarchical Parameter Estimationcited by 18
  11. 2021Data-driven geophysical forecasting: Simple, low-cost, and accurate baselines with kernel methodscited by 15
  12. 2020Kernel methods for center manifold approximation and a data-based version of the Center Manifold Theoremcited by 13
4 more
  1. 2019Dimensionality Reduction of Complex Metastable Systems via Kernel Embeddings of Transition Manifoldscited by 12
  2. 2018A Note on Kernel Methods for Multiscale Systems with Critical Transitionscited by 11
  3. 2020Deep regularization and direct training of the inner layers of Neural Networks with Kernel Flowscited by 10
  4. 2018Deep Ensemble Tensor Factorization for Longitudinal Patient Trajectories Classificationcited by 3

Built on by

Cited by year

Citing papers per year: 2022: 4; 2023: 4; 2024: 2; 2025: 4.

14 papers.

Sort:

  1. 2022Predicting the impact of treatments over time with uncertainty aware neural differential equationscited by 23
  2. 2022One-Shot Learning of Stochastic Differential Equations with Data Adapted Kernelscited by 15
  3. 2023Learning About Structural Errors in Models of Complex Dynamical Systemscited by 13
  4. 2023Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dotscited by 8
  5. 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysiscited by 6
  6. 2024Kernel Methods for the Approximation of the Eigenfunctions of the Koopman Operatorcited by 5
  7. 2022Gaussian Process Hydrodynamicscited by 4
  8. 2024Kernel Sum of Squares for Data Adapted Kernel Learning of Dynamical Systems from Data: A global optimization approachcited by 4
  9. 2025Structured Kolmogorov-Arnold Neural ODEs for Interpretable Learning and Symbolic Discovery of Nonlinear Dynamicscited by 4
  10. 2023Bridging Algorithmic Information Theory and Machine Learning: A New Approach to Kernel Learningcited by 3
  11. 2023Decoding Mean Field Games from Population and Environment Observations By Gaussian Processescited by 2
  12. 2025Learning Surrogate Potential Mean Field Games via Gaussian Processes: A Data-Driven Approach to Ill-Posed Inverse Problemscited by 2
2 more
  1. 2025Reservoir Computing with a Single Oscillating Gas Bubble: Emphasizing the Chaotic Regimecited by 2
  2. 2022Ensemble forecasts in reproducing kernel Hilbert space familycited by 1