mlsanityData to 7 Oct 2026

Symbolic Neural ODEs: Learning interpretable models from time-series data

arXiv 2608.22112 ↗First posted 22 Aug 2026cs.LG cs.SY eess.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a machine learning framework for identifying sparse, interpretable models of dynamical systems directly from time-series data. Our approach parameterizes the underlying vector field using a neural architecture and trains it by minimizing a multi-step prediction loss over a finite horizon. To ensure numerical tractability, we optimize a mean absolute error objective averaged across prediction steps, and progressively increase the horizon during training. A key feature of this formulation is that it enforces consistency under repeated composition of the learned dynamics. As a result, the identified models exhibit significantly improved stability compared with approaches based on one-step regression of the vector field. When combined with sparsity-promoting regularization, this leads to parsimonious models that generalize beyond the training data. We demonstrate accurate recovery of systems exhibiting a wide range of behaviors, including stable and unstable fixed points, periodic orbits, and chaotic attractors. For chaotic systems, while long-term trajectory prediction is inherently limited by sensitivity to initial conditions, we show that multi-step training yields models with accurate short-term dynamics and strong agreement in long-time statistical properties, including mean, variance, and Lyapunov exponents. Moreover, we establish theoretical bounds linking trajectory error to statistical accuracy, providing a step toward a principled explanation for this behavior.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 38 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

11 of 38 references.

References · 11

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systemscited by 88
  3. 2023ODEFormer: Symbolic Regression of Dynamical Systems with Transformerscited by 58
  4. 2020Discretize-Optimize vs. Optimize-Discretize for Time-Series Regression and Continuous Normalizing Flowscited by 36
  5. 2023Predicting Ordinary Differential Equations with Transformerscited by 26
  6. 2022Interpretable Polynomial Neural Ordinary Differential Equationscited by 24
  7. 2023Evolving Scientific Discovery by Unifying Data and Background Knowledge with AI Hilbertcited by 18
  8. 2024Training Stiff Neural Ordinary Differential Equations with Implicit Single-Step Methodscited by 11
  9. 2025The Vanishing Gradient Problem for Stiff Neural Differential Equationscited by 3
  10. 2026Symbolic Regression via Neural Networkscited by 2
  11. 2024Expressive Symbolic Regression for Interpretable Models of Discrete-Time Dynamical Systemscited by 1

Built on by

Not cited yet.