mlsanityData to 7 Oct 2026

Discovering ordinary differential equations that govern time-series

arXiv 2211.02830 ↗First posted 5 Nov 2022cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Natural laws are often described through differential equations yet finding a differential equation that describes the governing law underlying observed data is a challenging and still mostly manual task. In this paper we make a step towards the automation of this process: we propose a transformer-based sequence-to-sequence model that recovers scalar autonomous ordinary differential equations (ODEs) in symbolic form from time-series data of a single observed solution of the ODE. Our method is efficiently scalable: after one-time pretraining on a large set of ODEs, we can infer the governing laws of a new observed solution in a few forward passes of the model. Then we show that our model performs better or on par with existing methods in various test cases in terms of accurate symbolic recovery of the ODE, especially for more complex expressions.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 5 Nov 2022.

Builds on

16 of 29 references.

References · 16

  1. 2018Neural Ordinary Differential Equationscited by 3,733
  2. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  3. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  4. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
  5. 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
  6. 2019Deep Learning for Symbolic Mathematicscited by 266
  7. 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
  8. 2022End-to-end symbolic regression with transformerscited by 195
  9. 2021Neural Symbolic Regression that Scalescited by 185
  10. 2018Learning Equations for Extrapolation and Controlcited by 151
  11. 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
  12. 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 101
4 more
  1. 2022SymFormer: End-to-end symbolic regression using transformer-based architecturecited by 56
  2. 2019Data-driven discovery of free-form governing differential equationscited by 16
  3. 2021Inferring the Structure of Ordinary Differential Equationscited by 7
  4. 2020RODE-Net: Learning Ordinary Differential Equations with Randomness from Datacited by 6

Built on by

Cited by year

Citing papers per year: 2023: 3.

3 papers.