Discovering ordinary differential equations that govern time-series
Not on the map. Why?
Abstract (arXiv)
Natural laws are often described through differential equations yet finding a differential equation that describes the governing law underlying observed data is a challenging and still mostly manual task. In this paper we make a step towards the automation of this process: we propose a transformer-based sequence-to-sequence model that recovers scalar autonomous ordinary differential equations (ODEs) in symbolic form from time-series data of a single observed solution of the ODE. Our method is efficiently scalable: after one-time pretraining on a large set of ODEs, we can infer the governing laws of a new observed solution in a few forward passes of the model. Then we show that our model performs better or on par with existing methods in various test cases in terms of accurate symbolic recovery of the ODE, especially for more complex expressions.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 5 Nov 2022.
Builds on
16 of 29 references.
References · 16
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
- 2019Deep Learning for Symbolic Mathematicscited by 266
- 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 208
- 2022End-to-end symbolic regression with transformerscited by 195
- 2021Neural Symbolic Regression that Scalescited by 185
- 2018Learning Equations for Extrapolation and Controlcited by 151
- 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
- 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 101
4 more
- 2022SymFormer: End-to-end symbolic regression using transformer-based architecturecited by 56
- 2019Data-driven discovery of free-form governing differential equationscited by 16
- 2021Inferring the Structure of Ordinary Differential Equationscited by 7
- 2020RODE-Net: Learning Ordinary Differential Equations with Randomness from Datacited by 6
Built on by
Citing papers per year: 2023: 3.
3 papers.
- 2023Controllable Neural Symbolic Regressioncited by 19
- 2023Priors for symbolic regressioncited by 10
- 2023Simultaneous identification of models and parameters of scientific simulatorscited by 8
- 2023Simultaneous identification of models and parameters of scientific simulators24 May 2023
- 2023Controllable Neural Symbolic Regression20 Apr 2023
- 2023Priors for symbolic regression13 Apr 2023