Learning Equations for Extrapolation and Control
Not on the map. Why?
Abstract (arXiv)
We present an approach to identify concise equations from data using a shallow neural network approach. In contrast to ordinary black-box regression, this approach allows understanding functional relations and generalizing them from observed data to unseen parts of the parameter space. We show how to extend the class of learnable equations for a recently proposed equation learning network to include divisions, and we improve the learning and model selection strategy to be useful for challenging real-world data. For systems governed by analytical expressions, our method can in many cases identify the true underlying equation and extrapolate to unseen domains. We demonstrate its effectiveness by experiments on a cart-pendulum system, where only 2 random rollouts are required to learn the forward dynamics and successfully achieve the swing-up task.
Key facts. Cited by 151 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 25; 2023: 27; 2024: 26; 2025: 34; 2026: 23.
151 papers.
Sort:
By area:
- 2022End-to-end symbolic regression with transformerscited by 195
- 2021Neural Symbolic Regression that Scalescited by 185
- 2022Interpretable Scientific Discovery with Symbolic Regression: A Reviewcited by 105
- 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 101
- 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 97
- 2022Rediscovering orbital mechanics with machine learningcited by 71
- 2022Symbolic Physics Learner: Discovering governing equations via Monte Carlo tree searchcited by 61
- 2022SymFormer: End-to-end symbolic regression using transformer-based architecturecited by 56
- 2022Deep Symbolic Regression for Recurrent Sequencescited by 53
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2024Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Modelscited by 40
- 2023Generating Synergistic Formulaic Alpha Collections via Reinforcement Learningcited by 37
38 more
- 2023Interpretable Machine Learning for Science with PySR and SymbolicRegression.jlcited by 36
- 2023Discovering Causal Relations and Equations from Datacited by 33
- 2022gLaSDI: Parametric Physics-informed Greedy Latent Space Dynamics Identificationcited by 30
- 2021Shape-constrained Symbolic Regression -- Improving Extrapolation with Prior Knowledgecited by 27
- 2021Structure-preserving Sparse Identification of Nonlinear Dynamics for Data-driven Modelingcited by 27
- 2023Predicting Ordinary Differential Equations with Transformerscited by 26
- 2024AlphaForge: A Framework to Mine and Dynamically Combine Formulaic Alpha Factorscited by 25
- 2022Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learningcited by 24
- 2022Deep Learning and Symbolic Regression for Discovering Parametric Equationscited by 22
- 2025DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experiencecited by 20
- 2021Physics-informed Spline Learning for Nonlinear Dynamics Discoverycited by 18
- 2022Taylor Genetic Programming for Symbolic Regressioncited by 18
- 2023Automated Scientific Discovery: From Equation Discovery to Autonomous Discovery Systemscited by 18
- 2025A Comprehensive Survey on Self-Interpretable Neural Networkscited by 18
- 2024End-to-End Neuro-Symbolic Reinforcement Learning with Textual Explanationscited by 17
- 2025Call for Action: towards the next generation of symbolic regression benchmarkcited by 16
- 2023Toward Physically Plausible Data-Driven Models: A Novel Neural Network Approach to Symbolic Regressioncited by 14
- 2023A Neural-Guided Dynamic Symbolic Network for Exploring Mathematical Expressions from Datacited by 14
- 2022Integration of knowledge and data in machine learningcited by 13
- 2022From Perception to Programs: Regularize, Overparameterize, and Amortizecited by 13
- 2024LLM4ED: Large Language Models for Automatic Equation Discoverycited by 13
- 2026Think like a Scientist: Physics-guided LLM Agent for Equation Discoverycited by 13
- 2023Theory and implementation of inelastic Constitutive Artificial Neural Networkscited by 12
- 2022GSR: A Generalized Symbolic Regression Approachcited by 11
- 2023Physics-aware Machine Learning Revolutionizes Scientific Paradigm for Machine Learning and Process-based Hydrologycited by 11
- 2021Informed Equation Learningcited by 10
- 2023Efficient Symbolic Policy Learning with Differentiable Symbolic Expressioncited by 9
- 2025Hadamard product in deep learning: Introduction, Advances and Challengescited by 9
- 2021Identifying Physical Law of Hamiltonian Systems via Meta-Learningcited by 8
- 2022Symbolic Recovery of Differential Equations: The Identifiability Problemcited by 8
- 2023Simultaneous identification of models and parameters of scientific simulatorscited by 8
- 2023Physics-constrained robust learning of open-form partial differential equations from limited and noisy datacited by 8
- 2023ParFam -- (Neural Guided) Symbolic Regression Based on Continuous Global Optimizationcited by 8
- 2021Inferring the Structure of Ordinary Differential Equationscited by 7
- 2022Symbolic Expression Transformer: A Computer Vision Approach for Symbolic Regressioncited by 7
- 2022CoNSoLe: Convex Neural Symbolic Learningcited by 7
- 2022Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Studycited by 7
- 2023RSRM: Reinforcement Symbolic Regression Machinecited by 7
50 most cited of 151 All 151 (JSON)
- 2026Learning Chaos Without Seeing Chaos: Extrapolation of Global Dynamics in Autoregressive Transformers30 Sep 2026
- 2026LieDiscover: Adaptive Symbolic Library Construction for Explicit Open-form Symmetry Discovery27 Sep 2026
- 2026SMILE: Bridging Continuous Optimization and Discrete Symbolic Recovery4 Sep 2026
- 2026Shared Symbolic Backbones for Physically Consistent Multi-Output Symbolic Regression29 Jul 2026
- 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithms8 Jun 2026
- 2026EditSR: Enhancing Neural Symbolic Regression via Edit-based Rectification6 Jun 2026
- 2026FunctionEvolve: Structure-Guided Symbolic Regression with LLMs5 Jun 2026
- 2026When Good Equations Get Bad Scores: Improving Symbolic Regression Through Better Parameter Optimization22 May 2026
- 2026FePySR: A Neural Feature Extraction Framework for Efficient and Scalable Symbolic Regression12 May 2026
- 2026A Comparative Study of Model Selection Criteria for Symbolic Regression11 May 2026
- 2026Complex Equation Learner: Rational Symbolic Regression with Gradient Descent in Complex Domain5 May 2026
- 2026Architecture-Induced Recoverability Bias in Differentiable Symbolic Regression25 Apr 2026
38 more
- 2026Neuro-Symbolic ODE Discovery with Latent Grammar Flow17 Apr 2026
- 2026Hardware-Efficient Neuro-Symbolic Networks with the Exp-Minus-Log Operator15 Apr 2026
- 2026Weak-PDE-Net: Discovering Open-Form PDEs via Differentiable Symbolic Networks and Weak Formulation24 Mar 2026
- 2026Neural Structure Embedding for Symbolic Regression via Continuous Structure Search and Coefficient Optimization23 Mar 2026
- 2026Turning Time Series into Algebraic Equations: Symbolic Machine Learning for Interpretable Modeling of Chaotic Time Series7 Mar 2026
- 2026Symmetry-Constrained Language-Guided Program Synthesis for Discovering Governing Equations from Noisy and Partial Observations6 Mar 2026
- 2026Symbolic recovery of PDEs from measurement data17 Feb 2026
- 2026Think like a Scientist: Physics-guided LLM Agent for Equation Discovery12 Feb 2026
- 2026SymPlex: A Structure-Aware Transformer for Symbolic PDE Solving3 Feb 2026
- 2026Mixture of Concept Bottleneck Experts2 Feb 2026
- 2026Beyond Error-Based Optimization: Experience-Driven Symbolic Regression with Goal-Conditioned Reinforcement Learning21 Jan 2026
- 2025Symbolic regression for defect interactions in 2D materials23 Dec 2025
- 2025Introduction to Symbolic Regression in the Physical Sciences17 Dec 2025
- 2025Optimized Architectures for Kolmogorov-Arnold Networks13 Dec 2025
- 2025Softly Symbolifying Kolmogorov-Arnold Networks27 Nov 2025
- 2025When is a System Discoverable from Data? Discovery Requires Chaos12 Nov 2025
- 2025Identification of Empirical Constitutive Models for Age-Hardenable Aluminium Alloy and High-Chromium Martensitic Steel Using Symbolic Regression11 Nov 2025
- 2025EGG-SR: Embedding Symbolic Equivalence into Symbolic Regression via Equality Graph8 Nov 2025
- 2025Auditable Unit-Aware Thresholds in Symbolic Regression via Logistic-Gated Operators5 Oct 2025
- 2025MDBench: Benchmarking Data-Driven Methods for Model Discovery24 Sep 2025
- 2025Probabilistic and nonlinear compressive sensing18 Sep 2025
- 2025Data-driven Discovery of Digital Twins in Biomedical Research29 Aug 2025
- 2025Discovering equations from data: symbolic regression in dynamical systems27 Aug 2025
- 2025C1-approximation with rational functions and rational neural networks27 Aug 2025
- 2025Sparse Interpretable Deep Learning with LIES Networks for Symbolic Regression9 Jun 2025
- 2025DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experience4 Jun 2025
- 2025NeuronSeek: On Stability and Expressivity of Task-driven Neurons1 Jun 2025
- 2025Automated Modeling Method for Pathloss Model Discovery29 May 2025
- 2025Efficient compression of neural networks and datasets23 May 2025
- 2025Discovering Symbolic Differential Equations with Symmetry Invariants17 May 2025
- 2025Deep Symbolic Optimization: Reinforcement Learning for Symbolic Mathematics16 May 2025
- 2025Feasibility-Aware Pessimistic Estimation: Toward Long-Horizon Safety in Offline RL13 May 2025
- 2025UniSymNet: A Unified Symbolic Network Guided by Transformer9 May 2025
- 2025Call for Action: towards the next generation of symbolic regression benchmark6 May 2025
- 2025Neuro-Evolutionary Approach to Physics-Aware Symbolic Regression23 Apr 2025
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2025CTSR: Cartesian tensor-based sparse regression for data-driven discovery of high-dimensional invariant governing equations10 Apr 2025
- 2025Graph-Eq: Discovering Mathematical Equations using Graph Generative Models30 Mar 2025
50 newest of 151 All 151 (JSON)
- 2025DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experiencecited by 20
- 2026Think like a Scientist: Physics-guided LLM Agent for Equation Discoverycited by 13
- 2024OccamLLM: Fast and Exact Language Model Arithmetic in a Single Stepcited by 7
- 2023Probabilistic Regular Tree Priors for Scientific Symbolic Reasoningcited by 1
- 2026Think like a Scientist: Physics-guided LLM Agent for Equation Discovery12 Feb 2026
- 2025DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experience4 Jun 2025
- 2024OccamLLM: Fast and Exact Language Model Arithmetic in a Single Step4 Jun 2024
- 2023Probabilistic Regular Tree Priors for Scientific Symbolic Reasoning14 Jun 2023
- 2022End-to-end symbolic regression with transformerscited by 195
- 2021Neural Symbolic Regression that Scalescited by 185
- 2022Interpretable Scientific Discovery with Symbolic Regression: A Reviewcited by 105
- 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 101
- 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 97
- 2022Rediscovering orbital mechanics with machine learningcited by 71
- 2022Symbolic Physics Learner: Discovering governing equations via Monte Carlo tree searchcited by 61
- 2022SymFormer: End-to-end symbolic regression using transformer-based architecturecited by 56
- 2022Deep Symbolic Regression for Recurrent Sequencescited by 53
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 43
- 2024Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Modelscited by 40
- 2023Generating Synergistic Formulaic Alpha Collections via Reinforcement Learningcited by 37
12 most cited of 145 All 145 (JSON)
- 2026Learning Chaos Without Seeing Chaos: Extrapolation of Global Dynamics in Autoregressive Transformers30 Sep 2026
- 2026LieDiscover: Adaptive Symbolic Library Construction for Explicit Open-form Symmetry Discovery27 Sep 2026
- 2026SMILE: Bridging Continuous Optimization and Discrete Symbolic Recovery4 Sep 2026
- 2026Shared Symbolic Backbones for Physically Consistent Multi-Output Symbolic Regression29 Jul 2026
- 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithms8 Jun 2026
- 2026EditSR: Enhancing Neural Symbolic Regression via Edit-based Rectification6 Jun 2026
- 2026FunctionEvolve: Structure-Guided Symbolic Regression with LLMs5 Jun 2026
- 2026When Good Equations Get Bad Scores: Improving Symbolic Regression Through Better Parameter Optimization22 May 2026
- 2026FePySR: A Neural Feature Extraction Framework for Efficient and Scalable Symbolic Regression12 May 2026
- 2026A Comparative Study of Model Selection Criteria for Symbolic Regression11 May 2026
- 2026Complex Equation Learner: Rational Symbolic Regression with Gradient Descent in Complex Domain5 May 2026
- 2026Architecture-Induced Recoverability Bias in Differentiable Symbolic Regression25 Apr 2026
12 newest of 145 All 145 (JSON)