LLM-ACES: Closed-Loop Discovery of Dynamical Systems with LLM-Guided Adaptive Search
Not on the map. Why?
Abstract (arXiv)
Recovering governing Ordinary Differential Equations (ODEs) from data is a central challenge in modeling dynamical systems across scientific domains. Existing approaches cast discovery as a static inference problem over fixed datasets, assuming that the observed trajectories are sufficiently informative. However, dynamical systems evolve over large state spaces, and limited data can make multiple equations observationally indistinguishable, leading to identifiability gaps and the recovery of incorrect governing equations. To address this, we introduce LLM-ACES, or LLM-guided Active Closed-loop Equation Search, a closed-loop framework that jointly optimizes symbolic hypothesis construction and adaptive data acquisition. In LLM-ACES, a large language model (LLM) proposes operator priors that partition the large search space into distinct regions, within which candidate equations are fit to the observed data. The disagreement among these candidates guides the acquisition of informative trajectories, creating a feedback loop that iteratively refines both the hypothesis space and the discovered dynamics. On 122 ODE systems spanning ODEBench and ODEBase, LLM-ACES achieves the lowest median NMSE, outperforming state-of-the-art baselines by several orders of magnitude while achieving a high symbolic accuracy of 46.2% and 52.4%, respectively. Our analysis further shows that LLM-ACES is sample-efficient, achieving better performance with one-tenth the data. Furthermore, LLM-ACES's feedback-driven data acquisition makes it robust to noise and recovers the correct symbolic structure, while baselines introduce spurious terms that fit the data locally but obscure the true governing relationships.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 56 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
35 of 56 references.
References · 35
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 602
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2022End-to-end symbolic regression with transformerscited by 195
- 2021Neural Symbolic Regression that Scalescited by 185
- 2021Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and controlcited by 134
- 2022Evolution through Large Modelscited by 131
- 2023Large Language Models as Evolutionary Optimizerscited by 122
- 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 117
23 more
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 101
- 2020Active Learning for Nonlinear System Identification with Guaranteescited by 78
- 2024Symbolic Regression with a Learned Concept Librarycited by 76
- 2023Transformer-based Planning for Symbolic Regressioncited by 72
- 2022Symbolic Physics Learner: Discovering governing equations via Monte Carlo tree searchcited by 61
- 2025LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Modelscited by 61
- 2024Efficient Evolutionary Search Over Chemical Space with Large Language Modelscited by 59
- 2024Large Language Models As Evolution Strategiescited by 57
- 2024Towards Scientific Discovery with Generative AI: Progress, Opportunities, and Challengescited by 41
- 2023SoK: Memorization in General-Purpose Large Language Modelscited by 36
- 2020Active Learning for Identification of Linear Dynamical Systemscited by 33
- 2023Optimistic Active Exploration of Dynamical Systemscited by 32
- 2024In-Context Symbolic Regression: Leveraging Large Language Models for Function Discoverycited by 29
- 2022Taylor Genetic Programming for Symbolic Regressioncited by 18
- 2025LLEMA: Evolutionary Search with LLMs for Multi-Objective Materials Discoverycited by 11
- 2022Active Learning Improves Performance on Symbolic RegressionTasks in StackGPcited by 8
- 2021Inferring the Structure of Ordinary Differential Equationscited by 7
- 2025MDBench: Benchmarking Data-Driven Methods for Model Discoverycited by 7
- 2026LLM-AutoSciLab: Closed-Loop Scientific Discovery via Active Experimentation with LLMscited by 7
- 2023Active Learning in Genetic Programming: Guiding Efficient Data Collection for Symbolic Regressioncited by 3
- 2024Active Symbolic Discovery of Ordinary Differential Equations via Phase Portrait Sketchingcited by 3
- 2026LLM-ODE: Data-driven Discovery of Dynamical Systems with Large Language Modelscited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
- 2026Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world modelscited by 6
- 2026What Should a Large Language Model See? Physical Invariants as a Data Representation for PDE Discoverycited by 0
- 2026ALDER: Discovering the Laws of a World by Acting in Itcited by 0
- 2026LLM-IDEA: Identifiability-Driven Experimental Agent for Autonomous Discovery of Mechanistic World Modelscited by 0
- 2026LLM-IDEA: Identifiability-Driven Experimental Agent for Autonomous Discovery of Mechanistic World Models8 Oct 2026
- 2026ALDER: Discovering the Laws of a World by Acting in It27 Sep 2026
- 2026What Should a Large Language Model See? Physical Invariants as a Data Representation for PDE Discovery25 Aug 2026
- 2026Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models10 Aug 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026