Automated Scientific Discovery: From Equation Discovery to Autonomous Discovery Systems
Not on the map. Why?
Abstract (arXiv)
The paper surveys automated scientific discovery, from equation discovery and symbolic regression to autonomous discovery systems and agents. It discusses the individual approaches from a "big picture" perspective and in context, but also discusses open issues and recent topics like the various roles of deep neural networks in this area, aiding in the discovery of human-interpretable knowledge. Further, we will present closed-loop scientific discovery systems, starting with the pioneering work on the Adam system up to current efforts in fields from material science to astronomy. Finally, we will elaborate on autonomy from a machine learning perspective, but also in analogy to the autonomy levels in autonomous driving. The maximal level, level five, is defined to require no human intervention at all in the production of scientific knowledge. Achieving this is one step towards solving the Nobel Turing Grand Challenge to develop AI Scientists: AI systems capable of making Nobel-quality scientific discoveries highly autonomously at a level comparable, and possibly superior, to the best human scientists by 2050.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 39 of its 157 references that are in the map. First posted on arXiv 3 May 2023.
Builds on
39 of 157 references.
References · 39
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 752
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
- 2015Causal inference using invariant prediction: identification and confidence intervalscited by 536
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 375
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 344
- 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 331
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
- 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 309
- 2013Causal Discovery with Continuous Additive Noise Modelscited by 255
27 more
- 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
- 2019Gradient-Based Neural DAG Learningcited by 227
- 2019Learning Sparse Nonparametric DAGscited by 207
- 2022End-to-end symbolic regression with transformerscited by 203
- 2021Neural Symbolic Regression that Scalescited by 192
- 2013CAM: Causal additive models, high-dimensional order search and penalized regressioncited by 178
- 2018Learning Equations for Extrapolation and Controlcited by 156
- 2019Causal Discovery with Reinforcement Learningcited by 145
- 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 144
- 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 122
- 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 105
- 2022Interpretable Scientific Discovery with Symbolic Regression: A Reviewcited by 105
- 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 101
- 2023Transformer-based Planning for Symbolic Regressioncited by 79
- 2022Rediscovering orbital mechanics with machine learningcited by 71
- 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
- 2020A Bayesian machine scientist to aid in the solution of challenging scientific problemscited by 61
- 2023Deep Generative Symbolic Regression with Monte-Carlo-Tree-Searchcited by 41
- 2020Probabilistic Grammars for Equation Discoverycited by 36
- 2023Controllable Neural Symbolic Regressioncited by 20
- 2020Active Measure Reinforcement Learning for Observation Cost Minimizationcited by 17
- 2022Dimensionless machine learning: Imposing exact units equivariancecited by 17
- 2023Toward Physically Plausible Data-Driven Models: A Novel Neural Network Approach to Symbolic Regressioncited by 14
- 2021From Kepler to Newton: Explainable AI for Sciencecited by 13
- 2023Efficient Generator of Mathematical Expressions for Symbolic Regressioncited by 13
- 2022From latent dynamics to meaningful representationscited by 5
- 2021Deep Neural Networks to Recover Unknown Physical Parameters from Oscillating Time Seriescited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 7; 2025: 3; 2026: 7.
19 papers.
Sort:
By area:
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
- 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discoverycited by 86
- 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 77
- 2025Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agentscited by 33
- 2024How Far Are We From AGI: Are LLMs All We Need?cited by 31
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 10
- 2024Creativity in AI: Progresses and Challengescited by 7
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Modelscited by 7
- 2024AutoSciLab: A Self-Driving Laboratory For Interpretable Scientific Discoverycited by 5
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
- 2024Game On: Towards Language Models as RL Experimenterscited by 1
- 2024Aligning AI-driven discovery with human intuitioncited by 1
7 more
- 2026ToxScreen: Detecting Whether an LLM Has Been Poisonedcited by 1
- 2026Can AI Follow In Einstein's Footsteps?cited by 1
- 2025Towards explainable decision support using hybrid neural models for logistic terminal automationcited by 0
- 2026FunctionEvolve: Structure-Guided Symbolic Regression with LLMscited by 0
- 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithmscited by 0
- 2026Automatic Ordinary Differential Equations Discovery For Biological Systems Using Large Language Model Powered Agentic Systemcited by 0
- 2026Pre-Registered Genesis Accounting for Recursive Self-Improvement: First Audited Operator-Genesis Events in a Physics-Discovery Runtimecited by 0
- 2026Pre-Registered Genesis Accounting for Recursive Self-Improvement: First Audited Operator-Genesis Events in a Physics-Discovery Runtime10 Oct 2026
- 2026Can AI Follow In Einstein's Footsteps?30 Jul 2026
- 2026ToxScreen: Detecting Whether an LLM Has Been Poisoned29 Jul 2026
- 2026Automatic Ordinary Differential Equations Discovery For Biological Systems Using Large Language Model Powered Agentic System15 Jul 2026
- 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithms8 Jun 2026
- 2026FunctionEvolve: Structure-Guided Symbolic Regression with LLMs5 Jun 2026
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery22 May 2026
- 2025Towards explainable decision support using hybrid neural models for logistic terminal automation9 Sep 2025
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Models3 Sep 2025
- 2025Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents22 Feb 2025
- 2024AutoSciLab: A Self-Driving Laboratory For Interpretable Scientific Discovery16 Dec 2024
- 2024Creativity in AI: Progresses and Challenges22 Oct 2024
7 more
- 2024Aligning AI-driven discovery with human intuition9 Oct 2024
- 2024Game On: Towards Language Models as RL Experimenters5 Sep 2024
- 2024BLADE: Benchmarking Language Model Agents for Data-Driven Science19 Aug 2024
- 2024How Far Are We From AGI: Are LLMs All We Need?16 May 2024
- 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery16 May 2024
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Research6 Dec 2023
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation5 Oct 2023
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
- 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 77
- 2025Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agentscited by 33
- 2026Automatic Ordinary Differential Equations Discovery For Biological Systems Using Large Language Model Powered Agentic Systemcited by 0
- 2026Automatic Ordinary Differential Equations Discovery For Biological Systems Using Large Language Model Powered Agentic System15 Jul 2026
- 2025Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agents22 Feb 2025
- 2024BLADE: Benchmarking Language Model Agents for Data-Driven Science19 Aug 2024
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation5 Oct 2023
- 2026ToxScreen: Detecting Whether an LLM Has Been Poisonedcited by 1
- 2026ToxScreen: Detecting Whether an LLM Has Been Poisoned29 Jul 2026
- 2024How Far Are We From AGI: Are LLMs All We Need?cited by 31
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 10
- 2024Creativity in AI: Progresses and Challengescited by 7
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Modelscited by 7
- 2024AutoSciLab: A Self-Driving Laboratory For Interpretable Scientific Discoverycited by 5
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
- 2024Game On: Towards Language Models as RL Experimenterscited by 1
- 2024Aligning AI-driven discovery with human intuitioncited by 1
- 2026Can AI Follow In Einstein's Footsteps?cited by 1
- 2025Towards explainable decision support using hybrid neural models for logistic terminal automationcited by 0
- 2026FunctionEvolve: Structure-Guided Symbolic Regression with LLMscited by 0
- 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithmscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Pre-Registered Genesis Accounting for Recursive Self-Improvement: First Audited Operator-Genesis Events in a Physics-Discovery Runtime10 Oct 2026
- 2026Can AI Follow In Einstein's Footsteps?30 Jul 2026
- 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithms8 Jun 2026
- 2026FunctionEvolve: Structure-Guided Symbolic Regression with LLMs5 Jun 2026
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery22 May 2026
- 2025Towards explainable decision support using hybrid neural models for logistic terminal automation9 Sep 2025
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Models3 Sep 2025
- 2024AutoSciLab: A Self-Driving Laboratory For Interpretable Scientific Discovery16 Dec 2024
- 2024Creativity in AI: Progresses and Challenges22 Oct 2024
- 2024Aligning AI-driven discovery with human intuition9 Oct 2024
- 2024Game On: Towards Language Models as RL Experimenters5 Sep 2024
- 2024How Far Are We From AGI: Are LLMs All We Need?16 May 2024
12 newest of 13 All 13 (JSON)