mlsanityData to 14 Oct 2026

Automated Scientific Discovery: From Equation Discovery to Autonomous Discovery Systems

arXiv 2305.02251 ↗First posted 3 May 2023cs.AI cs.LGcited by 19

Not on the map. Why?

Abstract (arXiv)

The paper surveys automated scientific discovery, from equation discovery and symbolic regression to autonomous discovery systems and agents. It discusses the individual approaches from a "big picture" perspective and in context, but also discusses open issues and recent topics like the various roles of deep neural networks in this area, aiding in the discovery of human-interpretable knowledge. Further, we will present closed-loop scientific discovery systems, starting with the pioneering work on the Adam system up to current efforts in fields from material science to astronomy. Finally, we will elaborate on autonomy from a machine learning perspective, but also in analogy to the autonomy levels in autonomous driving. The maximal level, level five, is defined to require no human intervention at all in the production of scientific knowledge. Achieving this is one step towards solving the Nobel Turing Grand Challenge to develop AI Scientists: AI systems capable of making Nobel-quality scientific discoveries highly autonomously at a level comparable, and possibly superior, to the best human scientists by 2050.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 39 of its 157 references that are in the map. First posted on arXiv 3 May 2023.

Builds on

39 of 157 references.

References · 39

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  3. 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 752
  4. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
  5. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 536
  6. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  7. 2019Analyzing Learned Molecular Representations for Property Predictioncited by 375
  8. 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 344
  9. 2019DAG-GNN: DAG Structure Learning with Graph Neural Networkscited by 331
  10. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
  11. 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 309
  12. 2013Causal Discovery with Continuous Additive Noise Modelscited by 255
27 more
  1. 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
  2. 2019Gradient-Based Neural DAG Learningcited by 227
  3. 2019Learning Sparse Nonparametric DAGscited by 207
  4. 2022End-to-end symbolic regression with transformerscited by 203
  5. 2021Neural Symbolic Regression that Scalescited by 192
  6. 2013CAM: Causal additive models, high-dimensional order search and penalized regressioncited by 178
  7. 2018Learning Equations for Extrapolation and Controlcited by 156
  8. 2019Causal Discovery with Reinforcement Learningcited by 145
  9. 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 144
  10. 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 122
  11. 2021SymbolicGPT: A Generative Transformer Model for Symbolic Regressioncited by 105
  12. 2022Interpretable Scientific Discovery with Symbolic Regression: A Reviewcited by 105
  13. 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 101
  14. 2023Transformer-based Planning for Symbolic Regressioncited by 79
  15. 2022Rediscovering orbital mechanics with machine learningcited by 71
  16. 2022MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Designcited by 66
  17. 2020A Bayesian machine scientist to aid in the solution of challenging scientific problemscited by 61
  18. 2023Deep Generative Symbolic Regression with Monte-Carlo-Tree-Searchcited by 41
  19. 2020Probabilistic Grammars for Equation Discoverycited by 36
  20. 2023Controllable Neural Symbolic Regressioncited by 20
  21. 2020Active Measure Reinforcement Learning for Observation Cost Minimizationcited by 17
  22. 2022Dimensionless machine learning: Imposing exact units equivariancecited by 17
  23. 2023Toward Physically Plausible Data-Driven Models: A Novel Neural Network Approach to Symbolic Regressioncited by 14
  24. 2021From Kepler to Newton: Explainable AI for Sciencecited by 13
  25. 2023Efficient Generator of Mathematical Expressions for Symbolic Regressioncited by 13
  26. 2022From latent dynamics to meaningful representationscited by 5
  27. 2021Deep Neural Networks to Recover Unknown Physical Parameters from Oscillating Time Seriescited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 7; 2025: 3; 2026: 7.

19 papers.

Sort:

By area:

  1. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
  2. 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discoverycited by 86
  3. 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 77
  4. 2025Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agentscited by 33
  5. 2024How Far Are We From AGI: Are LLMs All We Need?cited by 31
  6. 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 10
  7. 2024Creativity in AI: Progresses and Challengescited by 7
  8. 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Modelscited by 7
  9. 2024AutoSciLab: A Self-Driving Laboratory For Interpretable Scientific Discoverycited by 5
  10. 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
  11. 2024Game On: Towards Language Models as RL Experimenterscited by 1
  12. 2024Aligning AI-driven discovery with human intuitioncited by 1
7 more
  1. 2026ToxScreen: Detecting Whether an LLM Has Been Poisonedcited by 1
  2. 2026Can AI Follow In Einstein's Footsteps?cited by 1
  3. 2025Towards explainable decision support using hybrid neural models for logistic terminal automationcited by 0
  4. 2026FunctionEvolve: Structure-Guided Symbolic Regression with LLMscited by 0
  5. 2026ERBench: A Benchmark and Testsuite for Equation Discovery Algorithmscited by 0
  6. 2026Automatic Ordinary Differential Equations Discovery For Biological Systems Using Large Language Model Powered Agentic Systemcited by 0
  7. 2026Pre-Registered Genesis Accounting for Recursive Self-Improvement: First Audited Operator-Genesis Events in a Physics-Discovery Runtimecited by 0