The Need for Verification in AI-Driven Scientific Discovery
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI) is transforming the practice of science. Machine learning and large language models (LLMs) can generate hypotheses at a scale and speed far exceeding traditional methods, offering the potential to accelerate discovery across diverse fields. However, the abundance of hypotheses introduces a critical challenge: without scalable and reliable mechanisms for verification, scientific progress risks being hindered rather than being advanced. In this article, we trace the historical development of scientific discovery, examine how AI is reshaping established practices for scientific discovery, and review the principal approaches, ranging from data-driven methods and knowledge-aware neural architectures to symbolic reasoning frameworks and LLM agents. While these systems can uncover patterns and propose candidate laws, their scientific value ultimately depends on rigorous and transparent verification, which we argue must be the cornerstone of AI-assisted discovery.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 70 of its 139 references that are in the map. First posted on arXiv 1 Sep 2025.
Builds on
70 of 139 references.
References · 70
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2019Hamiltonian Neural Networkscited by 702
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
38 more
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2020Lagrangian Neural Networkscited by 388
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
- 2017A Semantic Loss Function for Deep Learning with Symbolic Knowledgecited by 267
- 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 246
- 2023Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Taskscited by 243
- 2017Learning Explanatory Rules from Noisy Datacited by 210
- 2025Spurious Rewards: Rethinking Training Signals in RLVRcited by 199
- 2022End-to-end symbolic regression with transformerscited by 195
- 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 173
- 2022Biological Sequence Design with GFlowNetscited by 172
- 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
- 2018Discovering physical concepts with neural networkscited by 117
- 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 117
- 2022Semantic Probabilistic Layers for Neuro-Symbolic Learningcited by 103
- 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
- 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 95
- 2016Neuro-Symbolic Program Synthesiscited by 84
- 2024Can Large Language Models Reason and Plan?cited by 82
- 2019Bayesian Symbolic Regressioncited by 77
- 2020Learning Compositional Rules via Neural Program Synthesiscited by 74
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 74
- 2021Coordinate Independent Convolutional Networks -- Isometry and Gauge Equivariant Convolutions on Riemannian Manifoldscited by 72
- 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 68
- 2019A Logic-Driven Framework for Consistency of Neural Modelscited by 64
- 2020A Bayesian machine scientist to aid in the solution of challenging scientific problemscited by 61
- 2025LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Modelscited by 61
- 2019Augmenting Neural Networks with First-order Logiccited by 51
- 2019Embedding Symbolic Knowledge into Deep Networkscited by 49
- 2023NEWTON: Are Large Language Models Capable of Physical Reasoning?cited by 45
- 2023Large Language Models are Zero Shot Hypothesis Proposerscited by 45
- 2023SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-trainingcited by 41
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 56
- 2025AgenticSciML: Collaborative Multi-Agent Systems for Emergent Discovery in Scientific Machine Learningcited by 13
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
- 2025Bridging the Gap Between Scientific Laws Derived by AI Systems and Canonical Knowledge via Abductive Inference with AI-Noethercited by 0
- 2026Adversarial Fast-Moving Real-World Domains as Test Beds for Benchmarking AI Scientist Capabilitiescited by 0
- 2026Adversarial Fast-Moving Real-World Domains as Test Beds for Benchmarking AI Scientist Capabilities4 Aug 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2025AgenticSciML: Collaborative Multi-Agent Systems for Emergent Discovery in Scientific Machine Learning10 Nov 2025
- 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressively30 Sep 2025
- 2025Bridging the Gap Between Scientific Laws Derived by AI Systems and Canonical Knowledge via Abductive Inference with AI-Noether26 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026Contemporary AI lacks the imagination to diverge or negate in science
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery
- 2026AI Scientists as Engines of Discovery: A Case for Development within Reformed Institutions
- 2025AI-Researcher: Autonomous Scientific Innovation
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation
- 2025Kosmos: An AI Scientist for Autonomous Discovery
- 2026FIRE-Bench: Evaluating AI Agents on the Rediscovery of Scientific Insights