A Survey of AI Scientists
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence is undergoing a profound transition from a computational instrument to an autonomous originator of scientific knowledge. This emerging paradigm, the AI scientist, is architected to emulate the complete scientific workflow-from initial hypothesis generation to the final synthesis of publishable findings-thereby promising to fundamentally reshape the pace and scale of discovery. However, the rapid and unstructured proliferation of these systems has created a fragmented research landscape, obscuring overarching methodological principles and developmental trends. This survey provides a systematic and comprehensive synthesis of this domain by introducing a unified, six-stage methodological framework that deconstructs the end-to-end scientific process into: Literature Review, Idea Generation, Experimental Preparation, Experimental Execution, Scientific Writing, and Paper Generation. Through this analytical lens, we chart the field's evolution from early Foundational Modules (2022-2023) to integrated Closed-Loop Systems (2024), and finally to the current frontier of Scalability, Impact, and Human-AI Collaboration (2025-present). By rigorously synthesizing these developments, this survey not only clarifies the current state of autonomous science but also provides a critical roadmap for overcoming remaining challenges in robustness and governance, ultimately guiding the next generation of systems toward becoming trustworthy and indispensable partners in human scientific inquiry.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 72 of its 115 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
72 of 115 references.
References · 72
- 2023GPT-4 Technical Reportcited by 18,132
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2022DS-1000: A Natural and Reliable Benchmark for Data Science Code Generationcited by 442
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
- 2024Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understandingcited by 185
- 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
38 more
- 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Taskscited by 134
- 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoningcited by 127
- 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 127
- 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 121
- 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoningcited by 119
- 2024DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?cited by 119
- 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
- 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Modelscited by 97
- 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 95
- 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
- 2025AI-Researcher: Autonomous Scientific Innovationcited by 88
- 2022Natural Language to Code Generation in Interactive Data Science Notebookscited by 86
- 2025LLM4SR: A Survey on Large Language Models for Scientific Researchcited by 81
- 2024Delving into LLM-assisted writing in biomedical publications through excess vocabularycited by 75
- 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 74
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
- 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 72
- 2024Hypothesis Generation with Large Language Modelscited by 68
- 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 68
- 2024Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent Systemcited by 63
- 2024LitLLM: A Toolkit for Scientific Literature Reviewcited by 61
- 2024ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterizationcited by 60
- 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 57
- 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 56
- 2024Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideascited by 52
- 2023BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biologycited by 42
- 2024Automated Statistical Model Discovery with Language Modelscited by 41
- 2024Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMscited by 40
- 2024Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluationcited by 39
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 36
- 2024Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extractioncited by 33
- 2025AI Idea Bench 2025: AI Research Idea Generation Benchmarkcited by 33
- 2025Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agentscited by 31
- 2025SR-Scientist: Scientific Equation Discovery With Agentic AIcited by 30
- 2024AI for social science and social science of AI: A Surveycited by 29
- 2025SciSciGPT: Advancing Human-AI Collaboration in the Science of Sciencecited by 26
- 2024Evaluating LLMs' Divergent Thinking Capabilities for Scientific Idea Generation with Minimal Contextcited by 25
- 2025When AI Co-Scientists Fail: SPOT-a Benchmark for Automated Verification of Scientific Researchcited by 25
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026PostTrainBench: Can LLM Agents Automate LLM Post-Training?cited by 45
- 2026Omni-SimpleMem: Autoresearch-Guided Discovery of Lifelong Multimodal Agent Memorycited by 13
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 10
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 9
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
- 2026DeepInflation: an AI agent for research and model discovery of inflationcited by 1
- 2026SciAtlas: A Computable Atlas of Science for Knowledge-Grounded AI Researchcited by 1
- 2026RankLLM: Weighted Ranking of LLMs by Quantifying Question Difficultycited by 0
- 2026Toward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structurecited by 0
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026Toward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structure17 Jun 2026
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinement10 Jun 2026
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery22 May 2026
- 2026SciAtlas: A Computable Atlas of Science for Knowledge-Grounded AI Research20 May 2026
- 2026Omni-SimpleMem: Autoresearch-Guided Discovery of Lifelong Multimodal Agent Memory1 Apr 2026
- 2026PostTrainBench: Can LLM Agents Automate LLM Post-Training?9 Mar 2026
- 2026RankLLM: Weighted Ranking of LLMs by Quantifying Question Difficulty12 Feb 2026
- 2026DeepInflation: an AI agent for research and model discovery of inflation14 Jan 2026