mlsanityData to 7 Oct 2026

A Survey of AI Scientists

arXiv 2510.23045 ↗First posted 27 Oct 2025cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence is undergoing a profound transition from a computational instrument to an autonomous originator of scientific knowledge. This emerging paradigm, the AI scientist, is architected to emulate the complete scientific workflow-from initial hypothesis generation to the final synthesis of publishable findings-thereby promising to fundamentally reshape the pace and scale of discovery. However, the rapid and unstructured proliferation of these systems has created a fragmented research landscape, obscuring overarching methodological principles and developmental trends. This survey provides a systematic and comprehensive synthesis of this domain by introducing a unified, six-stage methodological framework that deconstructs the end-to-end scientific process into: Literature Review, Idea Generation, Experimental Preparation, Experimental Execution, Scientific Writing, and Paper Generation. Through this analytical lens, we chart the field's evolution from early Foundational Modules (2022-2023) to integrated Closed-Loop Systems (2024), and finally to the current frontier of Scalability, Impact, and Human-AI Collaboration (2025-present). By rigorously synthesizing these developments, this survey not only clarifies the current state of autonomous science but also provides a critical roadmap for overcoming remaining challenges in robustness and governance, ultimately guiding the next generation of systems toward becoming trustworthy and indispensable partners in human scientific inquiry.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 72 of its 115 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

72 of 115 references.

References · 72

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  3. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  4. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
  5. 2022DS-1000: A Natural and Reliable Benchmark for Data Science Code Generationcited by 442
  6. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
  7. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  8. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
  9. 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
  10. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
  11. 2024Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understandingcited by 185
  12. 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
38 more
  1. 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Taskscited by 134
  2. 2024ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoningcited by 127
  3. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 127
  4. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 121
  5. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoningcited by 119
  6. 2024DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?cited by 119
  7. 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
  8. 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Modelscited by 97
  9. 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 95
  10. 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
  11. 2025AI-Researcher: Autonomous Scientific Innovationcited by 88
  12. 2022Natural Language to Code Generation in Interactive Data Science Notebookscited by 86
  13. 2025LLM4SR: A Survey on Large Language Models for Scientific Researchcited by 81
  14. 2024Delving into LLM-assisted writing in biomedical publications through excess vocabularycited by 75
  15. 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 74
  16. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
  17. 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 72
  18. 2024Hypothesis Generation with Large Language Modelscited by 68
  19. 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 68
  20. 2024Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent Systemcited by 63
  21. 2024LitLLM: A Toolkit for Scientific Literature Reviewcited by 61
  22. 2024ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterizationcited by 60
  23. 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 57
  24. 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 56
  25. 2024Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideascited by 52
  26. 2023BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biologycited by 42
  27. 2024Automated Statistical Model Discovery with Language Modelscited by 41
  28. 2024Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMscited by 40
  29. 2024Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluationcited by 39
  30. 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 36
  31. 2024Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extractioncited by 33
  32. 2025AI Idea Bench 2025: AI Research Idea Generation Benchmarkcited by 33
  33. 2025Curie: Toward Rigorous and Automated Scientific Experimentation with AI Agentscited by 31
  34. 2025SR-Scientist: Scientific Equation Discovery With Agentic AIcited by 30
  35. 2024AI for social science and social science of AI: A Surveycited by 29
  36. 2025SciSciGPT: Advancing Human-AI Collaboration in the Science of Sciencecited by 26
  37. 2024Evaluating LLMs' Divergent Thinking Capabilities for Scientific Idea Generation with Minimal Contextcited by 25
  38. 2025When AI Co-Scientists Fail: SPOT-a Benchmark for Automated Verification of Scientific Researchcited by 25

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.