Towards End-to-End Automation of AI Research
Not on the map. Why?
Cited by 60 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The automation of science is a long-standing ambition in the field of AI. While the community has made significant progress in automating individual components of the scientific process, a system that autonomously navigates the entire research lifecycle -- from conception to publication -- has remained out of reach. Here, we present the strongest demonstration to date toward automating the entire process end-to-end. We present The AI Scientist, which creates research ideas, writes code, runs experiments, plots and analyzes data, writes the entire scientific manuscript and performs its own peer review. Its ideas, execution, and presentation are of sufficient quality to produce a manuscript generated by an AI system that passes the first round of peer review at a major machine learning conference workshop. The workshop has an acceptance rate of 70 percent. Our system leverages modern foundation models within a complex agentic system. We evaluate The AI Scientist in two settings: a focused mode using human-provided code templates as an initial scaffold to conduct research on a specific topic, and a template-free, open-ended mode that leverages agentic search for wider scientific exploration. Both settings produce diverse ideas and automatically test, report on, and evaluate them. This achievement demonstrates AI's growing capacity for scientific contribution and signifies a potential paradigm shift in how research is conducted. As with any impactful new technology, there could be significant risks, including taxing overwhelmed review systems and adding noise to scientific literature. However, if developed responsibly, such autonomous systems could greatly accelerate scientific discovery.
Key facts. Cited by 159 papers in the map (data through 14 Oct 2026). Builds on 26 of its 60 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
26 of 60 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2013Intriguing properties of neural networkscited by 5,155
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 776
14 more
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2015Illuminating search spaces by mapping elitescited by 425
- 2024Automated Design of Agentic Systemscited by 407
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 226
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 119
- 2024OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Codecited by 74
- 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 53
- 2024Discovering Preference Optimization Algorithms with and for Large Language Modelscited by 42
- 2020Open Questions in Creating Safe Open-ended AI: Tensions Between Control and Creativitycited by 15
- 2024Learning representations of learning representationscited by 5
Built on by
Citing papers per year: 2026: 159.
159 papers.
Sort:
By area:
- 2026MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discoverycited by 28
- 2026The Red Queen G"odel Machine: Co-Evolving Agents and Their Evaluatorscited by 19
- 2026BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarkscited by 15
- 2026The Art of Building Verifiers for Computer Use Agentscited by 13
- 2026Recursive self-improvement of AI research agentscited by 11
- 2026NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers?cited by 10
- 2026AutoScientists: Self-Organizing Agent Teams for Long-Running Scientific Experimentationcited by 9
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2026Agentic AI Scientists Are Not Built For Autonomous Scientific Discoverycited by 8
- 2026Closing the Loop to Discover Psychological Theories with an Automated Cognitive Scientistcited by 8
- 2026Tracing Agentic Failure from the Flow of Successcited by 8
- 2026AI Coding Agents Can Reproduce Social Science Findingscited by 6
38 more
- 2026Closed-loop Auto Research for Molecular Property Prediction: Discovering and Certifying Generalizable Improvementscited by 6
- 2026End-to-end autonomous scientific discovery on a real optical platformcited by 5
- 2026SciIntegrity-Bench: A Benchmark for Evaluating Academic Integrity in AI Scientist Systemscited by 5
- 2026auto-psych: Automating the science of mind using agent-driven theory discovery and experimentationcited by 5
- 2026Auto Research for Materials: Auditable AI-Scientist Workflows with Held-Out Transfercited by 5
- 2026The Implementation Lottery: Auditing Idea Reliability in Automated Researchcited by 5
- 2026Harness-Zero: Harness Distillation via Agent-as-Harnesscited by 5
- 2026NeuroClaw Technical Reportcited by 4
- 2026AI Research Agents Narrow Scientific Explorationcited by 4
- 2026Life After Benchmark Saturation: A Case Study of CORE-Benchcited by 4
- 2026From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discoverycited by 4
- 2026ASI-Bench: At the Dawn of Artificial Superintelligencecited by 4
- 2026Iteris: Agentic Research Loops for Computational Mathematicscited by 3
- 2026Position: Don't Just "Fix it in Post": A Science of AI Must Study Training Dynamicscited by 3
- 2026Gaming AI-Assisted Peer Reviews Poses New Risks to the Scientific Communitycited by 3
- 2026(Human) Attention Is (Still) All You Need: Human oversight makes AI-assisted social science reliablecited by 3
- 2026Position: Correct Answer, Wrong Mechanism -- When AI Scientists Defend General Claims Their Own Data Contradictscited by 3
- 2026The Calibration Turn in AI-Assisted Research: A Conceptual and Methodological Framework for Evidence-Licensed Claimscited by 3
- 2026The Agentic Garden of Forking Pathscited by 3
- 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agentscited by 3
- 2026Artifact-centered Claim-aware Observability for Autonomous Scientific Agentscited by 3
- 2026Discovery Foundation Models: Toward Open-Ended Discovery Intelligencecited by 3
- 2026Locating Hidden Failures Makes Long-Horizon Agents More Reliablecited by 3
- 2026Grounded autonomous scrutiny at scale: emergent critique from reproduction of published computational physics paperscited by 2
- 2026ForeSci: Evaluating LLM Agents for Forward-Looking AI Research Judgmentcited by 2
- 2026Scaling Participation in Modular AI Systemscited by 2
- 2026Benchmarking Open-Ended Multi-Agent Coordination in Language Agentscited by 2
- 2026AI can help scientists publish lesscited by 2
- 2026Mitigating LLM-based p-Hacking by Preregistering for the Next LLMcited by 2
- 2026Distributed Denial of Science: How Indirect Data Poisoning of AI Systems Can Industrialize Scientific Fraudcited by 2
- 2026An Agentic AI Scientific Community for Automated Neural Operator Discoverycited by 2
- 2026Mechanist: AI as a Scientific Instrument for Discovering the Mechanisms of Intelligencecited by 2
- 2026Beyond the Best Guess: Improving LLM Solution Coverage with Evolution Strategiescited by 2
- 2026What is Missing from AI Post-Training AI: An Empirical Analysiscited by 2
- 2026What Proves You Wrong: Benchmarking Language Models on Falsifiable Research Ideationcited by 2
- 2026AutoScientist-Quant: Self-Evolving Coding Agents for Automatic Research in Quantitative Investmentcited by 2
- 2026HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypothesescited by 2
- 2026ChemGraph-XANES: An Agentic Framework for XANES Simulation and Curationcited by 1
50 most cited of 159 All 159 (JSON)
- 2026The Last Remote Sensing Model Built by Humans? Casting Any Earth Observation Task as Recursive Self-Improvement13 Oct 2026
- 2026One-Sided Verification Under Limited Expert Review13 Oct 2026
- 2026ResearchFlow-Eval: Tracing the Execution Gap in End-to-End Multi-Claim Autoresearch13 Oct 2026
- 2026Large Language Models Extend Known Research But Do Not Create New Research Directions12 Oct 2026
- 2026SciCurateBench: Curating Experimental Data from Heterogeneous Scientific Literature with Verbal-Action Agents9 Oct 2026
- 2026Large Language Models, Machine-Assisted Cultural Analytics, and the Agentic Turn8 Oct 2026
- 2026IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation2 Oct 2026
- 2026The AI Theorist reveals excitonic structure in α-RuCl31 Oct 2026
- 2026Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation1 Oct 2026
- 2026Evidence-Gated Research: Statistically Controlled Model Adoption in Adaptive Search1 Oct 2026
- 2026Agents Are Systems, Not Models: Rethinking Agentic Evaluation1 Oct 2026
- 2026Forking: Sudden Overfitting Under Replay30 Sep 2026
38 more
- 2026CamAgent: An LLM-Agent Framework for Multi-Species Camera-Trap Workflows30 Sep 2026
- 2026Beyond a Better Score: Long-Horizon Agentic ML Development and Evaluation Protocol for Physics Time Series29 Sep 2026
- 2026Can AI Scientists Change Their Minds? Prior-Evidence Conflict in Synthetic Universes29 Sep 2026
- 2026Grounded Revision vs. Prior Injection: Probing Retrieval-Augmented Patent Claim Amendment29 Sep 2026
- 2026What if automating AI R&D triggers an intelligence explosion?28 Sep 2026
- 2026Imprint Reader: From Weight-Update Readout to Behavioral Intervention28 Sep 2026
- 2026Long-Horizon Scaling: How Model Capabilities Shape the Returns to Computation28 Sep 2026
- 2026RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agents28 Sep 2026
- 2026Qwen-Planner-Agent: A Closed-Loop AI-for-AI Framework for Real-World Mobile Planner Agents24 Sep 2026
- 2026Learning to Ideate for Scientific Impact24 Sep 2026
- 2026RECLAIM: Can Agents Reproduce the Claims of Machine Learning Papers?23 Sep 2026
- 2026Driving Epidemic Models with AI Agents: the Epydemix Agent Framework23 Sep 2026
- 2026Recursive self-improvement of AI research agents22 Sep 2026
- 2026The Tasteful Agent: Measuring and Improving Taste in Long-Horizon Tasks22 Sep 2026
- 2026Harness-Zero: Harness Distillation via Agent-as-Harness21 Sep 2026
- 2026ScholarStack: Layered Research Asset Orchestration and Cross-Task Reuse for Scientific Agents20 Sep 2026
- 2026Social Influence and the Allocation of Scientific Attention in AI Populations18 Sep 2026
- 2026Locating Hidden Failures Makes Long-Horizon Agents More Reliable15 Sep 2026
- 2026Discovery Foundation Models: Toward Open-Ended Discovery Intelligence14 Sep 2026
- 2026HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypotheses14 Sep 2026
- 2026LongAgent: History-Guided Agentic Search for Longitudinal Outcome Prediction14 Sep 2026
- 2026Atria Dawn: The Dawn of Agentic Superintelligence14 Sep 2026
- 2026Editorial routing shapes how computational results are qualified in AI-assisted scientific writing13 Sep 2026
- 2026LabAgent: Customize Any Research Hubs for Scientific Discoveries Using AI Agents11 Sep 2026
- 2026Vibe Patenting: Evaluating LLM Judges for Professional Patent-Drafting Agents11 Sep 2026
- 2026Autonomous Research for Open-Ended Problems: A Case Study on Telecom Ticket Retrieval11 Sep 2026
- 2026Scores Alone Do Not Prove Discovery: The Discovery Certification Protocol for Auditing AI Research Agents7 Sep 2026
- 2026CausalVerify: End-to-End Verification of Causal Analyses by Language Models7 Sep 2026
- 2026AIBuildAI-2.5: Efficient Autonomous AI Model Development Through LLM-Guided Tree Search6 Sep 2026
- 2026iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Model28 Aug 2026
- 2026Autonomous Mathematical Discovery in an Open-World Multi-Agent Environment24 Aug 2026
- 2026What Proves You Wrong: Benchmarking Language Models on Falsifiable Research Ideation24 Aug 2026
- 2026When Does AI for PDEs Yield Scientific Evidence?23 Aug 2026
- 2026What is Missing from AI Post-Training AI: An Empirical Analysis19 Aug 2026
- 2026Beyond the Text: Verifying That Agent-Written Papers Are Backed by Their Artifacts18 Aug 2026
- 2026Artifact-centered Claim-aware Observability for Autonomous Scientific Agents18 Aug 2026
- 2026When AI Designs AI: Innovation or Imitation?18 Aug 2026
- 2026ASI-Bench: At the Dawn of Artificial Superintelligence18 Aug 2026
50 newest of 159 All 159 (JSON)
- 2026The Red Queen G"odel Machine: Co-Evolving Agents and Their Evaluatorscited by 19
- 2026BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarkscited by 15
- 2026The Art of Building Verifiers for Computer Use Agentscited by 13
- 2026Recursive self-improvement of AI research agentscited by 11
- 2026NatureBench: Can Coding Agents Match the Published SOTA of Nature-Family Papers?cited by 10
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2026Agentic AI Scientists Are Not Built For Autonomous Scientific Discoverycited by 8
- 2026Tracing Agentic Failure from the Flow of Successcited by 8
- 2026AI Coding Agents Can Reproduce Social Science Findingscited by 6
- 2026Auto Research for Materials: Auditable AI-Scientist Workflows with Held-Out Transfercited by 5
- 2026Harness-Zero: Harness Distillation via Agent-as-Harnesscited by 5
- 2026NeuroClaw Technical Reportcited by 4
12 most cited of 59 All 59 (JSON)
- 2026SciCurateBench: Curating Experimental Data from Heterogeneous Scientific Literature with Verbal-Action Agents9 Oct 2026
- 2026Large Language Models, Machine-Assisted Cultural Analytics, and the Agentic Turn8 Oct 2026
- 2026IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation2 Oct 2026
- 2026Agents Are Systems, Not Models: Rethinking Agentic Evaluation1 Oct 2026
- 2026CamAgent: An LLM-Agent Framework for Multi-Species Camera-Trap Workflows30 Sep 2026
- 2026Beyond a Better Score: Long-Horizon Agentic ML Development and Evaluation Protocol for Physics Time Series29 Sep 2026
- 2026RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agents28 Sep 2026
- 2026Qwen-Planner-Agent: A Closed-Loop AI-for-AI Framework for Real-World Mobile Planner Agents24 Sep 2026
- 2026RECLAIM: Can Agents Reproduce the Claims of Machine Learning Papers?23 Sep 2026
- 2026Driving Epidemic Models with AI Agents: the Epydemix Agent Framework23 Sep 2026
- 2026Recursive self-improvement of AI research agents22 Sep 2026
- 2026The Tasteful Agent: Measuring and Improving Taste in Long-Horizon Tasks22 Sep 2026
12 newest of 59 All 59 (JSON)
- 2026Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflowscited by 1
- 2026Simulate, Reason, Decide: Scientific Reasoning with LLMs for Simulation-Driven Decision Makingcited by 0
- 2026Fine-Tuning Large Language Models for Quantum Reasoningcited by 0
- 2026Autonomous mechanistic discovery of colorectal cancer vulnerabilities via multi-scale AI swarmscited by 0
- 2026Autonomous mechanistic discovery of colorectal cancer vulnerabilities via multi-scale AI swarms28 Jun 2026
- 2026Fine-Tuning Large Language Models for Quantum Reasoning20 Jun 2026
- 2026Simulate, Reason, Decide: Scientific Reasoning with LLMs for Simulation-Driven Decision Making3 Jun 2026
- 2026Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflows22 Apr 2026
- 2026AutoScientists: Self-Organizing Agent Teams for Long-Running Scientific Experimentationcited by 9
- 2026Closing the Loop to Discover Psychological Theories with an Automated Cognitive Scientistcited by 8
- 2026Closed-loop Auto Research for Molecular Property Prediction: Discovering and Certifying Generalizable Improvementscited by 6
- 2026End-to-end autonomous scientific discovery on a real optical platformcited by 5
- 2026SciIntegrity-Bench: A Benchmark for Evaluating Academic Integrity in AI Scientist Systemscited by 5
- 2026auto-psych: Automating the science of mind using agent-driven theory discovery and experimentationcited by 5
- 2026The Implementation Lottery: Auditing Idea Reliability in Automated Researchcited by 5
- 2026Life After Benchmark Saturation: A Case Study of CORE-Benchcited by 4
- 2026ASI-Bench: At the Dawn of Artificial Superintelligencecited by 4
- 2026Position: Don't Just "Fix it in Post": A Science of AI Must Study Training Dynamicscited by 3
- 2026Gaming AI-Assisted Peer Reviews Poses New Risks to the Scientific Communitycited by 3
- 2026(Human) Attention Is (Still) All You Need: Human oversight makes AI-assisted social science reliablecited by 3
12 most cited of 91 All 91 (JSON)
- 2026The Last Remote Sensing Model Built by Humans? Casting Any Earth Observation Task as Recursive Self-Improvement13 Oct 2026
- 2026One-Sided Verification Under Limited Expert Review13 Oct 2026
- 2026ResearchFlow-Eval: Tracing the Execution Gap in End-to-End Multi-Claim Autoresearch13 Oct 2026
- 2026Large Language Models Extend Known Research But Do Not Create New Research Directions12 Oct 2026
- 2026The AI Theorist reveals excitonic structure in α-RuCl31 Oct 2026
- 2026Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation1 Oct 2026
- 2026Evidence-Gated Research: Statistically Controlled Model Adoption in Adaptive Search1 Oct 2026
- 2026Forking: Sudden Overfitting Under Replay30 Sep 2026
- 2026Can AI Scientists Change Their Minds? Prior-Evidence Conflict in Synthetic Universes29 Sep 2026
- 2026What if automating AI R&D triggers an intelligence explosion?28 Sep 2026
- 2026Imprint Reader: From Weight-Update Readout to Behavioral Intervention28 Sep 2026
- 2026Long-Horizon Scaling: How Model Capabilities Shape the Returns to Computation28 Sep 2026
12 newest of 91 All 91 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- 2026ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research
- 2025AI-Researcher: Autonomous Scientific Innovation
- 2026FARS: A Fully Automated Research System Deployed at Scale
- 2026AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directions
- 2026Towards Automating Scientific Review with Google's Paper Assistant Tool