Recursive self-improvement of AI research agents
On the map: LLM agents and tool use → Web, search, and research agents also fits: General LLM agent frameworks and benchmarks
Abstract (arXiv)
AI agents are beginning to automate research and development across the AI stack, from improving training efficiency to optimizing inference. A natural next step is to improve the research efficiency of the agents themselves. When an AI research agent's own code is the object of optimization, each accepted rewrite becomes the agent that the next round edits. We refer to this loop as recursive self-improvement. Its significance lies in a long-standing trend, in which increased cumulative spending on R&D yields diminishing returns. Sustained self-improvement offers a way to counter this trend. We present AIDE^2, a system that implements this loop for a frontier AI research agent. It proposes changes to its own code, benchmarks modified versions of itself on a suite of AI R&D tasks, and keeps the changes that perform best on hidden evaluations. In an autonomous 8-day run, AIDE^2 discovered seven successive improvements, ranging from a new search policy to memory mechanisms that compress and manage the agent's growing context. These gains generalize to four held-out benchmarks spanning machine learning engineering, heuristic algorithm engineering, and physics-based weather forecasting, the last of which is out of distribution from the selection tasks. On all four, the strongest discovered agent matches or exceeds a human-engineered production research agent that ranks among the strongest on FML-Bench. On a separate held-out task family, the discovered agents also exhibit reduced reward hacking, a property the loop never explicitly optimized for: the rate falls from 55% to 32% during the run, 7 percentage points below the human-engineered agent. Together, these results show that an AI research agent can improve its own research efficiency through recursive self-improvement, and that these gains transfer to tasks and domains the loop never encountered.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 83 of its 120 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
83 of 120 references.
Closest ancestors · 16
Same direction, newest first
- 2026AutoData: Agentic Search for Pre-training Data Selection17 Sep
- 2026AI Research Preference Models14 Aug
- 2026Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models10 Aug
- 2026Autodata: An agentic data scientist to create high quality synthetic data24 Jun
- 2026FML-bench: A Controlled Study of AI Research Agent Strategies from the Perspective of Search Dynamics17 May
- 2026AIRA_2: Overcoming Bottlenecks in AI Research Agents27 Mar
- 2026AIRS-Bench: a Suite of Tasks for Frontier AI Research Science Agents6 Feb
- 2026Why LLMs Aren't Scientists Yet: Lessons from Four Autonomous Research Attempts6 Jan
- 2025AI Research Agents for Machine Learning: Search, Exploration, and Generalization in MLE-bench3 Jul
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search10 Apr
- 2025MLGym: A New Framework and Benchmark for Advancing AI Research Agents20 Feb
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
4 more
- 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts22 Nov
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering9 Oct
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers6 Sep
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation5 Oct
Other references · 67
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2023Large Language Models as Optimizerscited by 830
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2016Learning to learn by gradient descent by gradient descentcited by 616
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
38 more
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2023Symbolic Discovery of Optimization Algorithmscited by 423
- 2015Illuminating search spaces by mapping elitescited by 406
- 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 403
- 2024AFlow: Automating Agentic Workflow Generationcited by 395
- 2024Automated Design of Agentic Systemscited by 360
- 2015Gradient-based Hyperparameter Optimization through Reversible Learningcited by 357
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
- 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 226
- 2025KernelBench: Can LLMs Write Efficient GPU Kernels?cited by 206
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 206
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
- 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Promptscited by 189
- 2022Defining and Characterizing Reward Hackingcited by 184
- 2026Towards End-to-End Automation of AI Researchcited by 150
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
- 2020AutoML-Zero: Evolving Machine Learning Algorithms From Scratchcited by 137
- 2022Evolution through Large Modelscited by 131
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
- 2019Generalized Inner Loop Meta-Learningcited by 92
- 2024Open-Endedness is Essential for Artificial Superhuman Intelligencecited by 79
- 2020Discovering Reinforcement Learning Algorithmscited by 75
- 2024Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMscited by 62
- 2025A Self-Improving Coding Agentcited by 58
- 2025CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentationcited by 54
- 2025Towards Robust Agentic CUDA Kernel Benchmarking, Verification, and Optimizationcited by 52
- 2025The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideascited by 49
- 2026AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimizationcited by 46
- 2026EvoX: Meta-Evolution for Automated Discoverycited by 45
- 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 44
- 2026Hyperagentscited by 40
- 2024Discovering Preference Optimization Algorithms with and for Large Language Modelscited by 38
- 2024LLM4AD: A Platform for Algorithm Design with Large Language Modelcited by 33
- 2025ALE-Bench: A Benchmark for Long-Horizon Objective-Driven Algorithm Engineeringcited by 30
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026AI4AI-Bench: Benchmarking LLM Agents in Algorithmic Design for Recursive Self-Improvement
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops
- 2026RRSI: Regularized Recursive Self-Improvement of Agent Harnesses
- 2026Knowledge-Centric Self-Improvement
- 2026RSIGym: A Flexible Environment for Recursive Self-Improvement
- 2026Recursive Harness Self-Improvement
- 2026RSIBench-Data: Benchmarking Data-Centric Research for Recursive Self-Improvement
- 2026AREX: Towards a Recursively Self-Improving Agent for Deep Research