Recursive Criticality of AI Self-Improvement
Not on the map. Why?
Abstract (arXiv)
AI is increasingly used in the R&D process that produces future AI systems. We study the conditions under which this feedback becomes self-amplifying. Our model describes how the rate of AI capability growth depends on baseline research productivity, recursive feedback, and the increasing difficulty of research progress. We derive a recursive reproduction number, RAI, that determines whether improvements are amplified or damped across development cycles. This quantity compares the strength of feedback with the rate at which further progress becomes more difficult. When RAI>1, the effects of improvements compound across development cycles, placing the system in a self-amplifying regime. When RAI<1, their effects weaken across cycles. The transition depends on the structure of the AI R&D feedback loop and need not occur at any particular level of model capability. A system can therefore enter a self-amplifying regime before acceleration becomes visible, while rapid progress can also occur without self-amplification. Higher baseline research productivity can accelerate progress without changing whether the system is self-amplifying, but the duration of the development cycle becomes a limiting timescale for amplification. Increasing research difficulty can end a period of self-amplification. Extending the model to multiple research actors shows that improvements shared across organizations can make the overall research ecosystem self-amplifying even when no individual actor is. The framework identifies measurable properties of AI R&D systems that can help distinguish recursive amplification from rapid progress driven by other sources, including the strength of recursive feedback, how effectively improvements propagate into successor systems, cycle duration, and the increasing difficulty of further progress.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 34 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
13 of 34 references.
References · 13
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
- 2025Measuring AI Ability to Complete Long Software Taskscited by 156
- 2025AI Research Agents for Machine Learning: Search, Exploration, and Generalization in MLE-benchcited by 71
- 2024Thousands of AI Authors on the Future of AIcited by 48
- 2025A Rosetta Stone for AI Benchmarkscited by 36
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 35
- 2024Algorithmic progress in language modelscited by 31
- 2016Self-Modification of Policy and Utility Function in Rational Agentscited by 11
- 2026Measuring AI R&D Automationcited by 9
- 2025On the Origin of Algorithmic Progress in AIcited by 6
- 2025A Mathematical Framework for AI Singularity: Conditions, Bounds, and Control of Recursive Improvementcited by 5
- 2026From AGI to ASIcited by 4
Built on by
Not cited yet.