mlsanityData to 7 Oct 2026

Audit the Scaffold, Not the Checkpoint: A Stationarity Dichotomy for Recursive Self-Improvement in Agentic Coding

arXiv 2609.34924 ↗First posted 28 Sep 2026cs.LG cs.AI cs.SEcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

An auditor who checks whether a system's weights are frozen is checking the wrong thing. Our stationarity dichotomy says that iterative self-modification hits strict diminishing returns whenever the agent's reachable set of edits stays fixed, and can escape only if that set expands. Rewriting scaffolding (tools, verifiers, decomposition) expands what an agent reaches without touching a weight, so frozen weights buy an eventual ceiling but no stationarity along the way. The criterion also separates three regimes usually merged: search within a fixed class, test-time training that raises the ceiling itself, and scaffold rewriting between them. Audit the scaffold, not the checkpoint. The same ceiling binds sideways. Best-of-k orchestration realizes the best worker's ceiling exactly: width buys rate, not budget. Re-consulting a fixed pool has a horizon computable in advance, decided by the pool alone, and the one arrangement that would beat it, a weighted vote, needs diversity real workers lack: on 30 same-family workers the failure overlap sits at its maximum, and a majority fails 23/55 (42%) of tasks. We obtain the criterion by reading refinement as gradient boosting on the residual error between draft and target, a patch or git diff, and then measuring where that reading breaks: patches compose instead of standing beside each other to be voted on, and failures overlap. What we measure is saturation. Per-round improvement decays toward zero on SWE-bench, and churn decays geometrically across 401 production sessions, a shape shared with a pre-AI human baseline that establishes the regime without identifying its cause. Both breaks are engineering choices rather than laws about code, so together they specify a harness worth building.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 51 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

21 of 51 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  2. 2023ChatDev: Communicative Agents for Software Development16 Jul

Other references · 19

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  4. 2016Concrete Problems in AI Safetycited by 1,582
  5. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  6. 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 329
  7. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
  8. 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 215
  9. 2022Defining and Characterizing Reward Hackingcited by 184
  10. 2024The Surprising Effectiveness of Test-Time Training for Few-Shot Learningcited by 88
  11. 2023Test-Time Training on Nearest Neighbors for Large Language Modelscited by 82
  12. 2025Self-Adapting Language Modelscited by 71
7 more
  1. 2020Measuring the Algorithmic Efficiency of Neural Networkscited by 51
  2. 2024Efficiently Learning at Test-Time: Active Fine-Tuning of LLMscited by 42
  3. 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 25
  4. 2015Optimal and Adaptive Algorithms for Online Boostingcited by 12
  5. 2025RTTC: Reward-Guided Collaborative Test-Time Computecited by 4
  6. 2026Rethinking Self-Evolving Agents: Do We Still Need Prescribed Optimization Pipelines?cited by 3
  7. 2026Predicting Acceptance and Review Effort in Human and Agent Pull Requestscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OctoBench: Benchmarking Scaffold-Aware Instruction Following in Repository-Grounded Agentic Coding
  2. 2026When the Specification Emerges: Benchmarking Faithfulness Loss in Long-Horizon Coding Agents
  3. 2026Metan: Recursive Self-Improvement through Emergent Depth
  4. 2026SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Tasks
  5. 2026Teaching Agents to Code Reliably
  6. 2026ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement
  7. 2026Before They Can Solve: Predicting Post-Training Coding-Agent Performance from Base Models
  8. 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine