Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine
On the map: LLM agents and tool use → Software engineering coding agents
also in 1 more
Abstract (arXiv)
Recent studies operationalize self-improvement through coding agents that edit their own codebases. They grow a tree of self-modifications through expansion strategies that favor higher software engineering benchmark performance, assuming that this implies more promising subsequent self-modifications. However, we identify a mismatch between the agent's self-improvement potential (metaproductivity) and its coding benchmark performance, namely the Metaproductivity-Performance Mismatch. Inspired by Huxley's concept of clade, we propose a metric (CMP) that aggregates the benchmark performances of the descendants of an agent as an indicator of its potential for self-improvement. We show that, in our self-improving coding agent development setting, access to the true CMP is sufficient to simulate how the G"odel Machine would behave under certain assumptions. We introduce the Huxley-G"odel Machine (HGM), which, by estimating CMP and using it as guidance, searches the tree of self-modifications. On SWE-bench Verified and Polyglot, HGM outperforms prior self-improving coding agent development methods while using fewer allocated CPU hours. Last but not least, HGM demonstrates strong transfer to other coding datasets and large language models. The agent optimized by HGM on SWE-bench Verified with GPT-5-mini and evaluated on SWE-bench Lite with GPT-5 achieves human-level performance, matching the best officially checked results of human-engineered coding agents. Our code is publicly available at https://github.com/metauto-ai/HGM.
Key facts. Cited by 47 papers in the map (data through 13 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 48 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
18 of 48 references.
Closest ancestors · 4
Same direction, newest first
- 2025A Self-Improving Coding Agent21 Apr
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
- 2023ChatDev: Communicative Agents for Software Development16 Jul
Other references · 14
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,274
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,777
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 315
- 2024AutoCodeRover: Autonomous Program Improvementcited by 274
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 134
- 2025SWE-bench Goes Live!cited by 77
- 2022Discovering Evolution Strategies via Meta-Black-Box Optimizationcited by 44
- 2015Simple regret for infinitely many armed banditscited by 39
- 2024G"odel Agent: A Self-Referential Agent Framework for Recursive Self-Improvementcited by 29
- 2017Monte-Carlo Tree Search by Best Arm Identificationcited by 13
- 2021Training Learned Optimizers with Randomly Initialized Learned Optimizerscited by 13
- 2022Eliminating Meta Optimization Through Self-Referential Meta Learningcited by 12
2 more
- 2016Self-Modification of Policy and Utility Function in Rational Agentscited by 11
- 2013Bounded Recursive Self-Improvementcited by 10
Built on by
Citing papers per year: 2025: 8; 2026: 39.
47 papers.
Sort:
By area:
- 2025Memory in the Age of AI Agentscited by 291
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 93
- 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 84
- 2025SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarioscited by 53
- 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RLcited by 37
- 2026From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flawscited by 26
- 2025AutoEnv: Automated Environments for Measuring Cross-Environment Agent Learningcited by 19
- 2026The Red Queen G"odel Machine: Co-Evolving Agents and Their Evaluatorscited by 16
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 14
- 2026Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearchcited by 12
- 2026Harnessing Agentic Evolutioncited by 11
- 2026Training AI Scientists to Replicate Researchcited by 9
35 more
- 2026DarwinX: Evolving Agent Harnesses Through Natural Selectioncited by 7
- 2026AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Designcited by 7
- 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environmentscited by 7
- 2025Agentic Software Issue Resolution with Large Language Models: A Surveycited by 6
- 2026Hierarchical Self-Improvement: A Framework for Task-Specific Evolvable Agent Harnessescited by 6
- 2026SE-Bench: Benchmarking Self-Evolution with Knowledge Internalizationcited by 5
- 2026DemoEvolve: Overcoming Sparse Feedback in Agentic Harness Evolution with Demonstrationscited by 5
- 2026RRSI: Regularized Recursive Self-Improvement of Agent Harnessescited by 5
- 2026Recursive self-improvement of AI research agentscited by 5
- 2026EvoFSM: Controllable Self-Evolution for Deep Research with Finite State Machinescited by 4
- 2026AutoLLMResearch: Training Research Agents for Automating LLM Experiment Configuration - Learning from Cheap, Optimizing Expensivecited by 4
- 2026On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecificationcited by 3
- 2026Beyond the Node: Clade-level Selection for Efficient MCTS in Automatic Heuristic Designcited by 2
- 2026Pioneer Agent: Continual Improvement of Small Language Models in Productioncited by 2
- 2026Evolving Ensemble of Agentscited by 2
- 2026Self-Evolving Coding Agentscited by 2
- 2026Accelerating Scientific Research with Gemini in the Real-Worldcited by 2
- 2026Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agentscited by 2
- 2025irace-evo: Automatic Algorithm Configuration Extended With LLM-Based Code Evolutioncited by 1
- 2026Beyond Fixed Representations: The Vocabulary and Verifier Gaps in Open-Ended AIcited by 1
- 2026ADIAS: Automated Design of Interactive Agentic Systemscited by 1
- 2026A Theory of Reliable Self-Evolution for Agent Harnessescited by 1
- 2026Self Improvement via Fast Tree-searchcited by 1
- 2026Search over Self-Edit Strategies for LLM Adaptationcited by 0
- 2026CyberEvolver: Structured Self-Evolution for Cybersecurity Agents On the Flycited by 0
- 2026Post-training is (Massive) Supervised Learningcited by 0
- 2026Knowledge-Centric Self-Improvementcited by 0
- 2026SBCO: Self-Supervised, Verifier-Grounded Harness Optimization For Planning Agentscited by 0
- 2026Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarkscited by 0
- 2026Certified Long-Horizon Code Agent Evolution via Validation-Gated Skill Optimizationcited by 0
- 2026Which Self-Improvements Should We Trust? Reliable Self-Improvement When Agents Reuse Their Benchmarkscited by 0
- 2026G"odel Forest: Balancing Search Depth and Breadth for Data-Centric Recursive Self-Improvementcited by 0
- 2026SelfSearch: Reward-Free Search for Self-Improving Agentscited by 0
- 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimizationcited by 0
- 2026The Winner's Curse in LLM Self-Improvement Loops: Selection Noise, Lock-in, and Acceptance Rulescited by 0
- 2026The Winner's Curse in LLM Self-Improvement Loops: Selection Noise, Lock-in, and Acceptance Rules7 Oct 2026
- 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimization1 Oct 2026
- 2026SelfSearch: Reward-Free Search for Self-Improving Agents29 Sep 2026
- 2026G"odel Forest: Balancing Search Depth and Breadth for Data-Centric Recursive Self-Improvement29 Sep 2026
- 2026Which Self-Improvements Should We Trust? Reliable Self-Improvement When Agents Reuse Their Benchmarks27 Sep 2026
- 2026Certified Long-Horizon Code Agent Evolution via Validation-Gated Skill Optimization26 Sep 2026
- 2026Recursive self-improvement of AI research agents22 Sep 2026
- 2026RRSI: Regularized Recursive Self-Improvement of Agent Harnesses21 Sep 2026
- 2026Self Improvement via Fast Tree-search17 Sep 2026
- 2026Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarks15 Sep 2026
- 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments14 Sep 2026
- 2026Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agents10 Sep 2026
35 more
- 2026A Theory of Reliable Self-Evolution for Agent Harnesses8 Sep 2026
- 2026Accelerating Scientific Research with Gemini in the Real-World27 Aug 2026
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces24 Aug 2026
- 2026On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecification18 Aug 2026
- 2026AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design13 Aug 2026
- 2026Training AI Scientists to Replicate Research13 Aug 2026
- 2026SBCO: Self-Supervised, Verifier-Grounded Harness Optimization For Planning Agents10 Aug 2026
- 2026Hierarchical Self-Improvement: A Framework for Task-Specific Evolvable Agent Harnesses9 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
- 2026ADIAS: Automated Design of Interactive Agentic Systems3 Aug 2026
- 2026DarwinX: Evolving Agent Harnesses Through Natural Selection31 Jul 2026
- 2026Knowledge-Centric Self-Improvement21 Jul 2026
- 2026Beyond Fixed Representations: The Vocabulary and Verifier Gaps in Open-Ended AI10 Jul 2026
- 2026The Red Queen G"odel Machine: Co-Evolving Agents and Their Evaluators24 Jun 2026
- 2026From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flaws4 Jun 2026
- 2026CyberEvolver: Structured Self-Evolution for Cybersecurity Agents On the Fly25 May 2026
- 2026DemoEvolve: Overcoming Sparse Feedback in Agentic Harness Evolution with Demonstrations23 May 2026
- 2026Harnessing Agentic Evolution13 May 2026
- 2026AutoLLMResearch: Training Research Agents for Automating LLM Experiment Configuration - Learning from Cheap, Optimizing Expensive12 May 2026
- 2026Evolving Ensemble of Agents9 May 2026
- 2026Post-training is (Massive) Supervised Learning20 Apr 2026
- 2026Pioneer Agent: Continual Improvement of Small Language Models in Production10 Apr 2026
- 2026Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearch25 Mar 2026
- 2026SE-Bench: Benchmarking Self-Evolution with Knowledge Internalization4 Feb 2026
- 2026Beyond the Node: Clade-level Selection for Efficient MCTS in Automatic Heuristic Design31 Jan 2026
- 2026Search over Self-Edit Strategies for LLM Adaptation20 Jan 2026
- 2026EvoFSM: Controllable Self-Evolution for Deep Research with Finite State Machines14 Jan 2026
- 2025Agentic Software Issue Resolution with Large Language Models: A Survey24 Dec 2025
- 2025MemEvolve: Meta-Evolution of Agent Memory Systems21 Dec 2025
- 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RL21 Dec 2025
- 2025SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios20 Dec 2025
- 2025Memory in the Age of AI Agents15 Dec 2025
- 2025AutoEnv: Automated Environments for Measuring Cross-Environment Agent Learning24 Nov 2025
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov 2025
- 2025irace-evo: Automatic Algorithm Configuration Extended With LLM-Based Code Evolution15 Nov 2025
- 2025Memory in the Age of AI Agentscited by 291
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 93
- 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 84
- 2025SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarioscited by 53
- 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RLcited by 37
- 2026From Failed Trajectories to Reliable LLM Agents: Diagnosing and Repairing Harness Flawscited by 26
- 2025AutoEnv: Automated Environments for Measuring Cross-Environment Agent Learningcited by 19
- 2026The Red Queen G"odel Machine: Co-Evolving Agents and Their Evaluatorscited by 16
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 14
- 2026Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearchcited by 12
- 2026Harnessing Agentic Evolutioncited by 11
- 2026DarwinX: Evolving Agent Harnesses Through Natural Selectioncited by 7
12 most cited of 31 All 31 (JSON)
- 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimization1 Oct 2026
- 2026SelfSearch: Reward-Free Search for Self-Improving Agents29 Sep 2026
- 2026Certified Long-Horizon Code Agent Evolution via Validation-Gated Skill Optimization26 Sep 2026
- 2026Recursive self-improvement of AI research agents22 Sep 2026
- 2026RRSI: Regularized Recursive Self-Improvement of Agent Harnesses21 Sep 2026
- 2026Self Improvement via Fast Tree-search17 Sep 2026
- 2026Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarks15 Sep 2026
- 2026Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM Agents10 Sep 2026
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces24 Aug 2026
- 2026AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design13 Aug 2026
- 2026Hierarchical Self-Improvement: A Framework for Task-Specific Evolvable Agent Harnesses9 Aug 2026
- 2026Self-Evolving Coding Agents4 Aug 2026
12 newest of 31 All 31 (JSON)
- 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environmentscited by 7
- 2026On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecificationcited by 3
- 2026Knowledge-Centric Self-Improvementcited by 0
- 2026SBCO: Self-Supervised, Verifier-Grounded Harness Optimization For Planning Agentscited by 0
- 2026The Winner's Curse in LLM Self-Improvement Loops: Selection Noise, Lock-in, and Acceptance Rulescited by 0
- 2026The Winner's Curse in LLM Self-Improvement Loops: Selection Noise, Lock-in, and Acceptance Rules7 Oct 2026
- 2026RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments14 Sep 2026
- 2026On the Fragility of Self-Improving Agents: Variance, Task Order, and Underspecification18 Aug 2026
- 2026SBCO: Self-Supervised, Verifier-Grounded Harness Optimization For Planning Agents10 Aug 2026
- 2026Knowledge-Centric Self-Improvement21 Jul 2026
- 2026Training AI Scientists to Replicate Researchcited by 9
- 2026SE-Bench: Benchmarking Self-Evolution with Knowledge Internalizationcited by 5
- 2026Beyond the Node: Clade-level Selection for Efficient MCTS in Automatic Heuristic Designcited by 2
- 2026Accelerating Scientific Research with Gemini in the Real-Worldcited by 2
- 2025irace-evo: Automatic Algorithm Configuration Extended With LLM-Based Code Evolutioncited by 1
- 2026Beyond Fixed Representations: The Vocabulary and Verifier Gaps in Open-Ended AIcited by 1
- 2026A Theory of Reliable Self-Evolution for Agent Harnessescited by 1
- 2026Search over Self-Edit Strategies for LLM Adaptationcited by 0
- 2026Post-training is (Massive) Supervised Learningcited by 0
- 2026Which Self-Improvements Should We Trust? Reliable Self-Improvement When Agents Reuse Their Benchmarkscited by 0
- 2026G"odel Forest: Balancing Search Depth and Breadth for Data-Centric Recursive Self-Improvementcited by 0
- 2026G"odel Forest: Balancing Search Depth and Breadth for Data-Centric Recursive Self-Improvement29 Sep 2026
- 2026Which Self-Improvements Should We Trust? Reliable Self-Improvement When Agents Reuse Their Benchmarks27 Sep 2026
- 2026A Theory of Reliable Self-Evolution for Agent Harnesses8 Sep 2026
- 2026Accelerating Scientific Research with Gemini in the Real-World27 Aug 2026
- 2026Training AI Scientists to Replicate Research13 Aug 2026
- 2026Beyond Fixed Representations: The Vocabulary and Verifier Gaps in Open-Ended AI10 Jul 2026
- 2026Post-training is (Massive) Supervised Learning20 Apr 2026
- 2026SE-Bench: Benchmarking Self-Evolution with Knowledge Internalization4 Feb 2026
- 2026Beyond the Node: Clade-level Selection for Efficient MCTS in Automatic Heuristic Design31 Jan 2026
- 2026Search over Self-Edit Strategies for LLM Adaptation20 Jan 2026
- 2025irace-evo: Automatic Algorithm Configuration Extended With LLM-Based Code Evolution15 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Mendel G"odel Machine: Recursive Self-Improving Coding Agents via Comparative Evolution
- 2026One Recipe, Many Harnesses: What Self-Evolution Encodes Across Languages and Models ↗
- 2026Metan: Recursive Self-Improvement through Emergent Depth
- 2026SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Tasks
- 2026ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement
- 2026EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions
- 2026Coding Agents Have Converged: Why the SWE-bench Leaderboard Can No Longer Order Its Top Entries, and What to Measure Instead
- 2026Audit the Scaffold, Not the Checkpoint: A Stationarity Dichotomy for Recursive Self-Improvement in Agentic Coding