mlsanityData to 7 Oct 2026

DarwinX: Evolving Agent Harnesses Through Natural Selection

arXiv 2608.07545 ↗First posted 31 Jul 2026cs.NE cs.AI cs.LGcited by 5

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

An LLM agent's capability depends not only on model weights but on its harness: prompts, tools, skills, and control flow. Self-improvement loops already edit harnesses, yet single-lineage search is path-dependent and local wins often regress other tasks. We introduce DarwinX, which treats self-evolution as selection over a population of harnesses with the model frozen: a preserve-and-extend contract admits only variants that extend coverage without regressing, an archive keeps alternative lineages for recombination, and failure-, teacher-, and self-derived evidence share one edit interface. Fitness comes from each benchmark's own verifier: no gold solutions, no hand-picked winners. Across four benchmarks that progressively separate the evolution signal from the test, one loop adds about 17 points on average: Terminal-Bench 2.1 rises +7.7 to 83.2% on a matched base and to the verified frontier at 84.7% on a stronger one; TerminalWorld's held-out split reaches 68.3%, ahead of every off-the-shelf agent; WebArena-Infinity real-task pass@1 rises from 43.5% to 93.0% audit-clean; and a Terminal-Bench 2.1 harness transfers unchanged to SWE-bench Verified. What evolves is general agent competence, not benchmark-specific patches, so it survives changes of task, verifier, and base model. A frozen model need not be a fixed agent: harness selection turns evaluation compute into durable capability.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 43 of its 59 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

43 of 59 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026The Red Queen G"odel Machine: Co-Evolving Agents and Their Evaluators24 Jun
  2. 2026On Randomness in Agentic Evals6 Feb
  3. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents29 May
  4. 2024Automated Design of Agentic Systems15 Aug
  5. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug

Other references · 37

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  7. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  8. 2023Large Language Models as Optimizerscited by 830
  9. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  10. 2021Deep Reinforcement Learning at the Edge of the Statistical Precipicecited by 781
  11. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  12. 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
25 more
  1. 2022Large Language Models Can Self-Improvecited by 656
  2. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  3. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  4. 2015Illuminating search spaces by mapping elitescited by 406
  5. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  6. 2019Random Search and Reproducibility for Neural Architecture Searchcited by 253
  7. 2024TextGrad: Automatic "Differentiation" via Textcited by 250
  8. 2015Non-stochastic Best Arm Identification and Hyperparameter Optimizationcited by 219
  9. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
  10. 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
  11. 2022Evolution through Large Modelscited by 131
  12. 2024Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluationscited by 130
  13. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
  14. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
  15. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 119
  16. 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systemscited by 96
  17. 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 91
  18. 2019Covariance Matrix Adaptation for the Rapid Illumination of Behavior Spacecited by 78
  19. 2024Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMscited by 62
  20. 2025A Self-Improving Coding Agentcited by 58
  21. 2024Quantifying Variance in Evaluation Benchmarkscited by 52
  22. 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 44
  23. 2026Hyperagentscited by 40
  24. 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 37
  25. 2026TerminalWorld: Benchmarking Agents on Real-World Terminal Taskscited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking the Evaluation of Harness Evolution for Agents
  2. 2026EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
  3. 2026Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
  4. 2026Rethinking Self-Evolving Agents: Do We Still Need Prescribed Optimization Pipelines?
  5. 2026MILO: Automated Harness Discovery via Orchestrated Multi-Agent Evolution
  6. 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnesses
  7. 2026One Recipe, Many Harnesses: What Self-Evolution Encodes Across Languages and Models ↗
  8. 2025Evolution without an Oracle: Driving Effective Evolution with LLM Judges