Harnessing Agentic Evolution
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Agentic evolution has emerged as a powerful paradigm for improving programs, workflows, and scientific solutions by iteratively generating candidates, evaluating them, and using feedback to guide future search. However, existing methods are typically instantiated either as fixed hand-designed procedures that are modular but rigid, or as general-purpose agents that flexibly integrate feedback but can drift in long-horizon evolution. Both forms accumulate rich evidence over time, including candidates, feedback, traces, and failures, yet lack a stable interface for organizing this evidence and revising the mechanism that drives future evolution. We address this limitation by formulating agentic evolution as an interactive environment, where the accumulated evolution context serves as a process-level state. We introduce AEvo, a harnessed meta-editing framework in which a meta-agent observes this state and acts not by directly proposing the next candidate, but by editing the procedure or agent context that controls future evolution. This unified interface enables AEvo to steer both procedure-based and agent-based evolution, making accumulated evidence actionable for long-horizon search. Empirical evaluations on agentic and reasoning benchmarks show that AEvo outperforms five evolution baselines, achieving a 26 relative improvement over the strongest baseline. Across three open-ended optimization tasks, AEvo further outperforms four evolution baselines and achieves state-of-the-art performance under the same iteration budget.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 32 of its 39 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
32 of 39 references.
Closest ancestors · 5
Same direction, newest first
- 2026CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discovery2 Apr
- 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration3 Feb
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents29 May
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems31 Mar
- 2024Automated Design of Agentic Systems15 Aug
Other references · 27
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2016Learning to reinforcement learncited by 377
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2024TextGrad: Automatic "Differentiation" via Textcited by 273
- 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
15 more
- 2026Learning to Discover at Test Timecited by 115
- 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 95
- 2018Evolved Policy Gradientscited by 88
- 2026Hyperagentscited by 56
- 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 53
- 2025Self-Supervised Prompt Optimizationcited by 37
- 2025Alpha-SQL: Zero-Shot Text-to-SQL using Monte Carlo Tree Searchcited by 34
- 2025DeepEye-SQL: A Software-Engineering-Inspired Text-to-SQL Frameworkcited by 28
- 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 21
- 2026Structured Scaling of AI Discovery Across Diverse Scientific Domainscited by 21
- 2025RobustFlow: Towards Robust Agentic Workflow Generationcited by 20
- 2026Learning to Continually Learn via Meta-learning Agentic Memory Designscited by 18
- 2025InteractComp: Evaluating Search Agents With Ambiguous Queriescited by 12
- 2026DeepEye: A Steerable Self-driving Data Agent Systemcited by 8
- 2026ASI-Evolve: AI Accelerates AIcited by 5
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Rethinking the Evaluation of Harness Evolution for Agentscited by 48
- 2026Co-Harness: Co-Evolving Harnesses and Model Weights for LLM Agentscited by 18
- 2026Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineeringcited by 8
- 2026Task-CoEvolve: Efficient Harness Optimization via Adaptive Validation Task Selectioncited by 5
- 2026Scalable Environments Drive Generalizable Agentscited by 2
- 2026ADIAS: Automated Design of Interactive Agentic Systemscited by 1
- 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnessescited by 1
- 2026Latent Action Reparameterization for Efficient Agent Inferencecited by 0
- 2026MemCodex: Self-Programming Hierarchical Memory for Language Agentscited by 0
- 2026MESH-Harness: Self-Improving Agent Harnesses via Bandit-Guided Compositional Evolutioncited by 0
- 2026HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstentioncited by 0
- 2026HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention5 Oct 2026
- 2026MESH-Harness: Self-Improving Agent Harnesses via Bandit-Guided Compositional Evolution4 Oct 2026
- 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnesses2 Oct 2026
- 2026MemCodex: Self-Programming Hierarchical Memory for Language Agents30 Sep 2026
- 2026Task-CoEvolve: Efficient Harness Optimization via Adaptive Validation Task Selection20 Aug 2026
- 2026ADIAS: Automated Design of Interactive Agentic Systems3 Aug 2026
- 2026Frontis-MA1: Training an AI4AI Model towards Recursive Self-Improvement in Machine Learning Engineering30 Jul 2026
- 2026Co-Harness: Co-Evolving Harnesses and Model Weights for LLM Agents17 Jul 2026
- 2026Rethinking the Evaluation of Harness Evolution for Agents14 Jul 2026
- 2026Latent Action Reparameterization for Efficient Agent Inference18 May 2026
- 2026Scalable Environments Drive Generalizable Agents18 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026EvoIn: Bridging Evolution and Internalization for Agent Fine-Tuning
- 2026EvoMaster: A Foundational Evolving Agent Framework for Agentic Science at Scale
- 2026EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
- 2026ScienceClaw: Benchmarking Continual Self-Evolution of AI-for-Science Agents Across the Natural and Social Sciences
- 2026CliffSearch: Structured Agentic Co-Evolution over Theory and Code for Scientific Algorithm Discovery
- 2026FreeEvolve: Learning to Evolve Beyond Fixed Loops
- 2026EVOM: Agentic Meta-Evolution of Actor-Critic Architectures for Reinforcement Learning
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design