FreeEvolve: Learning to Evolve Beyond Fixed Loops
On the map: LLM agents and tool use → Reinforcement learning for LLM agents also fits: Agent skill learning and evolution
Abstract (arXiv)
Agent evolvers automate the design of the prompts, skills and workflows around language model agents, yet the optimization process they follow is still designed by hand: a fixed search loop decides how candidates are evaluated, which are kept and when the search stops. We propose FREEEVOLVE, which automates this process as well. An environment specifies the goal, target agent, evaluator, data and resource limits; within these limits, the evolver itself decides what to test, how much evidence to collect, which candidates to pursue and when to stop. These decisions follow an editable evolution skill, which we improve through meta-evolution by scoring each candidate skill on the fresh target agent it produces. The optimization process thus becomes a capability learned from experience rather than a loop engineered in advance. On tau3-bench, ARC-AGI-2, ARC-AGI-3 and Terminal-Bench 2.1, FREEEVOLVE controls the evolution campaign by itself, yet improves the primary held-out metric by 13.6 points on average and matches or exceeds hand-designed evolvers. The learned process keeps improving with experience: meta-evolved skills add 6.9 points over the seed skill on fresh target agents, demonstrating transferability across environments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. First posted on arXiv 6 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DemoEvolve: Overcoming Sparse Feedback in Agentic Harness Evolution with Demonstrations
- 2026MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution
- 2026Learning from Research: Toward Lifelong Agent Harness Evolution
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
- 2026PACE: Two-Timescale Self-Evolution for Small Language Model Agents
- 2026SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization
- 2026PACEvolve++: Improving Test-time Learning for Evolutionary Search Agents
- 2026Evo-Bench: Can Language Models Improve Agent Harness?