Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Agentic systems are increasingly expected to improve after deployment, yet single-entity self-evolution is often bounded by a static learning context, such as fixed tasks and feedback. This survey focuses on co-evolution in agentic systems, a multi-component form of self-evolution in which multiple agents and their environment impose adaptive pressure on one another. To organize existing papers, we propose a progressive three-stage taxonomy that traces how the system gradually sheds human-engineered constraints. Agent--Agent Co-Evolution studies how agents adapt through dynamic peers, including adversarial, collaborative, and organizational adaptation. Agent--Environment Co-Evolution extends this loop to adaptive tasks, feedback, and interaction spaces that change with the agents. Meta Co-Evolution further explores the possibility of making the evolution mechanism itself evolvable. We also discuss open challenges in evaluating such systems, scaling them across multiple components, and keeping increasingly autonomous evolutionary processes safe and controllable. This survey provides a unified foundation for building robust and open-ended agentic systems that can improve beyond fixed human-designed paths.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 135 of its 171 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
135 of 171 references.
Closest ancestors · 27
Same direction, newest first
- 2026Self-Improvements in Modern Agentic Systems: A Survey14 Jul
- 2026The Red Queen G"odel Machine: Co-Evolving Agents and Their Evaluators24 Jun
- 2026Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution9 Jun
- 2026AdaPlanBench: Evaluating Adaptive Planning in Large Language Model Agents under World and User Constraints4 Jun
- 2026CoMAP: Co-Evolving World Models and Agent Policies for LLM Agents1 Jun
- 2026SEAL: Synergistic Co-Evolution of Agents and Learning Environments23 May
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr
- 2026CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discovery2 Apr
- 2026PostTrainBench: Can LLM Agents Automate LLM Post-Training?9 Mar
- 2026SEAD: Self-Evolving Agent for Multi-Turn Service Dialogue3 Feb
- 2026EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience22 Jan
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulators22 Dec
15 more
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning20 Nov
- 2025Environment Scaling for Interactive Agentic Experience Collection: A Survey12 Nov
- 2025CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agents4 Nov
- 2025AgentFrontier: Expanding the Capability Frontier of LLM Agents with ZPD-Guided Data Synthesis28 Oct
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle17 Oct
- 2025CoMAS: Co-Evolving Multi-Agent Systems via Interaction Rewards9 Oct
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
- 2025SEAgent: Self-Evolving Computer Use Agent with Autonomous Learning from Experience6 Aug
- 2025Learn as Individuals, Evolve as a Team: Multi-agent LLMs Adaptation in Embodied Environments8 Jun
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents3 Mar
- 2025EvolvingAgent: Curriculum Self-evolving Agent with Continual World Model for Long-Horizon Tasks9 Feb
- 2025SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning7 Feb
- 2024AgentSense: Benchmarking Social Intelligence of Language Agents through Interactive Scenarios25 Oct
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents18 Oct
Other references · 108
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Generative Adversarial Networkscited by 5,603
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2017Counterfactual Multi-Agent Policy Gradientscited by 733
- 2019Solving Rubik's Cube with a Robot Handcited by 699
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
38 more
- 2017Robust Adversarial Reinforcement Learningcited by 439
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
- 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 308
- 2021PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-trainingcited by 298
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 272
- 2020Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Designcited by 260
- 2017Automatic Goal Generation for Reinforcement Learning Agentscited by 252
- 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 243
- 2018Mean Field Multi-Agent Reinforcement Learningcited by 202
- 2017Teacher-Student Curriculum Learningcited by 197
- 2020Prioritized Level Replaycited by 190
- 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
- 2021Open-Ended Learning Leads to Generally Capable Agentscited by 177
- 2022Evolving Curricula with Regret-Based Environment Designcited by 166
- 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 146
- 2017Emergent Complexity via Multi-Agent Competitioncited by 117
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
- 2019Teacher algorithms for curriculum learning of Deep RL in continuously parameterized environmentscited by 113
- 2021Replay-Guided Adversarial Environment Designcited by 108
- 2025SWE-Lancer: Can Frontier LLMs Earn 1 Million from Real-World Freelance Software Engineering?cited by 99
- 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 81
- 2024Self-playing Adversarial Language Game Enhances LLM Reasoningcited by 80
- 2025MAPoRL: Multi-Agent Post-Co-Training for Collaborative Large Language Models with Reinforcement Learningcited by 80
- 2024Open-Endedness is Essential for Artificial Superhuman Intelligencecited by 79
- 2020The AI Economist: Improving Equality and Productivity with AI-Driven Tax Policiescited by 75
- 2021Asymmetric self-play for automatic goal discovery in robotic manipulationcited by 71
- 2024OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Codecited by 67
- 2020Learning to Incentivize Other Learning Agentscited by 55
- 2025MARFT: Multi-Agent Reinforcement Fine-Tuningcited by 51
- 2020Self-Paced Deep Reinforcement Learningcited by 49
- 2018Learning to Teach in Cooperative Multiagent Reinforcement Learningcited by 45
- 2026Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflowscited by 44
- 2024EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agentscited by 41
- 2026EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discoverycited by 41
- 2025Scaling Agent Learning via Experience Synthesiscited by 40
- 2025RL Tango: Reinforcing Generator and Verifier Together for Language Reasoningcited by 39
- 2026Dr. Zero: Self-Evolving Search Agents without Training Datacited by 39
- 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Modelcited by 39
50 most cited of 108 All 108 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
- 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems
- 2026EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
- 2026SkillSmith: Co-Evolving Skills and Tools for Self-Improving Agent Systems
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems