Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
LLM-based multi-agent systems (MAS) have emerged as an effective paradigm for complex and long-horizon tasks. However, in real-world tasks, MAS often exhibit various failures during execution and such failures are difficult to eliminate during design. This motivates experience-driven MAS evolution, where a system improves based on its own execution experience. Yet such evolution is challenging because MAS experience is prolonged and intricate, interleaving multiple agents' execution chains and communication messages, which makes it difficult to identify what should be improved. To address this challenge, we propose Meta-Team, an experience-driven MAS evolution framework based on collaborative self-evolution. Meta-Team preserves the execution context of each agent and coordinates post-task communication, enabling agents to exchange distributed evidence for evolution. Building on this design, Meta-Team conducts multi-scale self-evolution, transforming execution experience into reusable improvements to agent behaviors, inter-agent coordination, and team-level organization. Across six long-horizon agent benchmarks, Meta-Team consistently outperforms single-agent systems, hand-crafted MAS, and prior MAS evolution methods; further analyses demonstrate that Meta-Team enables more reliable and scalable MAS self-evolution.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 68 of its 85 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
68 of 85 references.
Closest ancestors · 27
Same direction, newest first
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks13 Apr
- 2026Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgets2 Apr
- 2026GoAgent: Group-of-Agents Communication Topology Generation for LLM-based Multi-Agent Systems20 Mar
- 2026LOCA-bench: Benchmarking Language Agents Under Controllable and Extreme Context Growth8 Feb
- 2026EvoMAS: Evolutionary Generation of Multi-Agent Systems6 Feb
- 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration3 Feb
- 2026Multi-Agent Teams Hold Experts Back1 Feb
- 2026AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts16 Jan
- 2025AgentAsk: Multi-Agent Systems Need to Ask8 Oct
- 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agents4 Aug
- 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation24 Jul
- 2025United Minds or Isolated Agents? Exploring Coordination of LLMs under Cognitive Load Theory7 Jun
15 more
- 2025AgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical Search6 Jun
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
- 2025Cross-Task Experiential Learning on LLM-based Multi-Agent Collaboration29 May
- 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems1 Apr
- 2025MasRouter: Learning to Route LLMs for Multi-Agent Systems16 Feb
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks7 Nov
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Space8 Oct
- 2024Automated Design of Agentic Systems15 Aug
- 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks4 Jun
- 2024Adaptive In-conversation Team Building for Language Model Agents29 May
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 41
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
29 more
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2024AFlow: Automating Agentic Workflow Generationcited by 395
- 2016Solving General Arithmetic Word Problemscited by 353
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systemscited by 170
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
- 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agentscited by 80
- 2024Why Does the Effective Context Length of LLMs Fall Short?cited by 60
- 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 56
- 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimizationcited by 50
- 2024Prompt Optimization with EASE? Efficient Ordering-aware Automated Selection of Exemplarscited by 37
- 2025Where Did It All Go Wrong? A Hierarchical Look into Multi-Agent Error Attributioncited by 25
- 2026ReCreate: Reasoning and Creating Domain Agents Driven by Experiencecited by 22
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systemscited by 22
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluationcited by 21
- 2026BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?cited by 20
- 2025Aegis: Automated Error Generation and Attribution for Multi-Agent Systemscited by 19
- 2024LLM×MapReduce: Simplified Long-Sequence Processing using Large Language Modelscited by 17
- 2025LoCoBench: A Benchmark for Long-Context Large Language Models in Complex Software Engineeringcited by 11
- 2025When Does Divide and Conquer Work for Long Context LLM? A Noise Decomposition Frameworkcited by 8
- 2026Workflow-R1: Group Sub-sequence Policy Optimization for Multi-turn Workflow Constructioncited by 7
- 2025Scoring, Reasoning, and Selecting the Best! Ensembling Large Language Models via a Peer-Review Processcited by 4
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systemscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
- 2025Learn as Individuals, Evolve as a Team: Multi-agent LLMs Adaptation in Embodied Environments
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design
- 2024MorphAgent: Empowering Agents through Self-Evolving Profiles and Decentralized Collaboration
- 2026Skill-MAS: Evolving Meta-Skill for Automatic Multi-Agent Systems
- 2026MAS-on-the-Fly: In-Context Structural Adaptation of LLM-Based Multi-Agent Systems
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems