mlsanityData to 7 Oct 2026

Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems

arXiv 2605.29790 ↗First posted 28 May 2026cs.MA cs.AIcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

LLM-based multi-agent systems (MAS) have emerged as an effective paradigm for complex and long-horizon tasks. However, in real-world tasks, MAS often exhibit various failures during execution and such failures are difficult to eliminate during design. This motivates experience-driven MAS evolution, where a system improves based on its own execution experience. Yet such evolution is challenging because MAS experience is prolonged and intricate, interleaving multiple agents' execution chains and communication messages, which makes it difficult to identify what should be improved. To address this challenge, we propose Meta-Team, an experience-driven MAS evolution framework based on collaborative self-evolution. Meta-Team preserves the execution context of each agent and coordinates post-task communication, enabling agents to exchange distributed evidence for evolution. Building on this design, Meta-Team conducts multi-scale self-evolution, transforming execution experience into reusable improvements to agent behaviors, inter-agent coordination, and team-level organization. Across six long-horizon agent benchmarks, Meta-Team consistently outperforms single-agent systems, hand-crafted MAS, and prior MAS evolution methods; further analyses demonstrate that Meta-Team enables more reliable and scalable MAS self-evolution.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 68 of its 85 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

68 of 85 references.

Closest ancestors · 27

Same direction, newest first

  1. 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks13 Apr
  2. 2026Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgets2 Apr
  3. 2026GoAgent: Group-of-Agents Communication Topology Generation for LLM-based Multi-Agent Systems20 Mar
  4. 2026LOCA-bench: Benchmarking Language Agents Under Controllable and Extreme Context Growth8 Feb
  5. 2026EvoMAS: Evolutionary Generation of Multi-Agent Systems6 Feb
  6. 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration3 Feb
  7. 2026Multi-Agent Teams Hold Experts Back1 Feb
  8. 2026AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts16 Jan
  9. 2025AgentAsk: Multi-Agent Systems Need to Ask8 Oct
  10. 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agents4 Aug
  11. 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation24 Jul
  12. 2025United Minds or Isolated Agents? Exploring Coordination of LLMs under Cognitive Load Theory7 Jun
15 more
  1. 2025AgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical Search6 Jun
  2. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
  3. 2025Cross-Task Experiential Learning on LLM-based Multi-Agent Collaboration29 May
  4. 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems1 Apr
  5. 2025MasRouter: Learning to Route LLMs for Multi-Agent Systems16 Feb
  6. 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
  7. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
  8. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks7 Nov
  9. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Space8 Oct
  10. 2024Automated Design of Agentic Systems15 Aug
  11. 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks4 Jun
  12. 2024Adaptive In-conversation Team Building for Language Model Agents29 May
  13. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
  14. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  15. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 41

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2021Program Synthesis with Large Language Modelscited by 3,509
  8. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  9. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  10. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  11. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  12. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
29 more
  1. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  2. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  3. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  4. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  5. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  6. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  7. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  8. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  9. 2016Solving General Arithmetic Word Problemscited by 353
  10. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
  11. 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systemscited by 170
  12. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
  13. 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agentscited by 80
  14. 2024Why Does the Effective Context Length of LLMs Fall Short?cited by 60
  15. 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 56
  16. 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimizationcited by 50
  17. 2024Prompt Optimization with EASE? Efficient Ordering-aware Automated Selection of Exemplarscited by 37
  18. 2025Where Did It All Go Wrong? A Hierarchical Look into Multi-Agent Error Attributioncited by 25
  19. 2026ReCreate: Reasoning and Creating Domain Agents Driven by Experiencecited by 22
  20. 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systemscited by 22
  21. 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluationcited by 21
  22. 2026BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?cited by 20
  23. 2025Aegis: Automated Error Generation and Attribution for Multi-Agent Systemscited by 19
  24. 2024LLM×MapReduce: Simplified Long-Sequence Processing using Large Language Modelscited by 17
  25. 2025LoCoBench: A Benchmark for Long-Context Large Language Models in Complex Software Engineeringcited by 11
  26. 2025When Does Divide and Conquer Work for Long Context LLM? A Noise Decomposition Frameworkcited by 8
  27. 2026Workflow-R1: Group Sub-sequence Policy Optimization for Multi-turn Workflow Constructioncited by 7
  28. 2025Scoring, Reasoning, and Selecting the Best! Ensembling Large Language Models via a Peer-Review Processcited by 4
  29. 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systemscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
  2. 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
  3. 2025Learn as Individuals, Evolve as a Team: Multi-agent LLMs Adaptation in Embodied Environments
  4. 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design
  5. 2024MorphAgent: Empowering Agents through Self-Evolving Profiles and Decentralized Collaboration
  6. 2026Skill-MAS: Evolving Meta-Skill for Automatic Multi-Agent Systems
  7. 2026MAS-on-the-Fly: In-Context Structural Adaptation of LLM-Based Multi-Agent Systems
  8. 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems