mlsanityData to 7 Oct 2026

Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems

arXiv 2605.14892 ↗First posted 14 May 2026cs.AIcited by 5

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

LLM-based autonomous agents have demonstrated strong capabilities in reasoning, planning, and tool use, yet remain limited when tasks require sustained coordination across roles, tools, and environments. Multi-agent systems address this through structured collaboration among specialized agents, but tighter coordination also amplifies a less explored risk: errors can propagate across agents and interaction rounds, producing failures that are difficult to diagnose and rarely translate into structural self-improvement. Existing surveys cover individual agent capabilities, multi-agent collaboration, or agent self-evolution separately, leaving the causal dependencies among them unexamined. This survey provides a unified review organized around four causally linked stages, which we term the LIFE progression: Lay the capability foundation, Integrate agents through collaboration, Find faults through attribution, and Evolve through autonomous self-improvement. For each stage, we provide systematic taxonomies and formally characterize the dependencies between adjacent stages, revealing how each stage both depends on and constrains the next. Beyond synthesizing existing work, we identify open challenges at stage boundaries and propose a cross-stage research agenda for closed-loop multi-agent systems capable of continuously diagnosing failures, reorganizing structures, and refining agent behaviors, extending current coordination frameworks toward more self-organizing forms of collective intelligence. By bridging these previously fragmented research threads, this survey aims to offer both a systematic reference and a conceptual roadmap toward autonomous, self-improving multi-agent intelligence.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 149 of its 423 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

149 of 423 references.

Closest ancestors · 53

Same direction, newest first

  1. 2026MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing6 Mar
  2. 2026HieraMAS: Optimizing Intra-Node LLM Mixtures and Inter-Node Topology for Multi-Agent Systems23 Feb
  3. 2026AdaptOrch: Task-Adaptive Multi-Agent Orchestration in the Era of LLM Performance Convergence18 Feb
  4. 2026TodyComm: Task-Oriented Dynamic Communication for Multi-Round LLM-based Multi-Agent System3 Feb
  5. 2026Epistemic Context Learning: Building Trust the Right Way in LLM-Based Multi-Agent Systems29 Jan
  6. 2026ALIGN: Aligned Delegation with Performance Guarantees for Multi-Agent LLM Reasoning28 Jan
  7. 2026A Lightweight Modular Framework for Constructing Autonomous Agents Driven by Large Language Models: Design, Implementation, and Applications in AgentForge19 Jan
  8. 2026Towards AGI A Pragmatic Approach Towards Self Evolving Agent15 Jan
  9. 2026ResMAS: Resilience Optimization in LLM-based Multi-agent Systems8 Jan
  10. 2025Towards a Science of Scaling Agent Systems9 Dec
  11. 2025Latent Collaboration in Multi-Agent Systems25 Nov
  12. 2025Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstruction16 Oct
38 more
  1. 2025CoMAS: Co-Evolving Multi-Agent Systems via Interaction Rewards9 Oct
  2. 2025AgentAsk: Multi-Agent Systems Need to Ask8 Oct
  3. 2025Stochastic Self-Organization in Multi-Agent Systems1 Oct
  4. 2025Symphony: A Decentralized Multi-Agent Framework for Scalable Collective Intelligence27 Aug
  5. 2025Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Tasks18 Aug
  6. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
  7. 2025RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory6 Aug
  8. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul
  9. 2025Optimizing Sequential Multi-Step Tasks with Parallel LLM Agents11 Jul
  10. 2025AgentGroupChat-V2: Divide-and-Conquer Is What LLM-Based Multi-Agent System Need18 Jun
  11. 2025AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocol14 Jun
  12. 2025Self-Evolving Multi-Agent Systems via Textual Backpropagation10 Jun
  13. 2025Learn as Individuals, Evolve as a Team: Multi-agent LLMs Adaptation in Embodied Environments8 Jun
  14. 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMs22 May
  15. 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervision21 May
  16. 2025Self-Resource Allocation in Multi-Agent LLM Systems2 Apr
  17. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems31 Mar
  18. 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks12 Mar
  19. 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systems5 Mar
  20. 2025REALM-Bench: A Benchmark for Evaluating Multi-Agent Systems on Real-world, Dynamic Planning and Scheduling Tasks26 Feb
  21. 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systems20 Feb
  22. 2025Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems16 Feb
  23. 2025Closed-Loop Vision-Language Planning for Multi-Agent Coordination14 Feb
  24. 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
  25. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
  26. 2025AgentBreeder: Mitigating the AI Safety Risks of Multi-Agent Scaffolds via Self-Improvement2 Feb
  27. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMs10 Jan
  28. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks18 Dec
  29. 2024Towards Effective GenAI Multi-Agent Collaboration: Design and Evaluation for Enterprise Applications6 Dec
  30. 2024LLM-based Multi-Agent Systems: Techniques and Business Perspectives21 Nov
  31. 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments4 Nov
  32. 2024MorphAgent: Empowering Agents through Self-Evolving Profiles and Decentralized Collaboration19 Oct
  33. 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks15 Oct
  34. 2024BattleAgentBench: A Benchmark for Evaluating Cooperation and Competition Capabilities of Language Models in Multi-Agent Systems28 Aug
  35. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  36. 2024KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents5 Mar
  37. 2024LLM Multi-Agent Systems: Challenges and Open Problems5 Feb
  38. 2024Understanding the planning of LLM agents: A survey5 Feb

50 newest of 53 All 53 (JSON)

Other references · 96

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  8. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  9. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  10. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  11. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  12. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
38 more
  1. 2023Reasoning with Language Model is Planning with World Modelcited by 846
  2. 2024DeepSeek-V3 Technical Reportcited by 724
  3. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  4. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  5. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  6. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
  7. 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
  8. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
  9. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 406
  10. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  11. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
  12. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
  13. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 247
  14. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 215
  15. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 210
  16. 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 209
  17. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
  18. 2023Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedbackcited by 202
  19. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
  20. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 182
  21. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
  22. 2024Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Modelscited by 156
  23. 2023Chain of Code: Reasoning with a Language Model-Augmented Code Emulatorcited by 120
  24. 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 119
  25. 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 118
  26. 2025Where LLM Agents Fail and How They can Learn From Failurescited by 118
  27. 2024CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmarkcited by 115
  28. 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 113
  29. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
  30. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
  31. 2025A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)cited by 98
  32. 2025TRAIL: Trace Reasoning and Agentic Issue Localizationcited by 98
  33. 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 94
  34. 2025Reinforcement Learning for Self-Improving Agent with Skill Librarycited by 91
  35. 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 81
  36. 2024Self-Evolving Multi-Agent Collaboration Networks for Software Developmentcited by 73
  37. 2025Self-Adapting Language Modelscited by 71
  38. 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolutioncited by 58

50 most cited of 96 All 96 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structures
  2. 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems
  3. 2026Towards a Science of Collective AI: LLM-based Multi-Agent Systems Need a Transition from Blind Trial-and-Error to Rigorous Science
  4. 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
  5. 2026From Task Solving to Robust Real-World Adaptation in LLM Agents
  6. 2025Risk Analysis Techniques for Governed LLM-based Multi-Agent Systems
  7. 2026CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments
  8. 2026TRACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agents