Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
LLM-based autonomous agents have demonstrated strong capabilities in reasoning, planning, and tool use, yet remain limited when tasks require sustained coordination across roles, tools, and environments. Multi-agent systems address this through structured collaboration among specialized agents, but tighter coordination also amplifies a less explored risk: errors can propagate across agents and interaction rounds, producing failures that are difficult to diagnose and rarely translate into structural self-improvement. Existing surveys cover individual agent capabilities, multi-agent collaboration, or agent self-evolution separately, leaving the causal dependencies among them unexamined. This survey provides a unified review organized around four causally linked stages, which we term the LIFE progression: Lay the capability foundation, Integrate agents through collaboration, Find faults through attribution, and Evolve through autonomous self-improvement. For each stage, we provide systematic taxonomies and formally characterize the dependencies between adjacent stages, revealing how each stage both depends on and constrains the next. Beyond synthesizing existing work, we identify open challenges at stage boundaries and propose a cross-stage research agenda for closed-loop multi-agent systems capable of continuously diagnosing failures, reorganizing structures, and refining agent behaviors, extending current coordination frameworks toward more self-organizing forms of collective intelligence. By bridging these previously fragmented research threads, this survey aims to offer both a systematic reference and a conceptual roadmap toward autonomous, self-improving multi-agent intelligence.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 149 of its 423 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
149 of 423 references.
Closest ancestors · 53
Same direction, newest first
- 2026MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing6 Mar
- 2026HieraMAS: Optimizing Intra-Node LLM Mixtures and Inter-Node Topology for Multi-Agent Systems23 Feb
- 2026AdaptOrch: Task-Adaptive Multi-Agent Orchestration in the Era of LLM Performance Convergence18 Feb
- 2026TodyComm: Task-Oriented Dynamic Communication for Multi-Round LLM-based Multi-Agent System3 Feb
- 2026Epistemic Context Learning: Building Trust the Right Way in LLM-Based Multi-Agent Systems29 Jan
- 2026ALIGN: Aligned Delegation with Performance Guarantees for Multi-Agent LLM Reasoning28 Jan
- 2026A Lightweight Modular Framework for Constructing Autonomous Agents Driven by Large Language Models: Design, Implementation, and Applications in AgentForge19 Jan
- 2026Towards AGI A Pragmatic Approach Towards Self Evolving Agent15 Jan
- 2026ResMAS: Resilience Optimization in LLM-based Multi-agent Systems8 Jan
- 2025Towards a Science of Scaling Agent Systems9 Dec
- 2025Latent Collaboration in Multi-Agent Systems25 Nov
- 2025Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstruction16 Oct
38 more
- 2025CoMAS: Co-Evolving Multi-Agent Systems via Interaction Rewards9 Oct
- 2025AgentAsk: Multi-Agent Systems Need to Ask8 Oct
- 2025Stochastic Self-Organization in Multi-Agent Systems1 Oct
- 2025Symphony: A Decentralized Multi-Agent Framework for Scalable Collective Intelligence27 Aug
- 2025Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Tasks18 Aug
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
- 2025RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory6 Aug
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul
- 2025Optimizing Sequential Multi-Step Tasks with Parallel LLM Agents11 Jul
- 2025AgentGroupChat-V2: Divide-and-Conquer Is What LLM-Based Multi-Agent System Need18 Jun
- 2025AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocol14 Jun
- 2025Self-Evolving Multi-Agent Systems via Textual Backpropagation10 Jun
- 2025Learn as Individuals, Evolve as a Team: Multi-agent LLMs Adaptation in Embodied Environments8 Jun
- 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMs22 May
- 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervision21 May
- 2025Self-Resource Allocation in Multi-Agent LLM Systems2 Apr
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems31 Mar
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks12 Mar
- 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systems5 Mar
- 2025REALM-Bench: A Benchmark for Evaluating Multi-Agent Systems on Real-world, Dynamic Planning and Scheduling Tasks26 Feb
- 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systems20 Feb
- 2025Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems16 Feb
- 2025Closed-Loop Vision-Language Planning for Multi-Agent Coordination14 Feb
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
- 2025AgentBreeder: Mitigating the AI Safety Risks of Multi-Agent Scaffolds via Self-Improvement2 Feb
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMs10 Jan
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks18 Dec
- 2024Towards Effective GenAI Multi-Agent Collaboration: Design and Evaluation for Enterprise Applications6 Dec
- 2024LLM-based Multi-Agent Systems: Techniques and Business Perspectives21 Nov
- 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments4 Nov
- 2024MorphAgent: Empowering Agents through Self-Evolving Profiles and Decentralized Collaboration19 Oct
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks15 Oct
- 2024BattleAgentBench: A Benchmark for Evaluating Cooperation and Competition Capabilities of Language Models in Multi-Agent Systems28 Aug
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
- 2024KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents5 Mar
- 2024LLM Multi-Agent Systems: Challenges and Open Problems5 Feb
- 2024Understanding the planning of LLM agents: A survey5 Feb
50 newest of 53 All 53 (JSON)
Other references · 96
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
38 more
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
- 2017Value-Decomposition Networks For Cooperative Multi-Agent Learningcited by 490
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 406
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 319
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 247
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 215
- 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 210
- 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 209
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
- 2023Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedbackcited by 202
- 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
- 2024Agent S: An Open Agentic Framework that Uses Computers Like a Humancited by 182
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
- 2024Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Modelscited by 156
- 2023Chain of Code: Reasoning with a Language Model-Augmented Code Emulatorcited by 120
- 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 119
- 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoningcited by 118
- 2025Where LLM Agents Fail and How They can Learn From Failurescited by 118
- 2024CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmarkcited by 115
- 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 113
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 105
- 2025A survey of agent interoperability protocols: Model Context Protocol (MCP), Agent Communication Protocol (ACP), Agent-to-Agent Protocol (A2A), and Agent Network Protocol (ANP)cited by 98
- 2025TRAIL: Trace Reasoning and Agentic Issue Localizationcited by 98
- 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 94
- 2025Reinforcement Learning for Self-Improving Agent with Skill Librarycited by 91
- 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 81
- 2024Self-Evolving Multi-Agent Collaboration Networks for Software Developmentcited by 73
- 2025Self-Adapting Language Modelscited by 71
- 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolutioncited by 58
50 most cited of 96 All 96 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026MechMath Agent Team: LLM Driven Agents for Mathematical Researchcited by 3
- 2026Rethinking Memory as Continuously Evolving Connectivitycited by 1
- 2026ASCon: A Direction-Aware Reciprocal Agent--Step Contextualization Model for Failure Attribution in Multi-Agent Systemscited by 1
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 1
- 2026DEALS: Decentralized Expertise-Aware Load Serving for Multi-Agent LLM Systemscited by 0
- 2026DEALS: Decentralized Expertise-Aware Load Serving for Multi-Agent LLM Systems27 Sep 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026ASCon: A Direction-Aware Reciprocal Agent--Step Contextualization Model for Failure Attribution in Multi-Agent Systems11 Aug 2026
- 2026MechMath Agent Team: LLM Driven Agents for Mathematical Research5 Jul 2026
- 2026Rethinking Memory as Continuously Evolving Connectivity27 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structures
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems
- 2026Towards a Science of Collective AI: LLM-based Multi-Agent Systems Need a Transition from Blind Trial-and-Error to Rigorous Science
- 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- 2026From Task Solving to Robust Real-World Adaptation in LLM Agents
- 2025Risk Analysis Techniques for Governed LLM-based Multi-Agent Systems
- 2026CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments
- 2026TRACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agents