LLM-based Multi-Agent Systems: Techniques and Business Perspectives
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
In the era of (multi-modal) large language models, most operational processes can be reformulated and reproduced using LLM agents. The LLM agents can perceive, control, and get feedback from the environment so as to accomplish the given tasks in an autonomous manner. Besides the environment-interaction property, the LLM agents can call various external tools to ease the task completion process. The tools can be regarded as a predefined operational process with private or real-time knowledge that does not exist in the parameters of LLMs. As a natural trend of development, the tools for calling are becoming autonomous agents, thus the full intelligent system turns out to be a LLM-based Multi-Agent System (LaMAS). Compared to the previous single-LLM-agent system, LaMAS has the advantages of i) dynamic task decomposition and organic specialization, ii) higher flexibility for system changing, iii) proprietary data preserving for each participating entity, and iv) feasibility of monetization for each entity. This paper discusses the technical and business landscapes of LaMAS. To support the ecosystem of LaMAS, we provide a preliminary version of such LaMAS protocol considering technical requirements, data privacy, and business incentives. As such, LaMAS would be a practical solution to achieve artificial collective intelligence in the near future.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 41 of its 81 references that are in the map. First posted on arXiv 21 Nov 2024.
Builds on
41 of 81 references.
Closest ancestors · 12
Same direction, newest first
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks7 Nov
- 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML3 Oct
- 2024Agent-Oriented Planning in Multi-Agent Systems3 Oct
- 2024MSI-Agent: Incorporating Multi-Scale Insight into Embodied Agents for Superior Planning and Decision-Making25 Sep
- 2024Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence9 Jul
- 2024Symbolic Learning Enables Self-Evolving Agents26 Jun
- 2024Autonomous Agents for Collaborative Task under Information Asymmetry21 Jun
- 2024AgentScope: A Flexible yet Robust Multi-Agent Platform21 Feb
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
- 2023OpenAgents: An Open Platform for Language Agents in the Wild16 Oct
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
- 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug
Other references · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
17 more
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
- 2023Detecting Language Model Attacks with Perplexitycited by 411
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
- 2024The Revolution of Multimodal Large Language Models: A Surveycited by 134
- 2024Efficient Adversarial Training in LLMs with Continuous Attackscited by 104
- 2024OpenR: An Open Source Framework for Advanced Reasoning with Large Language Modelscited by 92
- 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
- 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teamingcited by 85
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Modelscited by 84
- 2023Language Model Inversioncited by 66
- 2024Hammer: Robust Function-Calling for On-Device Language Models via Function Maskingcited by 53
- 2024A Scalable Communication Protocol for Networks of Large Language Modelscited by 43
- 2024Prompt Stealing Attacks Against Large Language Modelscited by 39
- 2024Agentic Information Retrievalcited by 19
- 2023Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Contentcited by 7
Built on by
Citing papers per year: 2025: 10; 2026: 12.
22 papers.
Sort:
By area:
- 2025Latent Collaboration in Multi-Agent Systemscited by 67
- 2025Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systemscited by 17
- 2026Recursive Multi-Agent Systemscited by 10
- 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challengecited by 8
- 2025AgentGit: A Version Control Framework for Reliable and Scalable LLM-Powered Multi-Agent Systemscited by 8
- 2026The Vision Wormhole: Latent-Space Communication in Heterogeneous Multi-Agent Systemscited by 8
- 2025BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Webcited by 7
- 2025ColorAgent: Building A Robust, Personalized, and Interactive OS Agentcited by 6
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injectioncited by 5
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systemscited by 5
- 2026StateBridge: Training-free Hidden-state Alignment for Latent Communication in LLM Multi-Agent Systemscited by 5
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challengescited by 4
10 more
- 2026MASPO: Joint Prompt Optimization for LLM-based Multi-Agent Systemscited by 3
- 2025EnvX: Agentize Everything with Agentic AIcited by 2
- 2026Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Modelscited by 2
- 2025Multi Part Deployment of Neural Networkcited by 0
- 2025Use of Retrieval-Augmented Large Language Model Agent for Long-Form COVID-19 Fact-Checkingcited by 0
- 2026An Interactive Multi-Agent System for Evaluation of New Product Conceptscited by 0
- 2026InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Readingcited by 0
- 2026Runtime Uncertainty Monitoring for LLM-Based Multi-Agent Systems Using Bayesian Networkscited by 0
- 2026A Multi-Agent Platform for Automated Enterprise Analytics and Insight Generationcited by 0
- 2026I Am AdMan: A Pipeline for Automatic Generation of Personalized Advertising Imagerycited by 0
- 2026I Am AdMan: A Pipeline for Automatic Generation of Personalized Advertising Imagery11 Sep 2026
- 2026A Multi-Agent Platform for Automated Enterprise Analytics and Insight Generation19 Aug 2026
- 2026StateBridge: Training-free Hidden-state Alignment for Latent Communication in LLM Multi-Agent Systems13 Aug 2026
- 2026Runtime Uncertainty Monitoring for LLM-Based Multi-Agent Systems Using Bayesian Networks28 Jul 2026
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems14 May 2026
- 2026MASPO: Joint Prompt Optimization for LLM-based Multi-Agent Systems7 May 2026
- 2026Recursive Multi-Agent Systems28 Apr 2026
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injection9 Apr 2026
- 2026InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Reading14 Mar 2026
- 2026An Interactive Multi-Agent System for Evaluation of New Product Concepts6 Mar 2026
- 2026The Vision Wormhole: Latent-Space Communication in Heterogeneous Multi-Agent Systems17 Feb 2026
- 2026Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Models12 Jan 2026
10 more
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges4 Dec 2025
- 2025Latent Collaboration in Multi-Agent Systems25 Nov 2025
- 2025AgentGit: A Version Control Framework for Reliable and Scalable LLM-Powered Multi-Agent Systems1 Nov 2025
- 2025ColorAgent: Building A Robust, Personalized, and Interactive OS Agent22 Oct 2025
- 2025Use of Retrieval-Augmented Large Language Model Agent for Long-Form COVID-19 Fact-Checking10 Oct 2025
- 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challenge2 Oct 2025
- 2025EnvX: Agentize Everything with Agentic AI9 Sep 2025
- 2025BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Web19 Aug 2025
- 2025Multi Part Deployment of Neural Network2 Jun 2025
- 2025Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems16 Feb 2025
- 2025Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systemscited by 17
- 2026Recursive Multi-Agent Systemscited by 10
- 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challengecited by 8
- 2025AgentGit: A Version Control Framework for Reliable and Scalable LLM-Powered Multi-Agent Systemscited by 8
- 2025BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Webcited by 7
- 2025ColorAgent: Building A Robust, Personalized, and Interactive OS Agentcited by 6
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systemscited by 5
- 2026StateBridge: Training-free Hidden-state Alignment for Latent Communication in LLM Multi-Agent Systemscited by 5
- 2026MASPO: Joint Prompt Optimization for LLM-based Multi-Agent Systemscited by 3
- 2025EnvX: Agentize Everything with Agentic AIcited by 2
- 2026Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Modelscited by 2
- 2026An Interactive Multi-Agent System for Evaluation of New Product Conceptscited by 0
12 most cited of 14 All 14 (JSON)
- 2026A Multi-Agent Platform for Automated Enterprise Analytics and Insight Generation19 Aug 2026
- 2026StateBridge: Training-free Hidden-state Alignment for Latent Communication in LLM Multi-Agent Systems13 Aug 2026
- 2026Runtime Uncertainty Monitoring for LLM-Based Multi-Agent Systems Using Bayesian Networks28 Jul 2026
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems14 May 2026
- 2026MASPO: Joint Prompt Optimization for LLM-based Multi-Agent Systems7 May 2026
- 2026Recursive Multi-Agent Systems28 Apr 2026
- 2026An Interactive Multi-Agent System for Evaluation of New Product Concepts6 Mar 2026
- 2026Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Models12 Jan 2026
- 2025AgentGit: A Version Control Framework for Reliable and Scalable LLM-Powered Multi-Agent Systems1 Nov 2025
- 2025ColorAgent: Building A Robust, Personalized, and Interactive OS Agent22 Oct 2025
- 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challenge2 Oct 2025
- 2025EnvX: Agentize Everything with Agentic AI9 Sep 2025
12 newest of 14 All 14 (JSON)
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injectioncited by 5
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challengescited by 4
- 2025Multi Part Deployment of Neural Networkcited by 0
- 2025Use of Retrieval-Augmented Large Language Model Agent for Long-Form COVID-19 Fact-Checkingcited by 0
- 2026InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Readingcited by 0
- 2026I Am AdMan: A Pipeline for Automatic Generation of Personalized Advertising Imagerycited by 0
- 2026I Am AdMan: A Pipeline for Automatic Generation of Personalized Advertising Imagery11 Sep 2026
- 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injection9 Apr 2026
- 2026InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Reading14 Mar 2026
- 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challenges4 Dec 2025
- 2025Use of Retrieval-Augmented Large Language Model Agent for Long-Form COVID-19 Fact-Checking10 Oct 2025
- 2025Multi Part Deployment of Neural Network2 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents
- 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
- 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects
- 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application
- 2026LLM-Enabled Multi-Agent Systems: Empirical Evaluation and Insights into Emerging Design Patterns & Paradigms
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMs
- 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systems