mlsanityData to 7 Oct 2026

LLM-based Multi-Agent Systems: Techniques and Business Perspectives

arXiv 2411.14033 ↗First posted 21 Nov 2024cs.AIcited by 22

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

In the era of (multi-modal) large language models, most operational processes can be reformulated and reproduced using LLM agents. The LLM agents can perceive, control, and get feedback from the environment so as to accomplish the given tasks in an autonomous manner. Besides the environment-interaction property, the LLM agents can call various external tools to ease the task completion process. The tools can be regarded as a predefined operational process with private or real-time knowledge that does not exist in the parameters of LLMs. As a natural trend of development, the tools for calling are becoming autonomous agents, thus the full intelligent system turns out to be a LLM-based Multi-Agent System (LaMAS). Compared to the previous single-LLM-agent system, LaMAS has the advantages of i) dynamic task decomposition and organic specialization, ii) higher flexibility for system changing, iii) proprietary data preserving for each participating entity, and iv) feasibility of monetization for each entity. This paper discusses the technical and business landscapes of LaMAS. To support the ecosystem of LaMAS, we provide a preliminary version of such LaMAS protocol considering technical requirements, data privacy, and business incentives. As such, LaMAS would be a practical solution to achieve artificial collective intelligence in the near future.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 41 of its 81 references that are in the map. First posted on arXiv 21 Nov 2024.

Builds on

41 of 81 references.

Closest ancestors · 12

Same direction, newest first

  1. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks7 Nov
  2. 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML3 Oct
  3. 2024Agent-Oriented Planning in Multi-Agent Systems3 Oct
  4. 2024MSI-Agent: Incorporating Multi-Scale Insight into Embodied Agents for Superior Planning and Decision-Making25 Sep
  5. 2024Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence9 Jul
  6. 2024Symbolic Learning Enables Self-Evolving Agents26 Jun
  7. 2024Autonomous Agents for Collaborative Task under Information Asymmetry21 Jun
  8. 2024AgentScope: A Flexible yet Robust Multi-Agent Platform21 Feb
  9. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
  10. 2023OpenAgents: An Open Platform for Language Agents in the Wild16 Oct
  11. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  12. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug

Other references · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  7. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  8. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  9. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  10. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  11. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  12. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
17 more
  1. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
  2. 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
  3. 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 434
  4. 2023Detecting Language Model Attacks with Perplexitycited by 411
  5. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
  6. 2024The Revolution of Multimodal Large Language Models: A Surveycited by 134
  7. 2024Efficient Adversarial Training in LLMs with Continuous Attackscited by 104
  8. 2024OpenR: An Open Source Framework for Advanced Reasoning with Large Language Modelscited by 92
  9. 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
  10. 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teamingcited by 85
  11. 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Modelscited by 84
  12. 2023Language Model Inversioncited by 66
  13. 2024Hammer: Robust Function-Calling for On-Device Language Models via Function Maskingcited by 53
  14. 2024A Scalable Communication Protocol for Networks of Large Language Modelscited by 43
  15. 2024Prompt Stealing Attacks Against Large Language Modelscited by 39
  16. 2024Agentic Information Retrievalcited by 19
  17. 2023Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Contentcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 10; 2026: 12.

22 papers.

Sort:

By area:

  1. 2025Latent Collaboration in Multi-Agent Systemscited by 67
  2. 2025Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systemscited by 17
  3. 2026Recursive Multi-Agent Systemscited by 10
  4. 2025Orchestrating Human-AI Teams: The Manager Agent as a Unifying Research Challengecited by 8
  5. 2025AgentGit: A Version Control Framework for Reliable and Scalable LLM-Powered Multi-Agent Systemscited by 8
  6. 2026The Vision Wormhole: Latent-Space Communication in Heterogeneous Multi-Agent Systemscited by 8
  7. 2025BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Webcited by 7
  8. 2025ColorAgent: Building A Robust, Personalized, and Interactive OS Agentcited by 6
  9. 2026ACIArena: Toward Unified Evaluation for Agent Cascading Injectioncited by 5
  10. 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systemscited by 5
  11. 2026StateBridge: Training-free Hidden-state Alignment for Latent Communication in LLM Multi-Agent Systemscited by 5
  12. 2025Embodied Co-Design for Rapidly Evolving Agents: Taxonomy, Frontiers, and Challengescited by 4
10 more
  1. 2026MASPO: Joint Prompt Optimization for LLM-based Multi-Agent Systemscited by 3
  2. 2025EnvX: Agentize Everything with Agentic AIcited by 2
  3. 2026Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Modelscited by 2
  4. 2025Multi Part Deployment of Neural Networkcited by 0
  5. 2025Use of Retrieval-Augmented Large Language Model Agent for Long-Form COVID-19 Fact-Checkingcited by 0
  6. 2026An Interactive Multi-Agent System for Evaluation of New Product Conceptscited by 0
  7. 2026InterventionLens: A Multi-Agent Framework for Detecting ASD Intervention Strategies in Parent-Child Shared Readingcited by 0
  8. 2026Runtime Uncertainty Monitoring for LLM-Based Multi-Agent Systems Using Bayesian Networkscited by 0
  9. 2026A Multi-Agent Platform for Automated Enterprise Analytics and Insight Generationcited by 0
  10. 2026I Am AdMan: A Pipeline for Automatic Generation of Personalized Advertising Imagerycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents
  2. 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
  3. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects
  4. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application
  5. 2026LLM-Enabled Multi-Agent Systems: Empirical Evaluation and Insights into Emerging Design Patterns & Paradigms
  6. 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey
  7. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMs
  8. 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systems