mlsanityData to 7 Oct 2026

Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents

arXiv 2306.03314 ↗First posted 5 Jun 2023cs.AI cs.LG cs.MAcited by 329

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

In this paper, we present a novel framework for enhancing the capabilities of large language models (LLMs) by leveraging the power of multi-agent systems. Our framework introduces a collaborative environment where multiple intelligent agent components, each with distinctive attributes and roles, work together to handle complex tasks more efficiently and effectively. We demonstrate the practicality and versatility of our framework through case studies in artificial general intelligence (AGI), specifically focusing on the Auto-GPT and BabyAGI models. We also examine the "Gorilla" model, which integrates external APIs into the LLM. Our framework addresses limitations and challenges such as looping issues, security risks, scalability, system evaluation, and ethical considerations. By modeling various domains such as courtroom simulations and software development scenarios, we showcase the potential applications and benefits of our proposed multi-agent system. Our framework provides an avenue for advancing the capabilities and performance of LLMs through collaboration and knowledge exchange among intelligent agents.

Key facts. Cited by 329 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 12 of its 16 references that are in the map. First posted on arXiv 5 Jun 2023.

Builds on

12 of 16 references.

References · 12

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  5. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  6. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  7. 2023Teaching Large Language Models to Self-Debugcited by 963
  8. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  9. 2023Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedbackcited by 202
  10. 2022Language Model Cascadescited by 104
  11. 2023One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Eracited by 55
  12. 2023Blind Judgement: Agent-Based Supreme Court Modelling With GPTcited by 37

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 23; 2024: 94; 2025: 127; 2026: 85.

329 papers.

Sort:

By area:

  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  2. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  3. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  4. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  5. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
  6. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 235
  7. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 221
  8. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
  9. 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 187
  10. 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 182
  11. 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
  12. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 167
38 more
  1. 2024PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Actioncited by 161
  2. 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 151
  3. 2024UFO: A UI-Focused Agent for Windows OS Interactioncited by 147
  4. 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 145
  5. 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 145
  6. 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
  7. 2024MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolutioncited by 132
  8. 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studiescited by 127
  9. 2024LLM Multi-Agent Systems: Challenges and Open Problemscited by 119
  10. 2025Red-Teaming LLM Multi-Agent Systems via Communication Attackscited by 118
  11. 2024Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methodscited by 114
  12. 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 101
  13. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Modelscited by 97
  14. 2025A Survey on Trustworthy LLM Agents: Threats and Countermeasurescited by 93
  15. 2024AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planningcited by 81
  16. 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 81
  17. 2024PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safetycited by 79
  18. 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agentscited by 77
  19. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
  20. 2023Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generationcited by 73
  21. 2024AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitionscited by 70
  22. 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 68
  23. 2023LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplaycited by 62
  24. 2024KnowAgent: Knowledge-Augmented Planning for LLM-Based Agentscited by 61
  25. 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolutioncited by 58
  26. 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
  27. 2024Learning to Use Tools via Cooperative and Interactive Agentscited by 54
  28. 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 54
  29. 2024Knowledge Mechanisms in Large Language Models: A Survey and Perspectivecited by 50
  30. 2025An Agentic System for Rare Disease Diagnosis with Traceable Reasoningcited by 50
  31. 2023EcoAssistant: Using LLM Assistant More Affordably and Accuratelycited by 47
  32. 2024LLM Voting: Human Choices and AI Collective Decision Makingcited by 47
  33. 2024Octopus v2: On-device language model for super agentcited by 45
  34. 2025Magentic-UI: Towards Human-in-the-loop Agentic Systemscited by 41
  35. 2025TxGemma: Efficient and Agentic LLMs for Therapeuticscited by 40
  36. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 40
  37. 2025Understanding the Information Propagation Effects of Communication Topologies in LLM-based Multi-Agent Systemscited by 39
  38. 2025MAM: Modular Multi-Agent Framework for Multi-Modal Medical Diagnosis via Role-Specialized Collaborationcited by 39

50 most cited of 329 All 329 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects
  2. 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
  3. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges
  4. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges
  5. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead
  6. 2024Creating an LLM-based AI-agent: A high-level methodology towards enhancing LLMs with APIs
  7. 2023A Survey on Large Language Model based Autonomous Agents
  8. 2025Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agents