mlsanityData to 14 Oct 2026

AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors

arXiv 2308.10848 ↗First posted 21 Aug 2023cs.CLcited by 598

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Autonomous agents empowered by Large Language Models (LLMs) have undergone significant improvements, enabling them to generalize across a broad spectrum of tasks. However, in real-world scenarios, cooperation among individuals is often required to enhance the efficiency and effectiveness of task accomplishment. Hence, inspired by human group dynamics, we propose a multi-agent framework framework that can collaboratively and dynamically adjust its composition as a greater-than-the-sum-of-its-parts system. Our experiments demonstrate that framework framework can effectively deploy multi-agent groups that outperform a single agent. Furthermore, we delve into the emergence of social behaviors among individual agents within a group during collaborative task accomplishment. In view of these behaviors, we discuss some possible strategies to leverage positive ones and mitigate negative ones for improving the collaborative potential of multi-agent groups. Our codes for framework will soon be released at urlhttps://github.com/OpenBMB/AgentVerse.

Key facts. Cited by 598 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 33 of its 70 references that are in the map. First posted on arXiv 21 Aug 2023.

Builds on

33 of 70 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug
  2. 2023Building Cooperative Embodied Agents Modularly with Large Language Models5 Jul
  3. 2023Multi-Party Chat: Conversational Agents in Group Settings with Humans and Models26 Apr

Other references · 30

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  8. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  9. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  10. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  11. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  12. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
18 more
  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  2. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  3. 2020Learning to summarize from human feedbackcited by 2,588
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  6. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  7. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  8. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  9. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  10. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  11. 2023PaLM 2 Technical Reportcited by 1,162
  12. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 530
  13. 2023Tool Learning with Foundation Modelscited by 302
  14. 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 155
  15. 2020Unsupervised Evaluation of Interactive Dialog with DialoGPTcited by 139
  16. 2023Wider and Deeper LLM Networks are Fairer LLM Evaluatorscited by 94
  17. 2019AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligencecited by 86
  18. 2016The AGI Containment Problemcited by 36

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 31; 2024: 160; 2025: 192; 2026: 215.

598 papers.

Sort:

By area:

  1. 2023Qwen Technical Reportcited by 3,344
  2. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  3. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  4. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  5. 2024Automated Design of Agentic Systemscited by 407
  6. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 386
  7. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
  8. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
  9. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
  10. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 222
  11. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 216
  12. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
38 more
  1. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
  2. 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaborationcited by 189
  3. 2024More Agents Is All You Needcited by 180
  4. 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 178
  5. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  6. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 169
  7. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
  8. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 155
  9. 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fastcited by 153
  10. 2023Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Gamecited by 152
  11. 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 145
  12. 2025Towards a Science of Scaling Agent Systemscited by 138
  13. 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 137
  14. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospectscited by 132
  15. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 131
  16. 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 128
  17. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 126
  18. 2024Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffoldingcited by 117
  19. 2023Agents: An Open-source Framework for Autonomous Language Agentscited by 116
  20. 2023AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systemscited by 116
  21. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 113
  22. 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Makingcited by 113
  23. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 113
  24. 2025Agentic Large Language Models, a surveycited by 108
  25. 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 108
  26. 2024Symbolic Learning Enables Self-Evolving Agentscited by 106
  27. 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Modelcited by 106
  28. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Modelscited by 100
  29. 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 99
  30. 2024AIOS: LLM Agent Operating Systemcited by 97
  31. 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 94
  32. 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 93
  33. 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systemscited by 90
  34. 2024Language Agents as Optimizable Graphscited by 89
  35. 2025MasRouter: Learning to Route LLMs for Multi-Agent Systemscited by 88
  36. 2024Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligencecited by 86
  37. 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 86
  38. 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 83

50 most cited of 598 All 598 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Lessons From Human Teams Be Applied to Multi-Agent Systems? The Role of Structure, Diversity, and Interaction Dynamics
  2. 2025Beyond Frameworks: Unpacking Collaboration Strategies in Multi-Agent Systems
  3. 2026CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments
  4. 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teaming
  5. 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
  6. 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents
  7. 2025AgentInit: Initializing LLM-based Multi-Agent Systems via Diversity and Expertise Orchestration for Effective and Efficient Collaboration
  8. 2026Improving the Efficiency of Language Agent Teams with Adaptive Task Graphs