mlsanityData to 7 Oct 2026

MetaAgents: Large Language Model Based Agents for Decision-Making on Teaming

arXiv 2310.06500 ↗First posted 10 Oct 2023cs.AIcited by 85

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Significant advancements have occurred in the application of Large Language Models (LLMs) for social simulations. Despite this, their abilities to perform teaming in task-oriented social events are underexplored. Such capabilities are crucial if LLMs are to effectively mimic human-like social behaviors and form efficient teams to solve tasks. To bridge this gap, we introduce MetaAgents, a social simulation framework populated with LLM-based agents. MetaAgents facilitates agent engagement in conversations and a series of decision making within social contexts, serving as an appropriate platform for investigating interactions and interpersonal decision-making of agents. In particular, we construct a job fair environment as a case study to scrutinize the team assembly and skill-matching behaviors of LLM-based agents. We take advantage of both quantitative metrics evaluation and qualitative text analysis to assess their teaming abilities at the job fair. Our evaluation demonstrates that LLM-based agents perform competently in making rational decisions to develop efficient teams. However, we also identify limitations that hinder their effectiveness in more complex team assembly tasks. Our work provides valuable insights into the role and evolution of LLMs in task-oriented social simulations.

Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 23 of its 72 references that are in the map. First posted on arXiv 10 Oct 2023.

Builds on

23 of 72 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 22

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  3. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  4. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  5. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
  6. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  7. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  8. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  9. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
  10. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
  11. 2023Can Large Language Models Transform Computational Social Science?cited by 245
  12. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
10 more
  1. 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
  2. 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 207
  3. 2023Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplationcited by 102
  4. 2023AgentSims: An Open-Source Sandbox for Large Language Model Evaluationcited by 86
  5. 2019Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AIcited by 79
  6. 2023How FaR Are Large Language Models From Agents with Theory-of-Mind?cited by 75
  7. 2020How do Data Science Workers Collaborate? Roles, Workflows, and Toolscited by 64
  8. 2023Rehearsal: Simulating Conflict to Teach Conflict Resolutioncited by 54
  9. 2020Towards Ecologically Valid Research on Language User Interfacescited by 42
  10. 2023Memory Sandbox: Transparent and Interactive Memory Management for Conversational Agentscited by 36

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 8; 2024: 43; 2025: 28; 2026: 6.

85 papers.

Sort:

By area:

  1. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  2. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  3. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 235
  4. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 210
  5. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
  6. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
  7. 2023Simulating Opinion Dynamics with Networks of LLM-based Agentscited by 153
  8. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
  9. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  10. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
  11. 2024A Survey on Large Language Model-Based Game Agentscited by 106
  12. 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 85
38 more
  1. 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 81
  2. 2023Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agentscited by 72
  3. 2023Experiential Co-Learning of Software-Developing Agentscited by 57
  4. 2024Game-theoretic LLM: Agent Workflow for Negotiation Gamescited by 55
  5. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 54
  6. 2023Do LLM Agents Exhibit Social Behavior?cited by 53
  7. 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
  8. 2024Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?cited by 40
  9. 2024CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worldscited by 38
  10. 2024AgentSense: Benchmarking Social Intelligence of Language Agents through Interactive Scenarioscited by 37
  11. 2024On the Structural Memory of LLM Agentscited by 37
  12. 2024IBSEN: Director-Actor Agent Collaboration for Controllable and Interactive Drama Script Generationcited by 35
  13. 2024CodeAgent: Autonomous Communicative Agents for Code Reviewcited by 33
  14. 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulationscited by 28
  15. 2024AMONGAGENTS: Evaluating Large Language Models in the Interactive Text-Based Social Deduction Gamecited by 26
  16. 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
  17. 2024Examining Identity Drift in Conversations of LLM Agentscited by 25
  18. 2023LARP: Language-Agent Role Play for Open-World Gamescited by 24
  19. 2025AgentRecBench: Benchmarking LLM Agent-based Personalized Recommender Systemscited by 23
  20. 2024A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challengescited by 22
  21. 2024Be More Real: Travel Diary Generation Using LLM Agents and Individual Profilescited by 22
  22. 2024ACC-Collab: An Actor-Critic Approach to Multi-Agent LLM Collaborationcited by 22
  23. 2024LLM-based Multi-Agent Systems: Techniques and Business Perspectivescited by 22
  24. 2024LLMs Can Simulate Standardized Patients via Agent Coevolutioncited by 22
  25. 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agentscited by 22
  26. 2024ChatShop: Interactive Information Seeking with Language Agentscited by 21
  27. 2025LLM-powered Multi-agent Framework for Goal-oriented Learning in Intelligent Tutoring Systemcited by 21
  28. 2024Simulating Human Strategic Behavior: Comparing Single and Multi-agent LLMscited by 20
  29. 2025Simulating Cooperative Prosocial Behavior with Multi-Agent LLMs: Evidence and Mechanisms for AI Agents to Inform Policy Decisionscited by 20
  30. 2024Assistive Large Language Model Agents for Socially-Aware Negotiation Dialoguescited by 18
  31. 2024ToolScan: A Benchmark for Characterizing Errors in Tool-Use LLMscited by 17
  32. 2024Iterative Experience Refinement of Software-Developing Agentscited by 16
  33. 2024LLM experiments with simulation: Large Language Model Multi-Agent System for Simulation Model Parametrization in Digital Twinscited by 16
  34. 2024An Electoral Approach to Diversify LLM-based Multi-Agent Collective Decision-Makingcited by 14
  35. 2023Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agentscited by 13
  36. 2025The PIMMUR Principles: Ensuring Validity in Collective Behavior of LLM Societiescited by 12
  37. 2024Towards Objectively Benchmarking Social Intelligence for Language Agents at Action Levelcited by 11
  38. 2025Shapley-Coop: Credit Assignment for Emergent Cooperation in Self-Interested LLM Agentscited by 11

50 most cited of 85 All 85 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Lessons From Human Teams Be Applied to Multi-Agent Systems? The Role of Structure, Diversity, and Interaction Dynamics
  2. 2024Synergistic Simulations: Multi-Agent Problem Solving with Large Language Models
  3. 2025Exploring Large Language Model Agents for Piloting Social Experiments
  4. 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents
  5. 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
  6. 2023Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Game
  7. 2025The Social Laboratory: A Psychometric Framework for Multi-Agent LLM Evaluation
  8. 2024Adaptive In-conversation Team Building for Language Model Agents