mlsanityData to 7 Oct 2026

LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplay

arXiv 2310.14985 ↗First posted 23 Oct 2023cs.CLcited by 62

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

This paper explores the open research problem of understanding the social behaviors of LLM-based agents. Using Avalon as a testbed, we employ system prompts to guide LLM agents in gameplay. While previous studies have touched on gameplay with LLM agents, research on their social behaviors is lacking. We propose a novel framework, tailored for Avalon, features a multi-agent system facilitating efficient communication and interaction. We evaluate its performance based on game success and analyze LLM agents' social behaviors. Results affirm the framework's effectiveness in creating adaptive agents and suggest LLM-based agents' potential in navigating dynamic social interactions. By examining collaboration and confrontation behaviors, we offer insights into this field's research and applications. Our code is publicly available at https://github.com/3DAgentWorld/LLM-Game-Agent.

Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 24 of its 50 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

24 of 50 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023An Appraisal-Based Chain-Of-Emotion Architecture for Affective Language Model Game Agents10 Sep
  2. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  4. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  5. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
  6. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
  7. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 329
  8. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  9. 2023Self-collaboration Code Generation via ChatGPTcited by 255
  10. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 238
  11. 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 228
  12. 2023Playing repeated games with Large Language Modelscited by 213
10 more
  1. 2023Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedbackcited by 202
  2. 2021Open-Ended Learning Leads to Generally Capable Agentscited by 177
  3. 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Taskscited by 166
  4. 2023Lyfe Agents: Generative agents for low-cost real-time social interactionscited by 49
  5. 2023Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questionscited by 30
  6. 2021RLupus: Cooperation through emergent communication in The Werewolf social deduction gamecited by 10
  7. 2023Knowledge-enhanced Agents for Interactive Text Gamescited by 10
  8. 2020On Emergent Communication in Competitive Multi-Agent Teamscited by 8
  9. 2023Recursive Metropolis-Hastings Naming Game: Symbol Emergence in a Multi-agent System based on Probabilistic Generative Modelscited by 8
  10. 2023CB2: Collaborative Natural Language Interaction Research Platformcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 25; 2025: 24; 2026: 13.

62 papers.

Sort:

By area:

  1. 2024A Survey on Large Language Model-Based Game Agentscited by 106
  2. 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 97
  3. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
  4. 2024How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environmentscited by 66
  5. 2024Can Large Language Model Agents Simulate Human Trust Behavior?cited by 62
  6. 2024Game-theoretic LLM: Agent Workflow for Negotiation Gamescited by 55
  7. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 54
  8. 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agentscited by 48
  9. 2024Puzzle Solving using Reasoning of Large Language Models: A Surveycited by 44
  10. 2024CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agentscited by 38
  11. 2025Reinforce LLM Reasoning through Multi-Agent Reflectioncited by 26
  12. 2024InterIntent: Investigating Social Intelligence of LLMs via Intention Understanding in an Interactive Game Contextcited by 25
38 more
  1. 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarioscited by 23
  2. 2024A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challengescited by 22
  3. 2024BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysiscited by 20
  4. 2025SOTOPIA-Omega: Dynamic Strategy Injection Learning and Social Instruction Following Evaluation for Social Agentscited by 16
  5. 2026Silo-Bench: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systemscited by 16
  6. 2024Step-On-Feet Tuning: Scaling Self-Alignment of LLMs via Bootstrappingcited by 14
  7. 2025Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontierscited by 14
  8. 2024Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulationcited by 13
  9. 2024An LLM-Based Digital Twin for Optimizing Human-in-the Loop Systemscited by 12
  10. 2024Helmsman of the Masses? Evaluate the Opinion Leadership of Large Language Models in the Werewolf Gamecited by 12
  11. 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspectivecited by 11
  12. 2025IMPersona: Evaluating Individual Level LM Impersonationcited by 11
  13. 2025Multi-agent KTO: Reinforcing Strategic Interactions of Large Language Model in Language Gamecited by 10
  14. 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
  15. 2024More Victories, Less Cooperation: Assessing Cicero's Diplomacy Playcited by 9
  16. 2025The Effect of State Representation on LLM Agent Behavior in Dynamic Routing Gamescited by 9
  17. 2025SE-VLN: A Self-Evolving Vision-Language Navigation Framework Based on Multimodal Large Language Modelscited by 9
  18. 2024Affordable Generative Agentscited by 8
  19. 2024BioKGBench: A Knowledge Graph Checking Benchmark of AI Agent for Biomedical Sciencecited by 8
  20. 2025Bayesian Social Deduction with Graph-Informed Language Modelscited by 8
  21. 2024Who Speaks Next? Multi-party AI Discussion Leveraging the Systematics of Turn-taking in Murder Mystery Gamescited by 7
  22. 2025Among Them: A game-based framework for assessing persuasion capabilities of LLMscited by 7
  23. 2025Exploring Large Language Models for Word Games:Who is the Spy?cited by 6
  24. 2025AI Agent Behavioral Sciencecited by 5
  25. 2025Simulating Influence Dynamics with LLM Agentscited by 4
  26. 2026Identity, Cooperation and Framing Effects within Groups of Real and Simulated Humanscited by 4
  27. 2024Fine-Grained and Thematic Evaluation of LLMs in Social Deduction Gamecited by 3
  28. 2025How Social is It? A Benchmark for LLMs' Capabilities in Multi-user Multi-turn Social Agent Taskscited by 3
  29. 2025The Stackelberg Speaker: Optimizing Persuasive Communication in Social Deduction Gamescited by 3
  30. 2025Can Competition Enhance the Proficiency of Agents Powered by Large Language Models in the Realm of News-driven Time Series Forecasting?cited by 2
  31. 2026ALIGN: Aligned Delegation with Performance Guarantees for Multi-Agent LLM Reasoningcited by 2
  32. 2026MafiaScope: Non-Invasive, Time-Resolved Belief Probing for LLM Agents in Social Deduction Gamescited by 2
  33. 2025PolicyEvol-Agent: Evolving Policy via Environment Perception and Self-Awareness with Theory of Mindcited by 1
  34. 2025Automatic Transmission for LLM Tiers: Optimizing Cost and Accuracy in Large Language Modelscited by 1
  35. 2025Multi-Agent Synergy-Driven Iterative Visual Narrative Synthesiscited by 1
  36. 2025IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimizationcited by 1
  37. 2025Debiasing International Attitudes: LLM Agents for Simulating US-China Perception Changescited by 1
  38. 2025Shall We Play a Game? Language Models for Open-ended Wargamescited by 1

50 most cited of 62 All 62 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023AvalonBench: Evaluating LLMs Playing the Game of Avalon
  2. 2026Game-Theoretic Lens on LLM-based Multi-Agent Systems
  3. 2025Time to Talk: LLM Agents for Asynchronous Group Communication in Mafia Games
  4. 2024LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
  5. 2025Beyond Self-Talk: A Communication-Centric Survey of LLM-Based Multi-Agent Systems
  6. 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
  7. 2023Do LLM Agents Exhibit Social Behavior?
  8. 2026Evaluating Collective Behaviour of Hundreds of LLM Agents