mlsanityData to 14 Oct 2026

Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Game

arXiv 2312.17515 ↗First posted 29 Dec 2023cs.CLcited by 28

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Multi-agent collaboration with Large Language Models (LLMs) demonstrates proficiency in basic tasks, yet its efficiency in more complex scenarios remains unexplored. In gaming environments, these agents often face situations without established coordination protocols, requiring them to make intelligent inferences about teammates from limited data. This problem motivates the area of ad hoc teamwork, in which an agent may potentially cooperate with a variety of teammates to achieve a shared goal. Our study focuses on the ad hoc teamwork problem where the agent operates in an environment driven by natural language. Our findings reveal the potential of LLM agents in team collaboration, highlighting issues related to hallucinations in communication. To address this issue, we develop CodeAct, a general agent that equips LLM with enhanced memory and code-driven reasoning, enabling the repurposing of partial information for rapid adaptation to new teammates.

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 23 of its 41 references that are in the map. First posted on arXiv 29 Dec 2023.

Builds on

23 of 41 references.

Closest ancestors · 7

Same direction, newest first

  1. 2023How FaR Are Large Language Models From Agents with Theory-of-Mind?4 Oct
  2. 2023The Rise and Potential of Large Language Model Based Agents: A Survey14 Sep
  3. 2023A Survey on Large Language Model based Autonomous Agents22 Aug
  4. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  5. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  7. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul

Other references · 16

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  4. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
  5. 2023Teaching Large Language Models to Self-Debugcited by 988
  6. 2023Self-collaboration Code Generation via ChatGPTcited by 258
  7. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 241
  8. 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 217
  9. 2020Towards Open Ad Hoc Teamwork Using Graph-based Policy Learningcited by 37
  10. 2023A Review of Cooperation in Multi-agent Learningcited by 29
  11. 2023PECAN: Leveraging Policy Ensemble for Context-Aware Zero-Shot Human-AI Coordinationcited by 25
  12. 2020Deep Reinforcement Learning with Stacked Hierarchical Attention for Text-based Gamescited by 22
4 more
  1. 2021Expected Value of Communication for Planning in Ad Hoc Teamworkcited by 19
  2. 2022Generating Teammates for Training Robust Ad Hoc Teamwork Agents via Best-Response Diversitycited by 17
  3. 2021Generalization in Text-based Games via Hierarchical Reinforcement Learningcited by 11
  4. 2022Perceiving the World: Question-guided Reinforcement Learning for Text-based Gamescited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 14; 2025: 9; 2026: 5.

28 papers.

Sort:

By area:

  1. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 126
  2. 2024A Survey on Large Language Model-Based Game Agentscited by 112
  3. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 82
  4. 2024Can Large Language Model Agents Simulate Human Trust Behavior?cited by 64
  5. 2024Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agentscited by 48
  6. 2024AMONGAGENTS: Evaluating Large Language Models in the Interactive Text-Based Social Deduction Gamecited by 28
  7. 2024InterIntent: Investigating Social Intelligence of LLMs via Intention Understanding in an Interactive Game Contextcited by 26
  8. 2024BattleAgentBench: A Benchmark for Evaluating Cooperation and Competition Capabilities of Language Models in Multi-Agent Systemscited by 26
  9. 2024Learning to Discuss Strategically: A Case Study on One Night Ultimate Werewolfcited by 24
  10. 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarioscited by 23
  11. 2025Pok'eChamp: an Expert-level Minimax Language Agentcited by 16
  12. 2024An Electoral Approach to Diversify LLM-based Multi-Agent Collective Decision-Makingcited by 14
16 more
  1. 2025The Collaboration Gap: Exploration and Benchmarking of Open-World Agentic Cooperationcited by 13
  2. 2025MultiMind: Enhancing Werewolf Agents with Multimodal Reasoning and Theory of Mindcited by 12
  3. 2024PLAYER*: Enhancing LLM-based Multi-Agent Communication and Interaction in Murder Mystery Gamescited by 10
  4. 2025From Natural Language to Extensive-Form Game Representationscited by 6
  5. 2026Identity, Cooperation and Framing Effects within Groups of Real and Simulated Humanscited by 5
  6. 2024Fine-Grained and Thematic Evaluation of LLMs in Social Deduction Gamecited by 4
  7. 2025Spiral of Silence in Large Language Model Agentscited by 3
  8. 2025The Stackelberg Speaker: Optimizing Persuasive Communication in Social Deduction Gamescited by 3
  9. 2025Benchmarking Foundation Models with Retrieval-Augmented Generation in Olympic-Level Physics Problem Solvingcited by 1
  10. 2026UIPress: Bringing Optical Token Compression to UI-to-Code Generationcited by 1
  11. 2026Evaluating Large Language Models in a Complex Hidden Role Gamecited by 1
  12. 2024Cognitive Insights and Stable Coalition Matching for Fostering Multi-Agent Cooperationcited by 0
  13. 2024WiS Platform: Enhancing Evaluation of LLM-Based Multi-Agent Systems Through Game-Based Analysiscited by 0
  14. 2025Generic-to-Specific Reasoning and Learning for Scalable Ad Hoc Teamworkcited by 0
  15. 2026CaM-Wolf: Causal-Aware Multimodal Agents for Social Deduction Gamescited by 0
  16. 2026Can Agents Deceive? Evaluating Reasoning and Deception in ParliamentBench using a Social Deduction Gamecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Communication and Verification in LLM Agents towards Collaboration under Information Asymmetry
  2. 2026COOP2: Defining, Observing, and Repairing Cooperation in LLM Multi-Agent Systems
  3. 2025Collaborating Action by Action: A Multi-agent LLM Framework for Embodied Reasoning
  4. 2026SMAC-Talk: A Natural Language Extension of the StarCraft Multi-Agent Challenge for Large Language Models
  5. 2024Adaptive In-conversation Team Building for Language Model Agents
  6. 2026More Capable, Less Cooperative? When LLMs Fail At Zero-Cost Collaboration
  7. 2024Language Grounded Multi-agent Reinforcement Learning with Human-interpretable Communication
  8. 2025Dynamic Strategy Adaptation in Multi-Agent Environments with Large Language Models