PLAYER*: Enhancing LLM-based Multi-Agent Communication and Interaction in Murder Mystery Games
On the map: LLM agents and tool use → Reinforcement learning for LLM agents
Abstract (arXiv)
We introduce WellPlay, a reasoning dataset for multi-agent conversational inference in Murder Mystery Games (MMGs). WellPlay comprises 1,482 inferential questions across 12 games, spanning objectives, reasoning, and relationship understanding, and establishes a systematic benchmark for evaluating agent reasoning abilities in complex social settings. Building on this foundation, we present PLAYER*, a novel framework for Large Language Model (LLM)-based agents in MMGs. MMGs pose unique challenges, including undefined state spaces, absent intermediate rewards, and the need for strategic reasoning through natural language. PLAYER* addresses these challenges with a sensor-based state representation and an information-driven strategy that optimises questioning and suspect pruning. Experiments show that PLAYER* outperforms existing methods in reasoning accuracy, efficiency, and agent-human interaction, advancing reasoning agents for complex social scenarios.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 36 of its 55 references that are in the map. First posted on arXiv 26 Apr 2024.
Builds on
36 of 55 references.
Closest ancestors · 2
Same direction, newest first
- 2023Deciphering Digital Detectives: Understanding LLM Behaviors and Capabilities in Multi-Agent Mystery Games1 Dec
- 2023Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Game29 Oct
Other references · 34
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2024Self-Rewarding Language Modelscited by 681
- 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 557
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 462
- 2024The Faiss librarycited by 376
- 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
22 more
- 2017A Unified Game-Theoretic Approach to Multiagent Reinforcement Learningcited by 268
- 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 241
- 2023Improving Language Model Negotiation with Self-Play and In-Context Learning from AI Feedbackcited by 207
- 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Taskscited by 168
- 2023RAIN: Your Language Models Can Align Themselves without Finetuningcited by 157
- 2023Simulating Opinion Dynamics with Networks of LLM-based Agentscited by 154
- 2022Mastering the Game of Stratego with Model-Free Multiagent Reinforcement Learningcited by 131
- 2024AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Callscited by 124
- 2023Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplationcited by 104
- 2023How FaR Are Large Language Models From Agents with Theory-of-Mind?cited by 76
- 2023The Next Chapter: A Study of Large Language Models in Storytellingcited by 58
- 2022Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and Planningcited by 48
- 2024Evaluating Language Model Agency through Negotiationscited by 48
- 2023Cooperation on the Fly: Exploring Language Agents for Ad Hoc Teamwork in the Avalon Gamecited by 28
- 2017Batch Informed Trees (BIT*): Informed Asymptotically Optimal Anytime Searchcited by 23
- 2024Empowering Large Language Model Agents through Action Learningcited by 22
- 2024Metacognition is all you need? Using Introspection in Generative Agents to Improve Goal-directed Behaviorcited by 15
- 2024Large Language Models Fall Short: Understanding Complex Relationships in Detective Narrativescited by 14
- 2023AutoPlan: Automatic Planning of Interactive Decision-Making Tasks With Large Language Modelscited by 13
- 2024Language-Guided World Models: A Model-Based Approach to AI Controlcited by 12
- 2023Large Human Language Models: A Need and the Challengescited by 11
- 2024NARRATE: Versatile Language Architecture for Optimal Control in Roboticscited by 4
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 4.
10 papers.
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 82
- 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 71
- 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarioscited by 23
- 2025EmoAgent: Assessing and Safeguarding Human-AI Interaction for Mental Health Safetycited by 21
- 2025MobileSteward: Integrating Multiple App-Oriented Agents with Self-Evolution to Automate Cross-App Instructionscited by 16
- 2026Does Socialization Emerge in AI Agent Society? A Case Study of Moltbookcited by 15
- 2026Collaborative Multi-Agent Scripts Generation for Enhancing Imperfect-Information Reasoning in Murder Mystery Gamescited by 6
- 2025Sparse Activation Editing for Reliable Instruction Following in Narrativescited by 4
- 2026Superminds Test: Actively Evaluating Collective Intelligence of Agent Society via Probing Agentscited by 1
- 2026RPA-Check: A Multi-Stage Automated Framework for Evaluating Dynamic LLM-based Role-Playing Agentscited by 0
- 2026Superminds Test: Actively Evaluating Collective Intelligence of Agent Society via Probing Agents24 Apr 2026
- 2026Collaborative Multi-Agent Scripts Generation for Enhancing Imperfect-Information Reasoning in Murder Mystery Games13 Apr 2026
- 2026RPA-Check: A Multi-Stage Automated Framework for Evaluating Dynamic LLM-based Role-Playing Agents13 Apr 2026
- 2026Does Socialization Emerge in AI Agent Society? A Case Study of Moltbook15 Feb 2026
- 2025Sparse Activation Editing for Reliable Instruction Following in Narratives22 May 2025
- 2025EmoAgent: Assessing and Safeguarding Human-AI Interaction for Mental Health Safety13 Apr 2025
- 2025MobileSteward: Integrating Multiple App-Oriented Agents with Self-Evolution to Automate Cross-App Instructions24 Feb 2025
- 2025A Survey of Personalized Large Language Models: Progress and Future Directions17 Feb 2025
- 2024A Survey on Large Language Model-Based Social Agents in Game-Theoretic Scenarios5 Dec 2024
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents4 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2024Who Speaks Next? Multi-party AI Discussion Leveraging the Systematics of Turn-taking in Murder Mystery Games
- 2026MINDGAMES: A Live Arena for Evaluating Social and Strategic Reasoning in Multi-Agent LLMs
- 2026Clueing up LLMs with Tool-Augmented Deductive Reasoning
- 2026Do Reasoning Models Ask Better Questions? A Formal Information-Theoretic Analysis on Multi-Turn LLM Games
- 2024AgentSense: Benchmarking Social Intelligence of Language Agents through Interactive Scenarios
- 2023Probing the Multi-turn Planning Capabilities of LLMs via 20 Question Games
- 2026GameTalk: Training LLMs for Strategic Conversation
- 2026LinguaGame: A Linguistically Grounded Game-Theoretic Paradigm for Multi-Agent Dialogue Generation