CALYPSO: LLMs as Dungeon Masters' Assistants
Not on the map. Why?
Abstract (arXiv)
The role of a Dungeon Master, or DM, in the game Dungeons & Dragons is to perform multiple tasks simultaneously. The DM must digest information about the game setting and monsters, synthesize scenes to present to other players, and respond to the players' interactions with the scene. Doing all of these tasks while maintaining consistency within the narrative and story world is no small feat of human cognition, making the task tiring and unapproachable to new players. Large language models (LLMs) like GPT-3 and ChatGPT have shown remarkable abilities to generate coherent natural language text. In this paper, we conduct a formative evaluation with DMs to establish the use cases of LLMs in D&D and tabletop gaming generally. We introduce CALYPSO, a system of LLM-powered interfaces that support DMs with information and inspiration specific to their own scenario. CALYPSO distills game context into bite-sized prose and helps brainstorm ideas without distracting the DM from the game. When given access to CALYPSO, DMs reported that it generated high-fidelity text suitable for direct presentation to players, and low-fidelity ideas that the DM could develop further while maintaining their creative agency. We see CALYPSO as exemplifying a paradigm of AI-augmented tools that provide synchronous creative assistance within established game worlds, and tabletop gaming more broadly.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 12 of its 50 references that are in the map. First posted on arXiv 15 Aug 2023.
Builds on
12 of 50 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2022Creative Writing with an AI-Powered Writing Assistant: Perspectives from Professional Writerscited by 69
- 2020STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generationcited by 56
- 2021Wordcraft: a Human-AI Collaborative Editor for Story Writingcited by 41
- 2022Dungeons and Dragons as a Dialog Challenge for Artificial Intelligencecited by 35
- 2020Bringing Stories Alive: Generating Interactive Fiction Worldscited by 28
- 2022I Cast Detect Thoughts: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragonscited by 22
- 2023FIREBALL: A Dataset of Dungeons and Dragons Actual-Play with Structured Game State Informationcited by 18
- 2022Creative Wand: A System to Study Effects of Communications in Co-Creative Settingscited by 9
- 2023Rolling the Dice: Imagining Generative AI as a Dungeons & Dragons Storytelling Companioncited by 2
Built on by
Citing papers per year: 2023: 3; 2024: 10; 2025: 8; 2026: 2.
23 papers.
Sort:
By area:
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2024A Survey on Large Language Model-Based Game Agentscited by 106
- 2024Large Language Models and Games: A Survey and Roadmapcited by 91
- 2025Oolong: Evaluating Long Context Reasoning and Aggregation Capabilitiescited by 33
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualizationcited by 23
- 2024A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challengescited by 22
- 2024LLM-based multi-agent poetry generation in non-cooperative environmentscited by 15
- 2023Assessing Logical Puzzle Solving in Large Language Models: Insights from a Minesweeper Case Studycited by 14
- 2024Unbounded: A Generative Infinite Game of Character Life Simulationcited by 14
- 2024GPT for Games: A Scoping Review (2020-2023)cited by 10
11 more
- 2024GPT for Games: An Updated Scoping Review (2020-2024)cited by 10
- 2025Beyond Survival: Evaluating LLMs in Social Deduction Games with Human-Aligned Strategiescited by 9
- 2023Skill Check: Some Considerations on the Evaluation of Gamemastering Models for Role-playing Gamescited by 3
- 2024Unveiling Disparities in Web Task Handling Between Human and Web Agentcited by 2
- 2025Can Large Language Models Capture Video Game Engagement?cited by 2
- 2025PolicyEvol-Agent: Evolving Policy via Environment Perception and Self-Awareness with Theory of Mindcited by 1
- 2025Shall We Play a Game? Language Models for Open-ended Wargamescited by 1
- 2025Hybrid Voting-Based Task Assignment in Role-Playing Gamescited by 0
- 2025Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generationcited by 0
- 2026DungeonBench: A Benchmark for Rules-Rich Tactical Reasoning in Dungeons & Dragons Combatcited by 0
- 2026Position: AI Is Not Ready for Strategic Conflictscited by 0
- 2026Position: AI Is Not Ready for Strategic Conflicts31 Jul 2026
- 2026DungeonBench: A Benchmark for Rules-Rich Tactical Reasoning in Dungeons & Dragons Combat31 Jul 2026
- 2025Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generation11 Dec 2025
- 2025Oolong: Evaluating Long Context Reasoning and Aggregation Capabilities4 Nov 2025
- 2025Beyond Survival: Evaluating LLMs in Social Deduction Games with Human-Aligned Strategies13 Oct 2025
- 2025Shall We Play a Game? Language Models for Open-ended Wargames21 Sep 2025
- 2025PolicyEvol-Agent: Evolving Policy via Environment Perception and Self-Awareness with Theory of Mind20 Apr 2025
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar 2025
- 2025Hybrid Voting-Based Task Assignment in Role-Playing Games25 Feb 2025
- 2025Can Large Language Models Capture Video Game Engagement?5 Feb 2025
- 2024GPT for Games: An Updated Scoping Review (2020-2024)1 Nov 2024
- 2024Unbounded: A Generative Infinite Game of Character Life Simulation24 Oct 2024
11 more
- 2024LLM-based multi-agent poetry generation in non-cooperative environments5 Sep 2024
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualization7 Aug 2024
- 2024Unveiling Disparities in Web Task Handling Between Human and Web Agent7 May 2024
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agents28 Apr 2024
- 2024GPT for Games: A Scoping Review (2020-2023)27 Apr 2024
- 2024A Survey on Large Language Model-Based Game Agents2 Apr 2024
- 2024A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges15 Mar 2024
- 2024Large Language Models and Games: A Survey and Roadmap28 Feb 2024
- 2023Assessing Logical Puzzle Solving in Large Language Models: Insights from a Minesweeper Case Study13 Nov 2023
- 2023Skill Check: Some Considerations on the Evaluation of Gamemastering Models for Role-playing Games24 Sep 2023
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug 2023
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2024A Survey on Large Language Model-Based Game Agentscited by 106
- 2024LLM-based multi-agent poetry generation in non-cooperative environmentscited by 15
- 2024Unveiling Disparities in Web Task Handling Between Human and Web Agentcited by 2
- 2025PolicyEvol-Agent: Evolving Policy via Environment Perception and Self-Awareness with Theory of Mindcited by 1
- 2025Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generationcited by 0
- 2025Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generation11 Dec 2025
- 2025PolicyEvol-Agent: Evolving Policy via Environment Perception and Self-Awareness with Theory of Mind20 Apr 2025
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges27 Mar 2025
- 2024LLM-based multi-agent poetry generation in non-cooperative environments5 Sep 2024
- 2024Unveiling Disparities in Web Task Handling Between Human and Web Agent7 May 2024
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agents28 Apr 2024
- 2024A Survey on Large Language Model-Based Game Agents2 Apr 2024
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug 2023
- 2024Large Language Models and Games: A Survey and Roadmapcited by 91
- 2025Oolong: Evaluating Long Context Reasoning and Aggregation Capabilitiescited by 33
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualizationcited by 23
- 2024A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challengescited by 22
- 2023Assessing Logical Puzzle Solving in Large Language Models: Insights from a Minesweeper Case Studycited by 14
- 2024GPT for Games: A Scoping Review (2020-2023)cited by 10
- 2024GPT for Games: An Updated Scoping Review (2020-2024)cited by 10
- 2025Beyond Survival: Evaluating LLMs in Social Deduction Games with Human-Aligned Strategiescited by 9
- 2023Skill Check: Some Considerations on the Evaluation of Gamemastering Models for Role-playing Gamescited by 3
- 2025Can Large Language Models Capture Video Game Engagement?cited by 2
- 2025Shall We Play a Game? Language Models for Open-ended Wargamescited by 1
- 2025Hybrid Voting-Based Task Assignment in Role-Playing Gamescited by 0
12 most cited of 14 All 14 (JSON)
- 2026Position: AI Is Not Ready for Strategic Conflicts31 Jul 2026
- 2026DungeonBench: A Benchmark for Rules-Rich Tactical Reasoning in Dungeons & Dragons Combat31 Jul 2026
- 2025Oolong: Evaluating Long Context Reasoning and Aggregation Capabilities4 Nov 2025
- 2025Beyond Survival: Evaluating LLMs in Social Deduction Games with Human-Aligned Strategies13 Oct 2025
- 2025Shall We Play a Game? Language Models for Open-ended Wargames21 Sep 2025
- 2025Hybrid Voting-Based Task Assignment in Role-Playing Games25 Feb 2025
- 2025Can Large Language Models Capture Video Game Engagement?5 Feb 2025
- 2024GPT for Games: An Updated Scoping Review (2020-2024)1 Nov 2024
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualization7 Aug 2024
- 2024GPT for Games: A Scoping Review (2020-2023)27 Apr 2024
- 2024A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges15 Mar 2024
- 2024Large Language Models and Games: A Survey and Roadmap28 Feb 2024
12 newest of 14 All 14 (JSON)