Knowledge Graph-enhanced Large Language Model for Incremental Game PlayTesting
Not on the map. Why?
Abstract (arXiv)
The rapid iteration and frequent updates of modern video games pose significant challenges to the efficiency and specificity of testing. Although automated playtesting methods based on Large Language Models (LLMs) have shown promise, they often lack structured knowledge accumulation mechanisms, making it difficult to conduct precise and efficient testing tailored for incremental game updates. To address this challenge, this paper proposes a KLPEG framework. The framework constructs and maintains a Knowledge Graph (KG) to systematically model game elements, task dependencies, and causal relationships, enabling knowledge accumulation and reuse across versions. Building on this foundation, the framework utilizes LLMs to parse natural language update logs, identify the scope of impact through multi-hop reasoning on the KG, enabling the generation of update-tailored test cases. Experiments in two representative game environments, Overcooked and Minecraft, demonstrate that KLPEG can more accurately locate functionalities affected by updates and complete tests in fewer steps, significantly improving both playtesting effectiveness and efficiency.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 6 of its 22 references that are in the map. First posted on arXiv 4 Nov 2025.
Builds on
6 of 22 references.
References · 6
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023Large Language Modelscited by 774
- 2021Improving Playtesting Coverage via Curiosity Driven Reinforcement Learning Agentscited by 28
- 2019Automated Video Game Testing Using Synthetic and Human-Like Agentscited by 22
- 2021A Survey of Video Game Testingcited by 18
- 2022Large Language Models are Pretty Good Zero-Shot Video Game Bug Detectorscited by 14
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026GUI Agents for Continual Game Generationcited by 16
- 2026GUI Agents for Continual Game Generation27 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Reasoning Capabilities of Large Language Models. Lessons Learned from General Game Playing
- 2024GAMEBoT: Transparent Assessment of LLM Reasoning in Games
- 2024GameArena: Evaluating LLM Reasoning through Live Computer Games
- 2025Game Reasoning Arena: A Framework and Benchmark for Assessing Reasoning Capabilities of Large Language Models via Game Play
- 2023SPRING: Studying the Paper and Reasoning to Play Games
- 2025Baba is LLM: Reasoning in a Game with Dynamic Rules
- 2024GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluations
- 2025GVGAI-LLM: Evaluating Large Language Model Agents with Infinite Games