mlsanityData to 7 Oct 2026

Synergizing Code Coverage and Gameplay Intent: Coverage-Aware Game Playtesting with LLM-Guided Reinforcement Learning

arXiv 2512.12706 ↗First posted 14 Dec 2025cs.AI cs.SEcited by 2

Not on the map. Why?

Abstract (arXiv)

The widespread adoption of the "Games as a Service" model necessitates frequent content updates, placing immense pressure on quality assurance. In response, automated game testing has been viewed as a promising solution to cope with this demanding release cadence. However, existing automated testing approaches typically create a dichotomy: code-centric methods focus on structural coverage without understanding gameplay context, while player-centric agents validate high-level intent but often fail to cover specific underlying code changes. To bridge this gap, we propose SMART (Structural Mapping for Augmented Reinforcement Testing), a novel framework that synergizes structural verification and functional validation for game update testing. SMART leverages large language models (LLMs) to interpret abstract syntax tree (AST) differences and extract functional intent, constructing a context-aware hybrid reward mechanism. This mechanism guides reinforcement learning agents to sequentially fulfill gameplay goals while adaptively exploring modified code branches. We evaluate SMART on two environments, Overcooked and Minecraft. The results demonstrate that SMART significantly outperforms state-of-the-art baselines; it achieves over 94% branch coverage of modified code, nearly double that of traditional reinforcement learning methods, while maintaining a 98% task completion rate, effectively balancing structural comprehensiveness with functional correctness.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 37 references that are in the map. First posted on arXiv 14 Dec 2025.

Builds on

12 of 37 references.

References · 12

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
  3. 2023Large Language Modelscited by 774
  4. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
  5. 2021Augmenting Automated Game Testing with Deep Reinforcement Learningcited by 38
  6. 2018Automated Playtesting with Procedural Personas through MCTS with Evolved Heuristicscited by 28
  7. 2021Improving Playtesting Coverage via Curiosity Driven Reinforcement Learning Agentscited by 28
  8. 2019Automated Video Game Testing Using Synthetic and Human-Like Agentscited by 22
  9. 2022Large Language Models are Pretty Good Zero-Shot Video Game Bug Detectorscited by 14
  10. 2021Playtesting: What is Beyond Personascited by 2
  11. 2020Are the Old Days Gone? A Survey on Actual Software Engineering Processes in Video Game Industrycited by 1
  12. 2024An approach to automated videogame beta testingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.