mlsanityData to 7 Oct 2026

A Survey of Video Game Testing

arXiv 2103.06431 ↗First posted 11 Mar 2021cs.SEcited by 18

Not on the map. Why?

Abstract (arXiv)

Video-game projects are notorious for having day-one bugs, no matter how big their budget or team size. The quality of a game is essential for its success. This quality could be assessed and ensured through testing. However, to the best of our knowledge, little is known about video-game testing. In this paper, we want to understand how game developers perform game testing. We investigate, through a survey, the academic and gray literature to identify and report on existing testing processes and how they could automate them. We found that game developers rely, almost exclusively, upon manual play-testing and the testers' intrinsic knowledge. We conclude that current testing processes fall short because of their lack of automation, which seems to be the natural next step to improve the quality of games while maintaining costs. However, the current game-testing techniques may not generalize to different types of games.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Mar 2021.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 2; 2024: 4; 2025: 4; 2026: 3.

18 papers.

Sort:

By area:

  1. 2022CLIP meets GamePhysics: Towards bug identification in gameplay videos using zero-shot transfer learningcited by 15
  2. 2022Large Language Models are Pretty Good Zero-Shot Video Game Bug Detectorscited by 14
  3. 2023Games for Artificial Intelligence Research: A Review and Perspectivescited by 14
  4. 2026GameGen-Verifier: Parallel Keypoint-Based Verification for LLM-Generated Games via Runtime State Injectioncited by 9
  5. 2022Inspector: Pixel-Based Automated Game Testing via Exploration, Detection, and Investigationcited by 7
  6. 2022Learning to Identify Perceptual Bugs in 3D Video Gamescited by 5
  7. 2024LLMs May Not Be Human-Level Players, But They Can Be Testers: Measuring Game Difficulty with LLM Agentscited by 5
  8. 2024Robust Imitation Learning for Automated Game Testingcited by 4
  9. 2025Agents in the Sandbox: End-to-End Crash Bug Reproduction for Minecraftcited by 4
  10. 2025Leveraging LLM Agents for Automated Video Game Testingcited by 4
  11. 2022Go-Explore Complex 3D Game Environments for Automated Reachability Testingcited by 3
  12. 2023Preference-conditioned Pixel-based AI Agent For Game Testingcited by 3
6 more
  1. 2024Level Up Your Tutorials: VLMs for Game Tutorials Quality Assessmentcited by 3
  2. 2025Human-AI Collaborative Game Testing with Vision Language Modelscited by 1
  3. 2025Knowledge Graph-enhanced Large Language Model for Incremental Game PlayTestingcited by 1
  4. 2024Combining Neuroevolution with the Search for Novelty to Improve the Generation of Test Inputs for Gamescited by 0
  5. 2026CA2: Code-Aware Agent for Automated Game Testingcited by 0
  6. 2026TempGlitch: Evaluating Vision-Language Models for Temporal Glitch Detection in Gameplay Videoscited by 0