mlsanityData to 7 Oct 2026

GameGen-Verifier: Parallel Keypoint-Based Verification for LLM-Generated Games via Runtime State Injection

arXiv 2605.07442 ↗First posted 8 May 2026cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

LLM-based game generation promises to turn natural-language specifications into executable games, but progress is limited by the lack of reliable automated verification. Unlike conventional code generation, game correctness is defined over long-horizon interaction: a game may appear correct while violating core mechanics such as state updates, interaction rules, and phase transitions. Existing Agent-as-a-Verifier approaches collapse verification into open-ended gameplay, making verdicts reachability-bound, time-consuming, coverage-limited, and sensitive to the agent's gameplay ability. We present GameGen-Verifier, an automated verification paradigm for LLM-generated games that decomposes a specification into verifiable keypoints and grounds them into independent verification units. Each unit patches the game runtime into a concrete target state, executes a bounded interaction, and judges the outcome against the keypoint assertion. We implement GGV-Harness, a scalable agentic harness providing concurrency management, runtime isolation, and fault recovery. On VeriGame, our dataset of 100 games across seven genres, GameGen-Verifier achieves up to 92.2% accuracy against human judgments versus 58.8% for the coverage-enforced Agent-as-a-Verifier baseline, while reducing wall-clock time by up to 16.6x.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 15 of its 42 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

15 of 42 references.

References · 15

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2021Program Synthesis with Large Language Modelscited by 3,509
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  6. 2021Measuring Coding Challenge Competence With APPScited by 879
  7. 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
  8. 2026MiMo-V2-Flash Technical Reportcited by 163
  9. 2023RLTF: Reinforcement Learning from Unit Test Feedbackcited by 110
  10. 2024Large Language Models and Games: A Survey and Roadmapcited by 91
  11. 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 66
  12. 2024Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Studycited by 40
3 more
  1. 2025UXAgent: An LLM Agent-Based Usability Testing Framework for Web Designcited by 39
  2. 2019Automated Video Game Testing Using Synthetic and Human-Like Agentscited by 22
  3. 2021A Survey of Video Game Testingcited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026GameLogicBench: Evaluating Coding Agents on Runtime Game Logic with Tick-Level State Assertions
  2. 2026OpenGame: Open Agentic Coding for Games
  3. 2026OptiArena: Can LLMs Improve Executable Algorithms under Fixed Resource Budgets?
  4. 2024GAMEBoT: Transparent Assessment of LLM Reasoning in Games
  5. 2026Towards Understanding Specification Gaming in Reasoning Models
  6. 2026Do LLMs Game Formalization? Evaluating Faithfulness in Logical Reasoning
  7. 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core
  8. 2026Distilling Game Code World Model Generation into Lightweight Large Language Models