GameGen-Verifier: Parallel Keypoint-Based Verification for LLM-Generated Games via Runtime State Injection
Not on the map. Why?
Abstract (arXiv)
LLM-based game generation promises to turn natural-language specifications into executable games, but progress is limited by the lack of reliable automated verification. Unlike conventional code generation, game correctness is defined over long-horizon interaction: a game may appear correct while violating core mechanics such as state updates, interaction rules, and phase transitions. Existing Agent-as-a-Verifier approaches collapse verification into open-ended gameplay, making verdicts reachability-bound, time-consuming, coverage-limited, and sensitive to the agent's gameplay ability. We present GameGen-Verifier, an automated verification paradigm for LLM-generated games that decomposes a specification into verifiable keypoints and grounds them into independent verification units. Each unit patches the game runtime into a concrete target state, executes a bounded interaction, and judges the outcome against the keypoint assertion. We implement GGV-Harness, a scalable agentic harness providing concurrency management, runtime isolation, and fault recovery. On VeriGame, our dataset of 100 games across seven genres, GameGen-Verifier achieves up to 92.2% accuracy against human judgments versus 58.8% for the coverage-enforced Agent-as-a-Verifier baseline, while reducing wall-clock time by up to 16.6x.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 15 of its 42 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
15 of 42 references.
References · 15
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
- 2026MiMo-V2-Flash Technical Reportcited by 163
- 2023RLTF: Reinforcement Learning from Unit Test Feedbackcited by 110
- 2024Large Language Models and Games: A Survey and Roadmapcited by 91
- 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 66
- 2024Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Studycited by 40
3 more
- 2025UXAgent: An LLM Agent-Based Usability Testing Framework for Web Designcited by 39
- 2019Automated Video Game Testing Using Synthetic and Human-Like Agentscited by 22
- 2021A Survey of Video Game Testingcited by 18
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?cited by 10
- 2026GameXpert-Bench: How Far Are Coding Agents from Expert Game Development?cited by 6
- 2026The Verifier is the Curriculum: Precision Sets the Return on Search in Code Self-Distillationcited by 2
- 2026AI for Games in the Foundation Model Eracited by 2
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 1
- 2026GameASG-Bench: Benchmarking Autonomous Software Generation for Game Developmentcited by 0
- 2026SWE-Game: Can Coding Agents Build the Games We Want?cited by 0
- 2026RSIGame: Autonomous Agentic Game Development with Recursive Self-improvementcited by 0
- 2026A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications?cited by 0
- 2026A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications?30 Sep 2026
- 2026RSIGame: Autonomous Agentic Game Development with Recursive Self-improvement30 Sep 2026
- 2026SWE-Game: Can Coding Agents Build the Games We Want?27 Sep 2026
- 2026GameASG-Bench: Benchmarking Autonomous Software Generation for Game Development18 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models26 Aug 2026
- 2026GameXpert-Bench: How Far Are Coding Agents from Expert Game Development?22 Aug 2026
- 2026The Verifier is the Curriculum: Precision Sets the Return on Search in Code Self-Distillation23 Jun 2026
- 2026GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?16 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026GameLogicBench: Evaluating Coding Agents on Runtime Game Logic with Tick-Level State Assertions
- 2026OpenGame: Open Agentic Coding for Games
- 2026OptiArena: Can LLMs Improve Executable Algorithms under Fixed Resource Budgets?
- 2024GAMEBoT: Transparent Assessment of LLM Reasoning in Games
- 2026Towards Understanding Specification Gaming in Reasoning Models
- 2026Do LLMs Game Formalization? Evaluating Faithfulness in Logical Reasoning
- 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core
- 2026Distilling Game Code World Model Generation into Lightweight Large Language Models