mlsanityData to 7 Oct 2026

Knowledge-Conditioned, Single-Pass LLM Synthesis of Executable Unity Game Scenes: A Compiler Error Census across 26 Goal Playable Concepts

arXiv 2607.10187 ↗First posted 11 Jul 2026cs.LG cs.SEcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) write Unity C# for game scenes. Yet nearly all demonstrations rest on an iterative repair loop that regenerates code until it compiles, conflating what the model writes with what the loop fixes. We remove the loop and evaluate a single pass, where the first draft is final. This isolates the model's parametric knowledge, the most stringent test of unaided generation. Models instantiate Goal Playable Concepts, playable counterparts of goal patterns, across 10,400 generations (four open-weight models, 7B--30B; two generation modes; four intermediate-representation (IR) conditioning levels; 26 goal patterns; 20 seeds). None compiled into a runnable scene, leaving no survivorship bias. To understand how the generated C# scripts fail, we categorize the 99 error codes behind 90,673 compiler-error occurrences as Grounding (invented or misused Unity types and APIs) or Hygiene (structural defects needing no Unity knowledge). The split differs sharply by goal pattern (e.g., Stealth fails mostly on invented engine references; Capture on plain C# structure). Larger models, stricter IRs, and different generation modes move the errors but never yield a compiling scene. The bottleneck is missing engine-specific knowledge. The census orders goal patterns by that demand, showing designers where single-pass generation breaks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 47 references that are in the map. First posted on arXiv 11 Jul 2026.

Builds on

19 of 47 references.

References · 19

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2021Program Synthesis with Large Language Modelscited by 3,509
  4. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  5. 2024A Survey on Large Language Models for Code Generationcited by 646
  6. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 325
  7. 2022DocPrompting: Generating Code by Retrieving the Docscited by 151
  8. 2017Procedural Content Generation via Machine Learning (PCGML)cited by 136
  9. 2023Self-planning Code Generation with Large Language Modelscited by 121
  10. 2024Large Language Models and Games: A Survey and Roadmapcited by 91
  11. 2023Level Generation Through Large Language Modelscited by 68
  12. 2025JSONSchemaBench: A Rigorous Benchmark of Structured Outputs for Language Modelscited by 66
7 more
  1. 2023MarioGPT: Open-Ended Text2Level Generation through Large Language Modelscited by 63
  2. 2024Bugs in Large Language Models Generated Code: An Empirical Studycited by 59
  3. 2023Grammar Prompting for Domain-Specific Language Generation with Large Language Modelscited by 58
  4. 2024What's Wrong with Your Code Generated by Large Language Models? An Extensive Studycited by 52
  5. 2018General Video Game AI: a Multi-Track Framework for Evaluating Agents, Games and Content Generation Algorithmscited by 45
  6. 2025Beyond Synthetic Benchmarks: Evaluating LLM Performance on Real-World Class-Level Code Generationcited by 8
  7. 2026Mage: Multi-Axis Evaluation of LLM-Generated Executable Game Scenes Beyond Compile-Pass Ratecited by 4

Built on by

Not cited yet.