When a Verified World Model Still Loses: Play-Adequacy vs Prediction-Accuracy in LLM-Synthesized Code World Models
On the map: World models → World models for language agents
Abstract (arXiv)
Large language models can synthesize a game's rules as executable code - a Code World Model (CWM) - which a classical planner then searches over. Such models are typically accepted when they reach high transition accuracy on sampled trajectories. We argue this is the wrong notion of adequacy for planning. We show four things. (1) An LLM-synthesized CWM can pass a sampling gate at 100% transition accuracy and be ≥ 98% state-accurate on the planner's own search distribution, yet lose systematically at play, because the <1% it gets wrong is exactly the pivotal dynamics; the play cost of the omitted rule is 0.091 (seed-clustered 95% CI [0.065,0.117], n=4800). We call this the verified-vs-correct gap, and confirm it end-to-end through the synthesis pipeline. (2) The harm follows a quantitative law, danger=playcost×(1-rarity)N, whose (1-rarity)N gate-miss factor is proven exact and whose play cost is empirically bounded. (3) The failure is not repaired by more data: LLM synthesis behaves as rule translation, not rule inference, and did not infer the omitted rule across models (GPT-5.x) and data regimes (including DAgger and targeted examples). (4) The same mechanism recurs on the belief-inference function of imperfect-information CWMs: we prove a coverage bound (a size-N gate is identifying when Ngtrsim b^dmax), explaining why shallow games such as Kuhn poker show no gap, and hand-construct Beacon, a verified-but-wrong inference function that passes the gate yet loses every game. These results suggest adequacy for planning-oriented world models should be measured on the search distribution or by play directly, not by prediction accuracy on sampled transitions.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 2 of its 26 references that are in the map. First posted on arXiv 15 Jul 2026.
Builds on
2 of 26 references.
References · 2
- 2020Objective Mismatch in Model-based Reinforcement Learningcited by 96
- 2014Solving Large Imperfect Information Games Using CFR+cited by 78
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Code World Models for General Game Playing
- 2026Distilling Game Code World Model Generation into Lightweight Large Language Models
- 2026Code World Models for Parameter Control in Evolutionary Algorithms
- 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search
- 2026Evaluating Large Language Models as Live Strategic Agents: Provider Performance, Hybrid Decomposition, and Operational Gaps in Timed Risk Play
- 2026World-Time Compute with Verified Code World Models
- 2024Evaluating the World Model Implicit in a Generative Model
- 2026OptiArena: Can LLMs Improve Executable Algorithms under Fixed Resource Budgets?