World-Time Compute with Verified Code World Models
On the map: World models → World models for language agents
Abstract (arXiv)
LLMs generalize across a domain only after seeing many real, labeled examples, which most domains lack. We study a way to manufacture it cheaply. When a domain's dynamics can be written as code, one template instantiates into many world models: executable, verifiable programs over symbolic state, each an inexhaustible source of exactly-labeled trajectories. Fine-tuning an LLM on trajectories through many such worlds, which we call world-time compute, a training-time analogue of test-time compute, lifts generalization to held-out worlds it never trained on (synthesized world families). Gains are largest where capability is scarcest: +29 points at 0.5B; the largest model's lift is within noise, consistent with saturation. Labels can be trusted because the worlds are verified code: synthesized-then-checked dynamics are exact over 20-step rollouts and answer 10x out-of-distribution probes exactly (100%), whereas per-step LLM and MLP predictors compound error and collapse. Unlike domain randomization, each world is independently authored and verified; a corrupted-label control shows label exactness, not task variety, drives the gains. On real benchmarks (ARC-AGI grids, List Functions, CLRS) the same lever holds as per-world test-time training. On List Functions the harder cross-world form holds: one adapter trained on 128 disjoint worlds reaches 40% on held-out worlds versus 6% for a corrupted-label control (+34 points, CI [29, 39]). The gain is a saturating regularity, not a law: largest for few-step reasoning and small/weak models, fading for long chains, perception-induced tasks, and saturated tasks; cross-task transfer is weak without shared skill. Worlds are authored and served by OpenWorld, a zero-dependency framework (companion paper). Scope: symbolic state; pixel-native domains remain territory of learned models. All code, recipes, and this manuscript regenerate from one repository.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 45 of its 53 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
45 of 53 references.
Closest ancestors · 8
Same direction, newest first
- 2025Code World Models for General Game Playing6 Oct
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Models30 Sep
- 2025What Does it Mean for a Neural Network to Learn a "World Model"?29 Jul
- 2025PoE-World: Compositional World Modeling with Products of Programmatic Experts16 May
- 2025Generating Symbolic World Models via Test-time Scaling of Large Language Models7 Feb
- 2024Evaluating the World Model Implicit in a Generative Model6 Jun
- 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search24 May
- 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb
Other references · 37
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2018World Modelscited by 1,513
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
25 more
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023Reinforced Self-Training (ReST) for Language Modelingcited by 500
- 2019Leveraging Procedural Generation to Benchmark Reinforcement Learningcited by 483
- 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 427
- 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 349
- 2022Transformers are Sample-Efficient World Modelscited by 328
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2025TTRL: Test-Time Reinforcement Learningcited by 275
- 2017Thinking Fast and Slow with Deep Learning and Tree Searchcited by 252
- 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 238
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
- 2021Open-Ended Learning Leads to Generally Capable Agentscited by 182
- 2022The CLRS Algorithmic Reasoning Benchmarkcited by 106
- 2024ARC Prize 2024: Technical Reportcited by 104
- 2024OMNI-EPIC: Open-endedness via Models of human Notions of Interestingness with Environments Programmed in Codecited by 74
- 2025WorldGym: World Model as An Environment for Policy Evaluationcited by 64
- 2024Combining Induction and Transduction for Abstract Reasoningcited by 53
- 2024Efficient World Models with Context-Aware Tokenizationcited by 33
- 2024The CLRS-Text Algorithmic Reasoning Language Benchmarkcited by 28
- 2024Reasoning Limitations of Multimodal Large Language Models. A Case Study of Bongard Problemscited by 15
- 2025Bongard-RWR+: Real-World Representations of Fine-Grained Concepts in Bongard Problemscited by 7
- 2025Moral Anchor System: A Predictive Framework for AI Value Alignment and Drift Preventioncited by 3
- 2025The Specification Trap: Why Static Value Alignment Alone Is Insufficient for Robust Alignmentcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026When a Verified World Model Still Loses: Play-Adequacy vs Prediction-Accuracy in LLM-Synthesized Code World Models
- 2025World Modelling Improves Language Model Agents
- 2026Certified World Models: Predictability Across Configuration, Horizon, and Resolution
- 2026TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agents
- 2026What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling
- 2026LLM-as-a-Verifier: A General-Purpose Verification Framework
- 2025SmallWorlds: Assessing Dynamics Understanding of World Models in Isolated Environments
- 2026Discrete World Models via Regularization