AutoWorldModel-Bench: A State-Centric Benchmark for Automated World-Model Research
On the map: World models → World models for language agents
also in 1 more
Abstract (arXiv)
World modeling is an unsettled field: architectures, training objectives, and state representations interact in complex ways, and no single recipe dominates across environments. This makes it an ideal testbed for AI coding agents acting as autonomous researchers--a setting in which the improvement direction is not specified in advance, unlike the engineering-to-spec tasks that dominate current agent benchmarks. We introduce AutoWorldModel-Bench, a closed-loop benchmark in which frontier coding agents autonomously improve a provided base world model under a fixed compute budget. The benchmark spans eight game environments under a unified structured-state representation--ground-truth entity state extracted from each game and consumed through a shared tensor format--which isolates dynamics modeling from perception and enables minutes-per-run iteration. Across 64 sessions, Codex-5.4 and Claude Opus 4.6 improve their base on a held-out test split in all but one session, with about half (33 of 64) a substantial gain (Delta ≥ +0.10) and the remaining improvements smaller but positive; in 91% of sessions the winning edit is a substantive change to the model or training rather than a hyperparameter tweak. Our benchmark offers a setting in which frontier coding agents can be evaluated on open-ended research rather than engineering-to-spec problems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 15 of its 69 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
15 of 69 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2018World Modelscited by 1,513
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2019Model-Based Reinforcement Learning for Ataricited by 502
- 2019MONet: Unsupervised Scene Decomposition and Representationcited by 392
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
- 2024MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agentscited by 67
- 2025Robin: A multi-agent system for automating scientific discoverycited by 62
- 2025ML-Agent: Reinforcing LLM Agents for Autonomous Machine Learning Engineeringcited by 26
2 more
- 2024ACT-Bench: Towards Action Controllable World Models for Autonomous Drivingcited by 14
- 2024Slot Structured World Modelscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025World-in-World: World Models in a Closed-Loop World
- 2026Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulation
- 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment
- 2025Assessing Adaptive World Models in Machines with Novel Games
- 2026Code World Model: Coding Agent as World Brain