Current World Models Lack a Persistent State Core
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
World models are increasingly regarded as a decisive step toward artificial general intelligence, yet modeling the physical world demands more than rendering convincing frames on demand: it requires an internal world state that keeps evolving over time, decoupled from observation, so that objects endure and events run to their conclusions whether or not a camera is watching, much as the moon holds to its orbit when no one is looking. This requirement is a blind spot of existing benchmarks, which reward surface properties such as fidelity, motion, and camera controllability while never asking whether a generated world keeps evolving once it is unobserved. We introduce WRBench, the first systematic diagnostic benchmark that treats camera motion as an intervention on observability and resolves evaluation into a human-calibrated chain that asks whether the camera executes the requested interaction, whether the scene stays continuous and identifiable while in view, and whether a returning target remains consistent with the event that was set in motion. Across 9,600 videos from 23 models spanning four control paradigms, one finding proves stubborn: current systems maintain the observed world as a tracking shot, resuming a returning target in the state at which it was abandoned rather than advancing the event while it went unseen. Because this failure recurs across control paradigms, model families, and increments of scale, robust world-state evolution does not follow from cleaner imagery, tighter control, richer geometric priors, or sheer parameter count We therefore argue that the stability of the physical state kernel and the consistency of worldlines under viewpoint intervention should become first-class objectives of world-model design, so that a world model captures how the world will unfold rather than how the next frame appears.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 39 of its 47 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
39 of 47 references.
Closest ancestors · 16
Same direction, newest first
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models30 May
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr
- 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar
- 2026Out of Sight, Out of Mind? Evaluating State Evolution in Video World Models13 Mar
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models7 Mar
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
- 2026Advancing Open-source World Models28 Jan
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control8 Jan
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
4 more
Other references · 23
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
11 more
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
- 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74
- 2024TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generationcited by 42
- 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 35
- 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 28
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026MASS: Multiplayer World Models with Authoritative Shared Statecited by 7
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worldscited by 3
- 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
- 2026AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splattingcited by 0
- 2026Persistent Computational State: A Session-Centric Runtime for Generative World Modelscited by 0
- 2026RolloutFaith: Auditing Persistent Internal Interventions in Visual World Modelcited by 0
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Modelscited by 0
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modelingcited by 0
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling1 Oct 2026
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Models29 Sep 2026
- 2026RolloutFaith: Auditing Persistent Internal Interventions in Visual World Model29 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026HarnessEval-W: Agentifying the Evaluation of Visual Worlds17 Aug 2026
- 2026MASS: Multiplayer World Models with Authoritative Shared State6 Aug 2026
- 2026Persistent Computational State: A Session-Centric Runtime for Generative World Models23 Jul 2026
- 2026AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splatting1 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity
- 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World
- 2026World Models' Last Exam in Physics
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
- 2026Beyond Pixel Histories: World Models with Persistent 3D State
- 2026World in World: Explore the World with World Models
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environments