mlsanityData to 7 Oct 2026

Current World Models Lack a Persistent State Core

arXiv 2606.20545 ↗First posted 18 Jun 2026cs.CVcited by 8

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

World models are increasingly regarded as a decisive step toward artificial general intelligence, yet modeling the physical world demands more than rendering convincing frames on demand: it requires an internal world state that keeps evolving over time, decoupled from observation, so that objects endure and events run to their conclusions whether or not a camera is watching, much as the moon holds to its orbit when no one is looking. This requirement is a blind spot of existing benchmarks, which reward surface properties such as fidelity, motion, and camera controllability while never asking whether a generated world keeps evolving once it is unobserved. We introduce WRBench, the first systematic diagnostic benchmark that treats camera motion as an intervention on observability and resolves evaluation into a human-calibrated chain that asks whether the camera executes the requested interaction, whether the scene stays continuous and identifiable while in view, and whether a returning target remains consistent with the event that was set in motion. Across 9,600 videos from 23 models spanning four control paradigms, one finding proves stubborn: current systems maintain the observed world as a tracking shot, resuming a returning target in the state at which it was abandoned rather than advancing the event while it went unseen. Because this failure recurs across control paradigms, model families, and increments of scale, robust world-state evolution does not follow from cleaner imagery, tighter control, richer geometric priors, or sheer parameter count We therefore argue that the stability of the physical state kernel and the consistency of worldlines under viewpoint intervention should become first-class objectives of world-model design, so that a world model captures how the world will unfold rather than how the next frame appears.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 39 of its 47 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

39 of 47 references.

Closest ancestors · 16

Same direction, newest first

  1. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models30 May
  2. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
  3. 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May
  4. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr
  5. 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling8 Apr
  6. 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar
  7. 2026Out of Sight, Out of Mind? Evaluating State Evolution in Video World Models13 Mar
  8. 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models7 Mar
  9. 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
  10. 2026Advancing Open-source World Models28 Jan
  11. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control8 Jan
  12. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
4 more
  1. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  3. 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
  4. 2024Genie: Generative Interactive Environments23 Feb

Other references · 23

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  3. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  4. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  5. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  6. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  7. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  8. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  9. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  10. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  11. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  12. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
11 more
  1. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
  2. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  3. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  4. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
  5. 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
  6. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
  7. 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74
  8. 2024TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generationcited by 42
  9. 2025T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generationcited by 35
  10. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
  11. 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 28

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models
  2. 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity
  3. 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World
  4. 2026World Models' Last Exam in Physics
  5. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
  6. 2026Beyond Pixel Histories: World Models with Persistent 3D State
  7. 2026World in World: Explore the World with World Models
  8. 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environments