WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
As video models enable longer and more realistic interactive experiences, maintaining a world consistent with its history becomes essential. This requires both preserving previously observed content and ensuring coherent world evolution over time. World memory is a critical capability to evaluate alongside visual fidelity and video duration. We introduce WorldMemBench, a benchmark for systematically evaluating world memory in video world models. Across 260 test cases, it assesses static memory through the retention of human identity and appearance, object appearance and geometry, and environmental content and geometry, and dynamic memory through event progression and state persistence. Using controlled camera departures and multi-revisit trajectories, the benchmark evaluates static content against fixed initial references and dynamic events against expected state transitions. It combines appearance and geometry metrics with event-specific assessments, and reports video quality and camera-following accuracy as complementary diagnostics. Evaluation of nine representative models shows that strong static retention does not imply reliable dynamic state evolution, while repeated revisits reveal memory degradation beyond the first return. Human studies support the alignment between our automatic evaluations and human judgments. WorldMemBench provides a systematic testbed for diagnosing memory failures and guiding the development of persistent, temporally coherent video worlds.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 32 of its 38 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
32 of 38 references.
Closest ancestors · 19
Same direction, newest first
- 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models27 Aug
- 2026Addressable Memory for Video World Models7 Aug
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug
- 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models30 Jun
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environments25 Jun
- 2026Current World Models Lack a Persistent State Core18 Jun
- 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models30 May
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
7 more
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models7 Mar
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
- 2026Advancing Open-source World Models28 Jan
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
- 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
- 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb
Other references · 13
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 56
1 more
- 2026Infinite Worlds with Versatile Interactionscited by 48
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Video World Models with Long-term Spatial Memory
- 2026OPIS: An Input-Grounded Benchmark for Multi-Object Memory in Video World Models
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models
- 2026World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models
- 2026ReWorld: An Interactive World Model with Long-Horizon Memory
- 2025WorldMem: Long-term Consistent World Simulation with Memory
- 2026Sekai2: From World Exploration to Interactive World Modeling
- 2026WorldKV: Efficient World Memory with World Retrieval and Compression