WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Video world models enable interactive exploration of dynamic environments, yet struggle to respect prior observations over long horizons and across viewpoints. We present WorldCrafter, a video world model that learns a camera-queryable implicit 3D-aware memory for this purpose. The key insight is to let the requested viewpoint shape how multi-view evidence is compressed into the video generator's limited token budget. Trained jointly with the video generator, a memory encoder and pose-conditioned readout module integrate historical observations into a fixed set of target view-specific tokens before denoising, without explicit depth-based correspondences. By combining this memory with recent temporal context and few-step distillation, WorldCrafter enables streaming scene exploration from a single input image or text prompt. Experiments across static and dynamic scenes show substantial gains in long-horizon consistency and camera-control accuracy while preserving visual quality during minute-scale exploration.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 38 of its 105 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
38 of 105 references.
Closest ancestors · 23
Same direction, newest first
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models2 Sep
- 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory30 Aug
- 2026ReWorld: An Interactive World Model with Long-Horizon Memory24 Aug
- 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug
- 2026Addressable Memory for Video World Models7 Aug
- 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
- 2026AlayaWorld: Long-Horizon and Playable Video World Generation7 Jul
- 2026Compression and Retrieval: Implicit Memory Retrieval for Video World Models22 Jun
- 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
- 2026Geometry-Aware Implicit Memory for Video World Models1 Jun
11 more
- 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models28 May
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar
- 2026MosaicMem: Hybrid Spatial Memory for Controllable Video World Models17 Mar
- 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
- 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025MAGI-1: Autoregressive Video Generation at Scale19 May
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
Other references · 15
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
- 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memorycited by 39
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
- 2025Pack and Force Your Memory: Long-form and Consistent Video Generationcited by 26
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026LOCI: Spatial Linear Memory for Streaming World Modelscited by 0
- 2026LOCI: Spatial Linear Memory for Streaming World Models30 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026World in World: Explore the World with World Models
- 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modeling
- 2026Walking in the Implicit: Interactive World Exploration via Neural Scene Representation
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
- 2026Beyond Pixel Histories: World Models with Persistent 3D State
- 2025Video World Models with Long-term Spatial Memory
- 2026Sekai2: From World Exploration to Interactive World Modeling
- 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models