mlsanityData to 7 Oct 2026

WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory

arXiv 2609.24984 ↗First posted 21 Sep 2026cs.CV cs.AI cs.GRcited by 1

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Video world models enable interactive exploration of dynamic environments, yet struggle to respect prior observations over long horizons and across viewpoints. We present WorldCrafter, a video world model that learns a camera-queryable implicit 3D-aware memory for this purpose. The key insight is to let the requested viewpoint shape how multi-view evidence is compressed into the video generator's limited token budget. Trained jointly with the video generator, a memory encoder and pose-conditioned readout module integrate historical observations into a fixed set of target view-specific tokens before denoising, without explicit depth-based correspondences. By combining this memory with recent temporal context and few-step distillation, WorldCrafter enables streaming scene exploration from a single input image or text prompt. Experiments across static and dynamic scenes show substantial gains in long-horizon consistency and camera-control accuracy while preserving visual quality during minute-scale exploration.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 38 of its 105 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

38 of 105 references.

Closest ancestors · 23

Same direction, newest first

  1. 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models2 Sep
  2. 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory30 Aug
  3. 2026ReWorld: An Interactive World Model with Long-Horizon Memory24 Aug
  4. 2026EchoWM: Open and Enterable Omnimodal World Models24 Aug
  5. 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug
  6. 2026Addressable Memory for Video World Models7 Aug
  7. 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
  8. 2026AlayaWorld: Long-Horizon and Playable Video World Generation7 Jul
  9. 2026Compression and Retrieval: Implicit Memory Retrieval for Video World Models22 Jun
  10. 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
  11. 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
  12. 2026Geometry-Aware Implicit Memory for Video World Models1 Jun
11 more
  1. 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models28 May
  2. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
  3. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  4. 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar
  5. 2026MosaicMem: Hybrid Spatial Memory for Controllable Video World Models17 Mar
  6. 2026MIND: Benchmarking Memory Consistency and Action Control in World Models8 Feb
  7. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  8. 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
  9. 2025Yume: An Interactive World Generation Model23 Jul
  10. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar

Other references · 15

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  3. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  4. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
  5. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
  6. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
  7. 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
  8. 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
  9. 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memorycited by 39
  10. 2026Infinite Worlds with Versatile Interactionscited by 37
  11. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
  12. 2025Pack and Force Your Memory: Long-form and Consistent Video Generationcited by 26
3 more
  1. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 25
  2. 2026WorldKV: Efficient World Memory with World Retrieval and Compressioncited by 14
  3. 2026I3DM: Implicit 3D-aware Memory Retrieval and Injection for Consistent Video Scene Generationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026World in World: Explore the World with World Models
  2. 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modeling
  3. 2026Walking in the Implicit: Interactive World Exploration via Neural Scene Representation
  4. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
  5. 2026Beyond Pixel Histories: World Models with Persistent 3D State
  6. 2025Video World Models with Long-term Spatial Memory
  7. 2026Sekai2: From World Exploration to Interactive World Modeling
  8. 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models