mlsanityData to 7 Oct 2026

DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory

arXiv 2605.31336 ↗First posted 29 May 2026cs.CVcited by 2

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Recent advances in video generative models have promoted rapid progress in controllable world models. However, maintaining fine-grained spatio-temporal consistency under long-horizon reasoning remains a key challenge. In this work, we move beyond explicit 3D memory and coarse frame-level implicit modeling, and propose a fine-grained, learnable, and scalable memory for consistent world generation. We first identify two fundamental limitations of na"ive learnable memory architectures in long-horizon extrapolation, namely computational inefficiency and attention dispersion. Through a systematic analysis of attention dispersion, we propose DecMem, a decoupled memory architecture that employs Sparse Global Memory for efficient fine-grained access to global history and Anchored Local Memory for stable and high-quality extrapolation. Extensive experiments demonstrate that DecMem significantly outperforms current state-of-the-art methods. By ensuring precise and efficient long-term memory and achieving superior extrapolation capabilities, DecMem enables minute-level controllable long video generation with high fidelity and consistency.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 44 of its 57 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

44 of 57 references.

Closest ancestors · 18

Same direction, newest first

  1. 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar
  2. 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models7 Mar
  3. 2026Geometry-Aware Rotary Position Embedding for Consistent Video World Model8 Feb
  4. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  5. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  6. 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
  7. 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
  8. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
  9. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  10. 2025Video World Models with Long-term Spatial Memory5 Jun
  11. 2025VRAG: Learning World Models for Interactive Video Generation28 May
  12. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
6 more
  1. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  2. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  4. 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
  5. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug

Other references · 26

  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  4. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  5. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  6. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  7. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173
  8. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  9. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
  10. 2025Cameras as Relative Positional Encodingcited by 94
  11. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
  12. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
14 more
  1. 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 79
  2. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
  3. 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
  4. 2025Deep Forcing: Training-Free Long Video Generation with Deep Sink and Participative Compressioncited by 72
  5. 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
  6. 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 63
  7. 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulationcited by 36
  8. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
  9. 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 29
  10. 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusioncited by 28
  11. 2025Matrix-Game: Interactive World Foundation Modelcited by 18
  12. 2025Yan: Foundational Interactive Video Generationcited by 15
  13. 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 13
  14. 2025UltraViCo: Breaking Extrapolation Limits in Video Diffusion Transformerscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Long-Context State-Space Video World Models
  2. 2025Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video Generation
  3. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models
  4. 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception
  5. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory
  6. 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
  7. 2026Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistency
  8. 2026DreamWorld: Unified World Modeling in Video Generation