DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Recent advances in video generative models have promoted rapid progress in controllable world models. However, maintaining fine-grained spatio-temporal consistency under long-horizon reasoning remains a key challenge. In this work, we move beyond explicit 3D memory and coarse frame-level implicit modeling, and propose a fine-grained, learnable, and scalable memory for consistent world generation. We first identify two fundamental limitations of na"ive learnable memory architectures in long-horizon extrapolation, namely computational inefficiency and attention dispersion. Through a systematic analysis of attention dispersion, we propose DecMem, a decoupled memory architecture that employs Sparse Global Memory for efficient fine-grained access to global history and Anchored Local Memory for stable and high-quality extrapolation. Extensive experiments demonstrate that DecMem significantly outperforms current state-of-the-art methods. By ensuring precise and efficient long-term memory and achieving superior extrapolation capabilities, DecMem enables minute-level controllable long video generation with high fidelity and consistency.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 44 of its 57 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
44 of 57 references.
Closest ancestors · 18
Same direction, newest first
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar
- 2026LiveWorld: Simulating Out-of-Sight Dynamics in Generative Video World Models7 Mar
- 2026Geometry-Aware Rotary Position Embedding for Consistent Video World Model8 Feb
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model28 Nov
- 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Video World Models with Long-term Spatial Memory5 Jun
- 2025VRAG: Learning World Models for Interactive Video Generation28 May
- 2025MAGI-1: Autoregressive Video Generation at Scale19 May
6 more
- 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraft11 Apr
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2025GameFactory: Creating New Games with Generative Interactive Videos14 Jan
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
Other references · 26
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
- 2025Cameras as Relative Positional Encodingcited by 94
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 92
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
14 more
- 2024The Matrix: Infinite-Horizon World Generation with Real-Time Moving Controlcited by 79
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
- 2025Deep Forcing: Training-Free Long Video Generation with Deep Sink and Participative Compressioncited by 72
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
- 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 63
- 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulationcited by 36
- 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
- 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 29
- 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusioncited by 28
- 2025Matrix-Game: Interactive World Foundation Modelcited by 18
- 2025Yan: Foundational Interactive Video Generationcited by 15
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 13
- 2025UltraViCo: Breaking Extrapolation Limits in Video Diffusion Transformerscited by 12
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Long-Context State-Space Video World Models
- 2025Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video Generation
- 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models
- 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
- 2026Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistency
- 2026DreamWorld: Unified World Modeling in Video Generation