SlotMemory: Object-Centric KV Memory for Streaming Long-Video Generation
Not on the map. Why?
Abstract (arXiv)
Streaming video generation models typically rely on temporal-centric memory, which organizes historical context as raw frames, chunk segments, or unclustered tokens. This organization frequently leads to identity drift and semantic inconsistency when entities exit the frame or during interactive prompt transitions. To address these limitations, we propose SlotMemory, an object-centric Key-Value memory mechanism for streaming video diffusion. Our approach shifts the memory abstraction from "when" an event occurred to "what" is being represented by decomposing the transformer's key-value manifold into discrete, reusable semantic slots. By utilizing these slots as routing addresses to index and store high-fidelity key-value tokens, we enable entity-level persistence and prompt-aware retrieval across long horizons. Evaluated on 60-second interactive narratives using the Wan2.1-T2V-1.3B backbone, SlotMemory achieves a state-of-the-art quality score of 81.61 and a 22.8 percent relative improvement in dynamic consistency over the strongest existing streaming baseline. Our results demonstrate that structured semantic representation, rather than raw temporal capacity, is the essential primitive for persistent long-form video synthesis. Our codes and checkpoints are available at https://tj12323.github.io/SlotMemory/.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
27 of 41 references.
References · 27
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 441
- 2019MONet: Unsupervised Scene Decomposition and Representationcited by 388
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
15 more
- 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
- 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
- 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
- 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Modelscited by 42
- 2025MemFlow: Flowing Adaptive Memory for Consistent and Efficient Long Video Narrativescited by 40
- 2024Temporally Consistent Object-Centric Learning by Contrasting Slotscited by 30
- 2023DORSal: Diffusion for Object-centric Representations of Scenes et alcited by 16
- 2025InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPOcited by 15
- 2026Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusioncited by 14
- 2024Explicitly Disentangled Representations in Object-Centric Learningcited by 4
- 2023DynaVol: Unsupervised Learning for Dynamic Scenes through Object-Centric Voxelizationcited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memorycited by 5
- 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Modelscited by 2
- 2026LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generationcited by 2
- 2026Compress to Remember: Learning Compact Memory via On-Policy Distillation for Long Video Generationcited by 0
- 2026DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistencycited by 0
- 2026DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistency30 Sep 2026
- 2026Compress to Remember: Learning Compact Memory via On-Policy Distillation for Long Video Generation28 Sep 2026
- 2026LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generation28 Aug 2026
- 2026R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models27 Aug 2026
- 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memory26 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026MEMO: Multi-Level Entity-Aware Memory for Streaming Video Understanding
- 2026MemEvo: Automatic Discovery of Streaming Video Memory Mechanisms
- 2026Advancing Narrative Long Video Generation via Training-Free Identity-Aware Memory
- 2025Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video Generation
- 2025StreamMem: Query-Agnostic KV Cache Memory for Streaming Video Understanding
- 2026KeyRec: Bounded Visual Memory for Streaming and Long-Video Understanding
- 2026ProtoKV: Streaming Video Understanding under Delayed Query with Summary-State Memory
- 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memory