mlsanityData to 7 Oct 2026

VideoMemory: Toward Consistent Video Generation via Memory Integration

arXiv 2601.03655 ↗First posted 7 Jan 2026cs.CVcited by 22

Not on the map. Why?

Abstract (arXiv)

Maintaining consistent characters, props, and environments across multiple shots is a central challenge in narrative video generation. Existing models can produce high-quality short clips but often fail to preserve entity identity and appearance when scenes change or when entities reappear after long temporal gaps. We present VideoMemory, an entity-centric framework that integrates narrative planning with visual generation through a Dynamic Memory Bank. Given a structured script, a multi-agent system decomposes the narrative into shots, retrieves entity representations from memory, and synthesizes keyframes and videos conditioned on these retrieved states. The Dynamic Memory Bank stores explicit visual and semantic descriptors for characters, props, and backgrounds, and is updated after each shot to reflect story-driven changes while preserving identity. This retrieval-update mechanism enables consistent portrayal of entities across distant shots and supports coherent long-form generation. To evaluate this setting, we construct a 54-case multi-shot consistency benchmark covering character-, prop-, and background-persistent scenarios. Extensive experiments show that VideoMemory achieves strong entity-level coherence and high perceptual quality across diverse narrative sequences.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 7 Jan 2026.

Builds on

31 of 37 references.

References · 31

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  6. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  7. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
  8. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  9. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  10. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  11. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 209
  12. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
19 more
  1. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
  2. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  3. 2024In-Context LoRA for Diffusion Transformerscited by 155
  4. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
  5. 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
  6. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
  7. 2025Video World Models with Long-term Spatial Memorycited by 124
  8. 2025Long Context Tuning for Video Generationcited by 110
  9. 2025One-Minute Video Generation with Test-Time Trainingcited by 100
  10. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
  11. 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 63
  12. 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 62
  13. 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
  14. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
  15. 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Modelscited by 37
  16. 2025EchoShot: Multi-Shot Portrait Video Generationcited by 28
  17. 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generationcited by 28
  18. 2024ROICtrl: Boosting Instance Control for Visual Generationcited by 9
  19. 2025STORYANCHORS: Generating Consistent Multi-Scene Story Frames for Long-Form Narrativescited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 22.

22 papers.

Sort:

By area:

  1. 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusioncited by 28
  2. 2026ViMax: Agentic Video Generationcited by 11
  3. 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistencycited by 6
  4. 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generationcited by 6
  5. 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneitycited by 5
  6. 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memorycited by 5
  7. 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 4
  8. 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Schedulingcited by 4
  9. 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 4
  10. 2026CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboardingcited by 3
  11. 2026WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interactioncited by 3
  12. 2026FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modelingcited by 2
10 more
  1. 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 2
  2. 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generationcited by 1
  3. 2026SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generationcited by 1
  4. 2026Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectificationcited by 1
  5. 2026SEAM: Shot Entity-Attribute Memory for Consistent Short-Drama Generation at Scalecited by 1
  6. 2026FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Productioncited by 0
  7. 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generationcited by 0
  8. 2026Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generationcited by 0
  9. 2026DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistencycited by 0
  10. 2026Memory-Guided B-Roll Generation from User Video Collectionscited by 0