VideoMemory: Toward Consistent Video Generation via Memory Integration
Not on the map. Why?
Abstract (arXiv)
Maintaining consistent characters, props, and environments across multiple shots is a central challenge in narrative video generation. Existing models can produce high-quality short clips but often fail to preserve entity identity and appearance when scenes change or when entities reappear after long temporal gaps. We present VideoMemory, an entity-centric framework that integrates narrative planning with visual generation through a Dynamic Memory Bank. Given a structured script, a multi-agent system decomposes the narrative into shots, retrieves entity representations from memory, and synthesizes keyframes and videos conditioned on these retrieved states. The Dynamic Memory Bank stores explicit visual and semantic descriptors for characters, props, and backgrounds, and is updated after each shot to reflect story-driven changes while preserving identity. This retrieval-update mechanism enables consistent portrayal of entities across distant shots and supports coherent long-form generation. To evaluate this setting, we construct a 54-case multi-shot consistency benchmark covering character-, prop-, and background-persistent scenarios. Extensive experiments show that VideoMemory achieves strong entity-level coherence and high perceptual quality across diverse narrative sequences.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
31 of 37 references.
References · 31
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 209
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
19 more
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
- 2024In-Context LoRA for Diffusion Transformerscited by 155
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 138
- 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
- 2025Video World Models with Long-term Spatial Memorycited by 124
- 2025Long Context Tuning for Video Generationcited by 110
- 2025One-Minute Video Generation with Test-Time Trainingcited by 100
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 82
- 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 63
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 62
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
- 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Modelscited by 37
- 2025EchoShot: Multi-Shot Portrait Video Generationcited by 28
- 2025FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generationcited by 28
- 2024ROICtrl: Boosting Instance Control for Visual Generationcited by 9
- 2025STORYANCHORS: Generating Consistent Multi-Scene Story Frames for Long-Form Narrativescited by 9
Built on by
Citing papers per year: 2026: 22.
22 papers.
Sort:
By area:
- 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusioncited by 28
- 2026ViMax: Agentic Video Generationcited by 11
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistencycited by 6
- 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generationcited by 6
- 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneitycited by 5
- 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memorycited by 5
- 2026Echo-Memory: A Controlled Study of Memory in Action World Modelscited by 4
- 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Schedulingcited by 4
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 4
- 2026CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboardingcited by 3
- 2026WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interactioncited by 3
- 2026FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modelingcited by 2
10 more
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 2
- 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generationcited by 1
- 2026SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generationcited by 1
- 2026Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectificationcited by 1
- 2026SEAM: Shot Entity-Attribute Memory for Consistent Short-Drama Generation at Scalecited by 1
- 2026FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Productioncited by 0
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generationcited by 0
- 2026Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generationcited by 0
- 2026DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistencycited by 0
- 2026Memory-Guided B-Roll Generation from User Video Collectionscited by 0
- 2026Memory-Guided B-Roll Generation from User Video Collections1 Oct 2026
- 2026DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistency30 Sep 2026
- 2026Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generation29 Sep 2026
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation1 Sep 2026
- 2026FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production30 Aug 2026
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generation27 Aug 2026
- 2026SEAM: Shot Entity-Attribute Memory for Consistent Short-Drama Generation at Scale24 Aug 2026
- 2026Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectification6 Aug 2026
- 2026FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic World Modeling21 Jul 2026
- 2026SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generation17 Jul 2026
- 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation15 Jul 2026
- 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memory26 Jun 2026
10 more
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating19 Jun 2026
- 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Scheduling18 Jun 2026
- 2026Echo-Memory: A Controlled Study of Memory in Action World Models8 Jun 2026
- 2026ViMax: Agentic Video Generation2 Jun 2026
- 2026WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction28 May 2026
- 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation14 May 2026
- 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneity14 May 2026
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency7 May 2026
- 2026CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding15 Apr 2026
- 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusion8 Feb 2026
- 2026ViMax: Agentic Video Generationcited by 11
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistencycited by 6
- 2026CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboardingcited by 3
- 2026FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Productioncited by 0
- 2026FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production30 Aug 2026
- 2026ViMax: Agentic Video Generation2 Jun 2026
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency7 May 2026
- 2026CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding15 Apr 2026
- 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusioncited by 28
- 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneitycited by 5
- 2026Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectificationcited by 1
- 2026DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistencycited by 0
- 2026DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistency30 Sep 2026
- 2026Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectification6 Aug 2026
- 2026Head Forcing: Long Autoregressive Video Generation via Head Heterogeneity14 May 2026
- 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusion8 Feb 2026
- 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generationcited by 6
- 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Schedulingcited by 4
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 4
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 2
- 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generationcited by 1
- 2026SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generationcited by 1
- 2026SEAM: Shot Entity-Attribute Memory for Consistent Short-Drama Generation at Scalecited by 1
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generationcited by 0
- 2026Memory-Guided B-Roll Generation from User Video Collectionscited by 0
- 2026Memory-Guided B-Roll Generation from User Video Collections1 Oct 2026
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation1 Sep 2026
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generation27 Aug 2026
- 2026SEAM: Shot Entity-Attribute Memory for Consistent Short-Drama Generation at Scale24 Aug 2026
- 2026SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generation17 Jul 2026
- 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation15 Jul 2026
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating19 Jun 2026
- 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Scheduling18 Jun 2026
- 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation14 May 2026