Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation
Not on the map. Why?
Abstract (arXiv)
Recent advances in autoregressive video generation have improved temporal consistency over extended durations, yet interactive storytelling requires more than continuous scene extension: a new shot may combine characters and backgrounds from different historical shots. Whole prompt retrieval can overlook the distinct reference needs of individual components, while directly combining all historical memories may introduce unrelated visual content. To address these problems, we present Weave Forcing, a training-free framework for compositional memory reuse in interactive long video generation. First, we use an LLM for semantic slot routing to decompose user prompts into character and background descriptions and explicitly select suitable historical references for each component. To isolate the required content, masked memory weaving uses contrasting attention maps conditioned on semantic slots to construct refined semantic masks, selectively exposing relevant tokens from compressed historical KV memories to guide the generation of the current shot. We further introduce coverage adaptive RoPE to adjust temporal offsets and memory retention according to no, partial, or full reference coverage, addressing visual artifacts observed when incomplete historical references are positioned close to the current generation. Extensive experiments demonstrate that Weave Forcing improves cross-shot subject and background consistency while maintaining competitive visual quality and text alignment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 45 references that are in the map. First posted on arXiv 2 Oct 2026.
Builds on
41 of 45 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
29 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
- 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 832
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2024Autoregressive Video Generation without Vector Quantizationcited by 186
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
- 2025Long Context Tuning for Video Generationcited by 113
- 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
- 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 40
- 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generationcited by 30
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
- 2025EchoShot: Multi-Shot Portrait Video Generationcited by 29
- 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 29
- 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 28
- 2025FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusioncited by 10
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 10
- 2026Echo-Forcing: A Scene Memory Framework for Interactive Long Video Generationcited by 9
- 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generationcited by 2
Built on by
Not cited yet.