mlsanityData to 14 Oct 2026

Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation

arXiv 2610.03510 ↗First posted 2 Oct 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in autoregressive video generation have improved temporal consistency over extended durations, yet interactive storytelling requires more than continuous scene extension: a new shot may combine characters and backgrounds from different historical shots. Whole prompt retrieval can overlook the distinct reference needs of individual components, while directly combining all historical memories may introduce unrelated visual content. To address these problems, we present Weave Forcing, a training-free framework for compositional memory reuse in interactive long video generation. First, we use an LLM for semantic slot routing to decompose user prompts into character and background descriptions and explicitly select suitable historical references for each component. To isolate the required content, masked memory weaving uses contrasting attention maps conditioned on semantic slots to construct refined semantic masks, selectively exposing relevant tokens from compressed historical KV memories to guide the generation of the current shot. We further introduce coverage adaptive RoPE to adjust temporal offsets and memory retention according to no, partial, or full reference coverage, addressing visual artifacts observed when incomplete historical references are positioned close to the current generation. Extensive experiments demonstrate that Weave Forcing improves cross-shot subject and background consistency while maintaining competitive visual quality and text alignment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 45 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

41 of 45 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023Segment Anythingcited by 8,234
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  11. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  12. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
29 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2019Root Mean Square Layer Normalizationcited by 1,480
  3. 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
  4. 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 832
  5. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  6. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  7. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  8. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  9. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  10. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  11. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  12. 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
  13. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
  14. 2024Autoregressive Video Generation without Vector Quantizationcited by 186
  15. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
  16. 2025Long Context Tuning for Video Generationcited by 113
  17. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
  18. 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
  19. 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
  20. 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 40
  21. 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generationcited by 30
  22. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
  23. 2025EchoShot: Multi-Shot Portrait Video Generationcited by 29
  24. 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 29
  25. 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 28
  26. 2025FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusioncited by 10
  27. 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 10
  28. 2026Echo-Forcing: A Scene Memory Framework for Interactive Long Video Generationcited by 9
  29. 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generationcited by 2

Built on by

Not cited yet.