mlsanityData to 14 Oct 2026

CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narratives

arXiv 2605.12496 ↗First posted 12 May 2026cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Autoregressive video generation aims at real-time, open-ended synthesis. Yet, cinematic storytelling is not merely the endless extension of a single scene; it requires progressing through evolving events, viewpoint shifts, and discrete shot boundaries. Existing autoregressive models often struggle in this setting. Trained primarily for short-horizon continuation, they treat long sequences as extended single shots, inevitably suffering from motion stagnation and semantic drift during long rollouts. To bridge this gap, we introduce CausalCine, an interactive autoregressive framework that transforms multi-shot video generation into an online directing process. CausalCine generates causally across shot changes, accepts dynamic prompts on the fly, and reuses context without regenerating previous shots. To achieve this, we first train a causal base model on native multi-shot sequences to learn complex shot transitions prior to acceleration. We then propose Content-Aware Memory Routing (CAMR), which dynamically retrieves historical KV entries according to attention-based relevance scores rather than temporal proximity, preserving cross-shot coherence under bounded active memory. Finally, we distill the causal base model into a few-step generator for real-time interactive generation. Extensive experiments demonstrate that CausalCine significantly outperforms autoregressive baselines and approaches the capability of bidirectional models while unlocking the streaming interactivity of causal generation. Demo available at https://yihao-meng.github.io/CausalCine/

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 59 of its 61 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

59 of 61 references.

References · 59

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  11. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  12. 2024Genie: Generative Interactive Environmentscited by 747
38 more
  1. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  2. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  4. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  5. 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 447
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  7. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  8. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
  9. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
  10. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 245
  11. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  12. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
  13. 2025MoBA: Mixture of Block Attention for Long-Context LLMscited by 198
  14. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
  15. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
  16. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  17. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
  18. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  19. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  20. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
  21. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
  22. 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 123
  23. 2025Long Context Tuning for Video Generationcited by 113
  24. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
  25. 2025Mixture of Contexts for Long Video Generationcited by 95
  26. 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequencecited by 89
  27. 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
  28. 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 76
  29. 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 64
  30. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
  31. 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
  32. 2025Captain Cinema: Towards Short Movie Generationcited by 48
  33. 2025MemFlow: Flowing Adaptive Memory for Consistent and Efficient Long Video Narrativescited by 45
  34. 2023AutoStory: Generating Diverse Storytelling Images with Minimal Human Effortcited by 38
  35. 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 36
  36. 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 36
  37. 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 32
  38. 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.