CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narratives
Not on the map. Why?
Abstract (arXiv)
Autoregressive video generation aims at real-time, open-ended synthesis. Yet, cinematic storytelling is not merely the endless extension of a single scene; it requires progressing through evolving events, viewpoint shifts, and discrete shot boundaries. Existing autoregressive models often struggle in this setting. Trained primarily for short-horizon continuation, they treat long sequences as extended single shots, inevitably suffering from motion stagnation and semantic drift during long rollouts. To bridge this gap, we introduce CausalCine, an interactive autoregressive framework that transforms multi-shot video generation into an online directing process. CausalCine generates causally across shot changes, accepts dynamic prompts on the fly, and reuses context without regenerating previous shots. To achieve this, we first train a causal base model on native multi-shot sequences to learn complex shot transitions prior to acceleration. We then propose Content-Aware Memory Routing (CAMR), which dynamically retrieves historical KV entries according to attention-based relevance scores rather than temporal proximity, preserving cross-shot coherence under bounded active memory. Finally, we distill the causal base model into a few-step generator for real-time interactive generation. Extensive experiments demonstrate that CausalCine significantly outperforms autoregressive baselines and approaches the capability of bidirectional models while unlocking the streaming interactivity of causal generation. Demo available at https://yihao-meng.github.io/CausalCine/
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 59 of its 61 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
59 of 61 references.
References · 59
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024Genie: Generative Interactive Environmentscited by 747
38 more
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 447
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
- 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 245
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2025MoBA: Mixture of Block Attention for Long-Context LLMscited by 198
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
- 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
- 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 123
- 2025Long Context Tuning for Video Generationcited by 113
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
- 2025Mixture of Contexts for Long Video Generationcited by 95
- 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequencecited by 89
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 76
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videoscited by 64
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
- 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
- 2025Captain Cinema: Towards Short Movie Generationcited by 48
- 2025MemFlow: Flowing Adaptive Memory for Consistent and Efficient Long Video Narrativescited by 45
- 2023AutoStory: Generating Diverse Storytelling Images with Minimal Human Effortcited by 38
- 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 36
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 36
- 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 32
- 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 31
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Infinite Worlds with Versatile Interactionscited by 48
- 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Schedulingcited by 5
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Controlcited by 4
- 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuationcited by 1
- 2026ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routingcited by 0
- 2026InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adaptercited by 0
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generationcited by 0
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generationcited by 0
- 2026Weave Forcing: Compositional Memory Routing for Interactive Long Video Generationcited by 0
- 2026CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generationcited by 0
- 2026CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generation13 Oct 2026
- 2026Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation2 Oct 2026
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generation30 Sep 2026
- 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control15 Sep 2026
- 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuation3 Sep 2026
- 2026DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation1 Sep 2026
- 2026InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adapter21 Aug 2026
- 2026ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routing5 Aug 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Scheduling18 Jun 2026