CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling
On the map: Diffusion models → Video generation
Abstract (arXiv)
Cinematic video generation is challenging for text-to-video diffusion models due to concurrent requirements on multi-shot generation, fine-grained controllability over characters and scenes, and long-form generation across extended temporal horizons. Existing methods rely on customization and retraining to separately address specific requirements, and cannot simultaneously fulfill all the requirements with a unified framework. In this paper, we shed light on the training-free paradigm with the key insight that the difficulty of multi-shot generation arises from a structural bias toward temporal continuity in pretrained video diffusion models, and consequently, propose a unified framework named CineWeaver to achieve reference-controllable multi-shot long-video generation without retraining. We manipulate positional encoding and attention patterns to break temporal continuity during inference to enable clear shot transitions using pretrained video diffusion models. Furthermore, we extend the proposed framework with a shot-routed reference conditioning mechanism for per-shot fine-grained controllability, and develop an anchor memory mechanism to allow long-form generation with consistent global appearance cues. To our best knowledge, CineWeaver is the first unified framework to simultaneously enable long-form, reference-controllable, and multi-shot video generation in a training-free fashion. Experimental results demonstrate that CineWeaver produces high-quality cinematic videos of long durations with consistent identities, stable global appearance, and clear shot transitions. The project page is available at: https://cineweaver.github.io.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 40 of its 54 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
40 of 54 references.
Closest ancestors · 13
Same direction, newest first
- 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers21 Jan
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models15 Aug
- 2025Macro-from-Micro Planning for High-Quality and Parallelized Autoregressive Long Video Generation5 Aug
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformers3 Apr
- 2025LongDiff: Training-Free Long Video Generation in One Go23 Mar
- 2025VACE: All-in-One Video Creation and Editing10 Mar
- 2025MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generation18 Feb
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention29 Jul
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
1 more
Other references · 27
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 166
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
- 2025AI Flow: Perspectives, Scenarios, and Approachescited by 44
- 2024AI Flow at the Network Edgecited by 43
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 33
15 more
- 2023Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Viewscited by 32
- 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 29
- 2025EchoShot: Multi-Shot Portrait Video Generationcited by 28
- 2025Pack and Force Your Memory: Long-form and Consistent Video Generationcited by 26
- 2023VideoDreamer: Customized Multi-Subject Text-to-Video Generation with Disen-Mix Finetuning on Language-Video Foundation Modelscited by 16
- 2025Kaleido: Open-Sourced Multi-Subject Reference Video Generation Modelcited by 16
- 2025TeleWorld: Towards Dynamic Multimodal Synthesis with a 4D World Modelcited by 14
- 2024LiftImage3D: Lifting Any Single Image to 3D Gaussians with Video Generation Priorscited by 11
- 20253DGabSplat: 3D Gabor Splatting for Frequency-adaptive Radiance Field Renderingcited by 10
- 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
- 2026SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generationcited by 9
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
- 2025ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generationcited by 5
- 2026Full-4D: Generating Full-Scope 4D Scenes from a Single-View Videocited by 5
- 2026PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interactioncited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 2
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Imagecited by 2
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Searchcited by 1
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillationcited by 0
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation10 Sep 2026
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Search7 Sep 2026
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image4 Sep 2026
- 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generation27 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generation
- 2025StoryMem: Multi-shot Long Video Storytelling with Memory
- 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence
- 2026ShotPlan: Cinematic Video Generation with Learnable Planning Token
- 2023ControlVideo: Training-free Controllable Text-to-Video Generation
- 2026DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior
- 2025CineScale: Tuning-Free High-Resolution Video Generation
- 2025Captain Cinema: Towards Short Movie Generation