CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models
On the map: Diffusion models → Video generation
Abstract (arXiv)
Despite significant advances in video synthesis, research into multi-shot video generation remains in its infancy. Even with scaled-up models and massive datasets, the shot transition capabilities remain rudimentary and unstable, largely confining generated videos to single-shot sequences. In this work, we introduce CineTrans, a novel framework for generating coherent multi-shot videos with cinematic, film-style transitions. To facilitate insights into the film editing style, we construct a multi-shot video-text dataset Cine250K with detailed shot annotations. Furthermore, our analysis of existing video diffusion models uncovers a correspondence between attention maps in the diffusion model and shot boundaries, which we leverage to design a mask-based control mechanism that enables transitions at arbitrary positions and transfers effectively in a training-free setting. After fine-tuning on our dataset with the mask mechanism, CineTrans produces cinematic multi-shot sequences while adhering to the film editing style, avoiding unstable transitions or naive concatenations. Finally, we propose specialized evaluation metrics for transition control, temporal consistency and overall quality, and demonstrate through extensive experiments that CineTrans significantly outperforms existing baselines across all criteria.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 53 of its 59 references that are in the map. First posted on arXiv 15 Aug 2025.
Builds on
53 of 59 references.
Closest ancestors · 17
Same direction, newest first
- 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Models12 May
- 2025Mask2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generation25 Mar
- 2025Long Context Tuning for Video Generation13 Mar
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation24 Dec
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence23 Jul
- 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagation29 May
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May
- 2024FlexiFilm: Long Video Generation with Flexible Conditions29 Apr
- 2024VSTAR: Generative Temporal Nursing for Longer Dynamic Video Synthesis20 Mar
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
5 more
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction31 Oct
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
- 2023VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation1 Sep
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation15 Mar
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov
Other references · 36
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
24 more
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2022MAGVIT: Masked Generative Video Transformercited by 346
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
- 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
- 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
- 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 146
- 2025One-Minute Video Generation with Test-Time Trainingcited by 101
- 2023Animate-A-Story: Storytelling with Retrieval-Augmented Video Generationcited by 90
- 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Modelscited by 83
- 2024Vlogger: Make Your Dream A Vlogcited by 70
- 2023Shot2Story: A New Benchmark for Comprehensive Understanding of Multi-shot Videoscited by 54
- 2024Sora as a World Model? A Complete Survey on Text-to-Video Generationcited by 53
- 2024A Survey on Long Video Generation: Challenges, Methods, and Prospectscited by 40
- 2024DreamFactory: Pioneering Multi-Scene Long Video Generation with a Multi-Agent Frameworkcited by 35
- 2024LVD-2M: A Long-take Video Dataset with Temporally Dense Captionscited by 25
- 2023Masked-Attention Diffusion Guidance for Spatially Controlling Text-to-Image Generationcited by 9
Built on by
Citing papers per year: 2025: 5; 2026: 24.
29 papers.
Sort:
By area:
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 36
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 35
- 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 28
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scalingcited by 10
- 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generationcited by 9
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Groundingcited by 8
- 2026InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitionscited by 7
- 2025ShotDirector: Directorially Controllable Multi-Shot Video Generation with Cinematographic Transitionscited by 6
- 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generationcited by 6
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 6
- 2026OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Datacited by 6
17 more
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 6
- 2026Memento: Reconstruct to Remember for Consistent Long Video Generationcited by 5
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasonerscited by 3
- 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generationcited by 2
- 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytellingcited by 1
- 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generationcited by 0
- 2026MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative Controlcited by 0
- 2026ShotPlan: Cinematic Video Generation with Learnable Planning Tokencited by 0
- 2026PersonaShot: Benchmarking Person-Centric Narrative Continuity in Multi-Shot Video Generationcited by 0
- 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generationcited by 0
- 2026PACE: Precise AI Cinematic Expressioncited by 0
- 2026Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generationcited by 0
- 2026Weave Forcing: Compositional Memory Routing for Interactive Long Video Generationcited by 0
- 2026AdSpark: A Large-Scale Dataset and Benchmark for Product-Centric Advertisement Video Generationcited by 0
- 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generationcited by 0
- 2026CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generationcited by 0
- 2026CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generation13 Oct 2026
- 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generation11 Oct 2026
- 2026AdSpark: A Large-Scale Dataset and Benchmark for Product-Centric Advertisement Video Generation7 Oct 2026
- 2026Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation2 Oct 2026
- 2026Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generation29 Sep 2026
- 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytelling28 Sep 2026
- 2026PACE: Precise AI Cinematic Expression17 Sep 2026
- 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation2 Sep 2026
- 2026PersonaShot: Benchmarking Person-Centric Narrative Continuity in Multi-Shot Video Generation17 Aug 2026
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026ShotPlan: Cinematic Video Generation with Learnable Planning Token20 Jul 2026
- 2026MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative Control28 Jun 2026
17 more
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating19 Jun 2026
- 2026Memento: Reconstruct to Remember for Consistent Long Video Generation12 Jun 2026
- 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generation11 Jun 2026
- 2026OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Data11 Jun 2026
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generation8 Jun 2026
- 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation14 May 2026
- 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners14 May 2026
- 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generation14 May 2026
- 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generation26 Apr 2026
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Grounding13 Apr 2026
- 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytelling26 Mar 2026
- 2026InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitions4 Mar 2026
- 2025ShotDirector: Directorially Controllable Multi-Shot Video Generation with Cinematographic Transitions11 Dec 2025
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memory8 Dec 2025
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Framework2 Dec 2025
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narratives23 Oct 2025
- 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scaling23 Oct 2025
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 36
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 35
- 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 28
- 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generationcited by 9
- 2026InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitionscited by 7
- 2025ShotDirector: Directorially Controllable Multi-Shot Video Generation with Cinematographic Transitionscited by 6
- 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generationcited by 6
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 6
- 2026OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Datacited by 6
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 6
- 2026Memento: Reconstruct to Remember for Consistent Long Video Generationcited by 5
12 most cited of 23 All 23 (JSON)
- 2026CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generation13 Oct 2026
- 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generation11 Oct 2026
- 2026AdSpark: A Large-Scale Dataset and Benchmark for Product-Centric Advertisement Video Generation7 Oct 2026
- 2026Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation2 Oct 2026
- 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytelling28 Sep 2026
- 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation2 Sep 2026
- 2026PersonaShot: Benchmarking Person-Centric Narrative Continuity in Multi-Shot Video Generation17 Aug 2026
- 2026ShotPlan: Cinematic Video Generation with Learnable Planning Token20 Jul 2026
- 2026MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative Control28 Jun 2026
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating19 Jun 2026
- 2026Memento: Reconstruct to Remember for Consistent Long Video Generation12 Jun 2026
- 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generation11 Jun 2026
12 newest of 23 All 23 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023Structure and Content-Guided Video Synthesis with Diffusion Models
- 2024TVG: A Training-free Transition Video Generation Method with Diffusion Models
- 2025CineScale: Tuning-Free High-Resolution Video Generation
- 2023LOVECon: Text-driven Training-Free Long Video Editing with ControlNet
- 2022Imagen Video: High Definition Video Generation with Diffusion Models
- 2025Fine-Tuning Open Video Generators for Cinematic Scene Synthesis: A Small-Data Pipeline with LoRA and Wan2.1 I2V
- 2025CineTechBench: A Benchmark for Cinematographic Technique Understanding and Generation
- 2025MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generation