mlsanityData to 14 Oct 2026

CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models

arXiv 2508.11484 ↗First posted 15 Aug 2025cs.CVcited by 29

On the map: Diffusion models → Video generation

Abstract (arXiv)

Despite significant advances in video synthesis, research into multi-shot video generation remains in its infancy. Even with scaled-up models and massive datasets, the shot transition capabilities remain rudimentary and unstable, largely confining generated videos to single-shot sequences. In this work, we introduce CineTrans, a novel framework for generating coherent multi-shot videos with cinematic, film-style transitions. To facilitate insights into the film editing style, we construct a multi-shot video-text dataset Cine250K with detailed shot annotations. Furthermore, our analysis of existing video diffusion models uncovers a correspondence between attention maps in the diffusion model and shot boundaries, which we leverage to design a mask-based control mechanism that enables transitions at arbitrary positions and transfers effectively in a training-free setting. After fine-tuning on our dataset with the mask mechanism, CineTrans produces cinematic multi-shot sequences while adhering to the film editing style, avoiding unstable transitions or naive concatenations. Finally, we propose specialized evaluation metrics for transition control, temporal consistency and overall quality, and demonstrate through extensive experiments that CineTrans significantly outperforms existing baselines across all criteria.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 53 of its 59 references that are in the map. First posted on arXiv 15 Aug 2025.

Builds on

53 of 59 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Models12 May
  2. 2025Mask2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generation25 Mar
  3. 2025Long Context Tuning for Video Generation13 Mar
  4. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation24 Dec
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  6. 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence23 Jul
  7. 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagation29 May
  8. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May
  9. 2024FlexiFilm: Long Video Generation with Flexible Conditions29 Apr
  10. 2024VSTAR: Generative Temporal Nursing for Longer Dynamic Video Synthesis20 Mar
  11. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
5 more
  1. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction31 Oct
  2. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
  3. 2023VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation1 Sep
  4. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation15 Mar
  5. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov

Other references · 36

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  8. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  10. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  11. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  12. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
24 more
  1. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  2. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  3. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  4. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  5. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  6. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  7. 2022MAGVIT: Masked Generative Video Transformercited by 346
  8. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  9. 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
  10. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  11. 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
  12. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  13. 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
  14. 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 146
  15. 2025One-Minute Video Generation with Test-Time Trainingcited by 101
  16. 2023Animate-A-Story: Storytelling with Retrieval-Augmented Video Generationcited by 90
  17. 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Modelscited by 83
  18. 2024Vlogger: Make Your Dream A Vlogcited by 70
  19. 2023Shot2Story: A New Benchmark for Comprehensive Understanding of Multi-shot Videoscited by 54
  20. 2024Sora as a World Model? A Complete Survey on Text-to-Video Generationcited by 53
  21. 2024A Survey on Long Video Generation: Challenges, Methods, and Prospectscited by 40
  22. 2024DreamFactory: Pioneering Multi-Scene Long Video Generation with a Multi-Agent Frameworkcited by 35
  23. 2024LVD-2M: A Long-take Video Dataset with Temporally Dense Captionscited by 25
  24. 2023Masked-Attention Diffusion Guidance for Spatially Controlling Text-to-Image Generationcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 24.

29 papers.

Sort:

By area:

  1. 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
  2. 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 36
  3. 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 35
  4. 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 28
  5. 2025RAPO++: Cross-Stage Prompt Optimization for Text-to-Video Generation via Data Alignment and Test-Time Scalingcited by 10
  6. 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generationcited by 9
  7. 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Groundingcited by 8
  8. 2026InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitionscited by 7
  9. 2025ShotDirector: Directorially Controllable Multi-Shot Video Generation with Cinematographic Transitionscited by 6
  10. 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generationcited by 6
  11. 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generationcited by 6
  12. 2026OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Datacited by 6
17 more
  1. 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 6
  2. 2026Memento: Reconstruct to Remember for Consistent Long Video Generationcited by 5
  3. 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
  4. 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasonerscited by 3
  5. 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generationcited by 2
  6. 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytellingcited by 1
  7. 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generationcited by 0
  8. 2026MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative Controlcited by 0
  9. 2026ShotPlan: Cinematic Video Generation with Learnable Planning Tokencited by 0
  10. 2026PersonaShot: Benchmarking Person-Centric Narrative Continuity in Multi-Shot Video Generationcited by 0
  11. 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generationcited by 0
  12. 2026PACE: Precise AI Cinematic Expressioncited by 0
  13. 2026Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generationcited by 0
  14. 2026Weave Forcing: Compositional Memory Routing for Interactive Long Video Generationcited by 0
  15. 2026AdSpark: A Large-Scale Dataset and Benchmark for Product-Centric Advertisement Video Generationcited by 0
  16. 2026Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generationcited by 0
  17. 2026CineMem: Attention-Aligned Fine-grained Memory Retrieval for Multi-Shot Long Video Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Structure and Content-Guided Video Synthesis with Diffusion Models
  2. 2024TVG: A Training-free Transition Video Generation Method with Diffusion Models
  3. 2025CineScale: Tuning-Free High-Resolution Video Generation
  4. 2023LOVECon: Text-driven Training-Free Long Video Editing with ControlNet
  5. 2022Imagen Video: High Definition Video Generation with Diffusion Models
  6. 2025Fine-Tuning Open Video Generators for Cinematic Scene Synthesis: A Small-Data Pipeline with LoRA and Wan2.1 I2V
  7. 2025CineTechBench: A Benchmark for Cinematographic Technique Understanding and Generation
  8. 2025MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generation