mlsanityData to 14 Oct 2026

Fine-Tuning Open Video Generators for Cinematic Scene Synthesis: A Small-Data Pipeline with LoRA and Wan2.1 I2V

arXiv 2510.27364 ↗First posted 31 Oct 2025cs.CV cs.AIcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

We present a practical pipeline for fine-tuning open-source video diffusion transformers to synthesize cinematic scenes for television and film production from small datasets. The proposed two-stage process decouples visual style learning from motion generation. In the first stage, Low-Rank Adaptation (LoRA) modules are integrated into the cross-attention layers of the Wan2.1 I2V-14B model to adapt its visual representations using a compact dataset of short clips from Ay Yapim's historical television film El Turco. This enables efficient domain transfer within hours on a single GPU. In the second stage, the fine-tuned model produces stylistically consistent keyframes that preserve costume, lighting, and color grading, which are then temporally expanded into coherent 720p sequences through the model's video decoder. We further apply lightweight parallelization and sequence partitioning strategies to accelerate inference without quality degradation. Quantitative and qualitative evaluations using FVD, CLIP-SIM, and LPIPS metrics, supported by a small expert user study, demonstrate measurable improvements in cinematic fidelity and temporal stability over the base model. The complete training and inference pipeline is released to support reproducibility and adaptation across cinematic domains.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 8 of its 9 references that are in the map. First posted on arXiv 31 Oct 2025.

Builds on

8 of 9 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
  2. 2023ModelScope Text-to-Video Technical Report12 Aug

Other references · 6

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Can video generation replace cinematographers? Research on the cinematic language of generated video
  2. 2025Captain Cinema: Towards Short Movie Generation
  3. 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models
  4. 2025GigaVideo-1: Advancing Video Generation via Automatic Feedback with 4 GPU-Hours Fine-Tuning
  5. 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesis
  6. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models
  7. 2026ViBe: Ultra-High-Resolution Video Synthesis Born from Pure Images
  8. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning