TVG: A Training-free Transition Video Generation Method with Diffusion Models
On the map: Diffusion models → Video generation
Abstract (arXiv)
Transition videos play a crucial role in media production, enhancing the flow and coherence of visual narratives. Traditional methods like morphing often lack artistic appeal and require specialized skills, limiting their effectiveness. Recent advances in diffusion model-based video generation offer new possibilities for creating transitions but face challenges such as poor inter-frame relationship modeling and abrupt content changes. We propose a novel training-free Transition Video Generation (TVG) approach using video-level diffusion models that addresses these limitations without additional training. Our method leverages Gaussian Process Regression (GPR) to model latent representations, ensuring smooth and dynamic transitions between frames. Additionally, we introduce interpolation-based conditional controls and a Frequency-aware Bidirectional Fusion (FBiF) architecture to enhance temporal control and transition reliability. Evaluations of benchmark datasets and custom image pairs demonstrate the effectiveness of our approach in generating high-quality smooth transition videos. The code are provided in https://sobeymil.github.io/tvg.com.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 38 of its 59 references that are in the map. First posted on arXiv 24 Aug 2024.
Builds on
38 of 59 references.
Closest ancestors · 10
Same direction, newest first
- 2024MVOC: a training-free multiple video object composition method with diffusion models22 Jun
- 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model22 Jun
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
- 2023FreeInit: Bridging Initialization Gap in Video Diffusion Models12 Dec
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction31 Oct
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
- 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
- 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generation17 Apr
- 2022Video Diffusion Models7 Apr
Other references · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2017Neural Discrete Representation Learningcited by 4,650
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
16 more
- 2023FreeU: Free Lunch in Diffusion U-Netcited by 195
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
- 2024FiT: Flexible Vision Transformer for Diffusion Modelcited by 84
- 2022Fast Vision Transformers with HiLo Attentioncited by 78
- 2023Dynamic Prompt Learning: Addressing Cross-Attention Leakage for Text-Based Image Editingcited by 76
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
- 2023DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphingcited by 66
- 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Priorcited by 56
- 2024Spherical Linear Interpolation and Text-Anchoring for Zero-shot Composed Image Retrievalcited by 44
- 2024TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generationcited by 42
- 2024Mora: Enabling Generalist Video Generation via A Multi-Agent Frameworkcited by 41
- 2023Interpolating between Images with Diffusion Modelscited by 37
- 2024FlexiEdit: Frequency-Aware Latent Refinement for Enhanced Non-Rigid Editingcited by 31
- 2019Gated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfercited by 17
- 2024FRAG: Frequency Adapting Group for Diffusion Video Editingcited by 15
- 2023Cartoondiff: Training-free Cartoon Image Generation with Diffusion Transformer Modelscited by 4
Built on by
Citing papers per year: 2024: 2; 2025: 7; 2026: 6.
15 papers.
Sort:
By area:
- 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 25
- 2024PERSE: Personalized 3D Generative Avatars from A Single Portraitcited by 15
- 2025LRQ-DiT: Log-Rotation Post-Training Quantization of Diffusion Transformers for Image and Video Generationcited by 10
- 2025Versatile Transition Generation with Image-to-Video Diffusioncited by 7
- 2025DiTalker: A Unified DiT-based Framework for High-Quality and Speaking Styles Controllable Portrait Animationcited by 3
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clipscited by 2
- 2025ESA: Energy-Based Shot Assembly Optimization for Automatic Video Editingcited by 2
- 2025Which Way from B to A: The role of embedding geometry in image interpolation for Stable Diffusioncited by 1
- 2026Image-to-Video Diffusion: From Foundations to Open Frontierscited by 1
- 2025GeoMVD: Geometry-Enhanced Multi-View Generation Model Based on Geometric Information Extractioncited by 0
- 2026VC-Bench: Pioneering the Video Connecting Benchmark with a Dataset and Evaluation Metricscited by 0
- 2026Ego-InBetween: Generating Object State Transitions in Ego-Centric Videoscited by 0
3 more
- 2026Inverting the Streaming-Diffusion Bottleneck: Video-Rate MLLM-Conditioned Edit Diffusion on a Consumer GPUcited by 0
- 2026PhysFlow: Physics-Aware Optical Flow for Motion Controllable Video Generationcited by 0
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generationcited by 0
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generation30 Sep 2026
- 2026PhysFlow: Physics-Aware Optical Flow for Motion Controllable Video Generation8 Sep 2026
- 2026Inverting the Streaming-Diffusion Bottleneck: Video-Rate MLLM-Conditioned Edit Diffusion on a Consumer GPU4 Jun 2026
- 2026Image-to-Video Diffusion: From Foundations to Open Frontiers17 May 2026
- 2026Ego-InBetween: Generating Object State Transitions in Ego-Centric Videos20 Apr 2026
- 2026VC-Bench: Pioneering the Video Connecting Benchmark with a Dataset and Evaluation Metrics27 Jan 2026
- 2025Which Way from B to A: The role of embedding geometry in image interpolation for Stable Diffusion16 Nov 2025
- 2025GeoMVD: Geometry-Enhanced Multi-View Generation Model Based on Geometric Information Extraction15 Nov 2025
- 2025ESA: Energy-Based Shot Assembly Optimization for Automatic Video Editing4 Nov 2025
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clips28 Oct 2025
- 2025LRQ-DiT: Log-Rotation Post-Training Quantization of Diffusion Transformers for Image and Video Generation5 Aug 2025
- 2025Versatile Transition Generation with Image-to-Video Diffusion3 Aug 2025
- 2025LRQ-DiT: Log-Rotation Post-Training Quantization of Diffusion Transformers for Image and Video Generationcited by 10
- 2025Versatile Transition Generation with Image-to-Video Diffusioncited by 7
- 2025Which Way from B to A: The role of embedding geometry in image interpolation for Stable Diffusioncited by 1
- 2026Image-to-Video Diffusion: From Foundations to Open Frontierscited by 1
- 2026Image-to-Video Diffusion: From Foundations to Open Frontiers17 May 2026
- 2025Which Way from B to A: The role of embedding geometry in image interpolation for Stable Diffusion16 Nov 2025
- 2025LRQ-DiT: Log-Rotation Post-Training Quantization of Diffusion Transformers for Image and Video Generation5 Aug 2025
- 2025Versatile Transition Generation with Image-to-Video Diffusion3 Aug 2025
- 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 25
- 2024PERSE: Personalized 3D Generative Avatars from A Single Portraitcited by 15
- 2025DiTalker: A Unified DiT-based Framework for High-Quality and Speaking Styles Controllable Portrait Animationcited by 3
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clipscited by 2
- 2025ESA: Energy-Based Shot Assembly Optimization for Automatic Video Editingcited by 2
- 2025GeoMVD: Geometry-Enhanced Multi-View Generation Model Based on Geometric Information Extractioncited by 0
- 2026VC-Bench: Pioneering the Video Connecting Benchmark with a Dataset and Evaluation Metricscited by 0
- 2026Ego-InBetween: Generating Object State Transitions in Ego-Centric Videoscited by 0
- 2026Inverting the Streaming-Diffusion Bottleneck: Video-Rate MLLM-Conditioned Edit Diffusion on a Consumer GPUcited by 0
- 2026PhysFlow: Physics-Aware Optical Flow for Motion Controllable Video Generationcited by 0
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generationcited by 0
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generation30 Sep 2026
- 2026PhysFlow: Physics-Aware Optical Flow for Motion Controllable Video Generation8 Sep 2026
- 2026Inverting the Streaming-Diffusion Bottleneck: Video-Rate MLLM-Conditioned Edit Diffusion on a Consumer GPU4 Jun 2026
- 2026Ego-InBetween: Generating Object State Transitions in Ego-Centric Videos20 Apr 2026
- 2026VC-Bench: Pioneering the Video Connecting Benchmark with a Dataset and Evaluation Metrics27 Jan 2026
- 2025GeoMVD: Geometry-Enhanced Multi-View Generation Model Based on Geometric Information Extraction15 Nov 2025
- 2025ESA: Energy-Based Shot Assembly Optimization for Automatic Video Editing4 Nov 2025
- 2025SAGE: Structure-Aware Generative Video Transitions between Diverse Clips28 Oct 2025
- 2025DiTalker: A Unified DiT-based Framework for High-Quality and Speaking Styles Controllable Portrait Animation29 Jul 2025
- 2024PERSE: Personalized 3D Generative Avatars from A Single Portrait30 Dec 2024
- 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editing17 Nov 2024
Similar, not cited
Close in wording, no citation either way
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
- 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models
- 2022Imagen Video: High Definition Video Generation with Diffusion Models
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models
- 2024Video Diffusion Models: A Survey
- 2023BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Models
- 2024JVID: Joint Video-Image Diffusion for Visual-Quality and Temporal-Consistency in Video Generation
- 2024Noise Crystallization and Liquid Noise: Zero-shot Video Generation using Image Diffusion Models