mlsanityData to 7 Oct 2026

TVG: A Training-free Transition Video Generation Method with Diffusion Models

arXiv 2408.13413 ↗First posted 24 Aug 2024cs.CVcited by 15

On the map: Diffusion models → Video generation

Abstract (arXiv)

Transition videos play a crucial role in media production, enhancing the flow and coherence of visual narratives. Traditional methods like morphing often lack artistic appeal and require specialized skills, limiting their effectiveness. Recent advances in diffusion model-based video generation offer new possibilities for creating transitions but face challenges such as poor inter-frame relationship modeling and abrupt content changes. We propose a novel training-free Transition Video Generation (TVG) approach using video-level diffusion models that addresses these limitations without additional training. Our method leverages Gaussian Process Regression (GPR) to model latent representations, ensuring smooth and dynamic transitions between frames. Additionally, we introduce interpolation-based conditional controls and a Frequency-aware Bidirectional Fusion (FBiF) architecture to enhance temporal control and transition reliability. Evaluations of benchmark datasets and custom image pairs demonstrate the effectiveness of our approach in generating high-quality smooth transition videos. The code are provided in https://sobeymil.github.io/tvg.com.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 38 of its 59 references that are in the map. First posted on arXiv 24 Aug 2024.

Builds on

38 of 59 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024MVOC: a training-free multiple video object composition method with diffusion models22 Jun
  2. 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model22 Jun
  3. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May
  4. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
  5. 2023FreeInit: Bridging Initialization Gap in Video Diffusion Models12 Dec
  6. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction31 Oct
  7. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
  8. 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
  9. 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generation17 Apr
  10. 2022Video Diffusion Models7 Apr

Other references · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2017Neural Discrete Representation Learningcited by 4,650
  9. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  10. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  11. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  12. 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
16 more
  1. 2023FreeU: Free Lunch in Diffusion U-Netcited by 195
  2. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
  3. 2024FiT: Flexible Vision Transformer for Diffusion Modelcited by 84
  4. 2022Fast Vision Transformers with HiLo Attentioncited by 78
  5. 2023Dynamic Prompt Learning: Addressing Cross-Attention Leakage for Text-Based Image Editingcited by 76
  6. 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
  7. 2023DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphingcited by 66
  8. 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Priorcited by 56
  9. 2024Spherical Linear Interpolation and Text-Anchoring for Zero-shot Composed Image Retrievalcited by 44
  10. 2024TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generationcited by 42
  11. 2024Mora: Enabling Generalist Video Generation via A Multi-Agent Frameworkcited by 41
  12. 2023Interpolating between Images with Diffusion Modelscited by 37
  13. 2024FlexiEdit: Frequency-Aware Latent Refinement for Enhanced Non-Rigid Editingcited by 31
  14. 2019Gated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfercited by 17
  15. 2024FRAG: Frequency Adapting Group for Diffusion Video Editingcited by 15
  16. 2023Cartoondiff: Training-free Cartoon Image Generation with Diffusion Transformer Modelscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 7; 2026: 6.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
  2. 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Models
  4. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models
  5. 2024Video Diffusion Models: A Survey
  6. 2023BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Models
  7. 2024JVID: Joint Video-Image Diffusion for Visual-Quality and Temporal-Consistency in Video Generation
  8. 2024Noise Crystallization and Liquid Noise: Zero-shot Video Generation using Image Diffusion Models