mlsanityData to 7 Oct 2026

Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation

arXiv 2603.21864 ↗First posted 23 Mar 2026cs.CV cs.AIcited by 7

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite its significance, there is a scarcity of methods specifically designed for video diffusion models. Prevailing approaches often directly adapt image distillation techniques, which frequently lead to artifacts such as oversaturation, temporal inconsistency, and mode collapse. To address these challenges, we propose a novel distillation framework tailored specifically for video diffusion models. Its core innovations include: (1) an adaptive regression loss that dynamically adjusts spatial supervision weights to prevent artifacts arising from excessive distribution shifts; (2) a temporal regularization loss to counteract temporal collapse, promoting smooth and physically plausible sampling trajectories; and (3) an inference-time frame interpolation strategy that reduces sampling overhead while preserving perceptual quality. Extensive experiments and ablation studies on the VBench and VBench2 benchmarks demonstrate that our method achieves stable few-step video synthesis, significantly enhancing perceptual fidelity and motion realism. It consistently outperforms existing distillation baselines across multiple metrics.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 61 of its 63 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

61 of 63 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026Streaming Autoregressive Video Generation via Diagonal Distillation10 Mar
  2. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generation2 Oct
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
  4. 2025Dual-Expert Consistency Model for Efficient and High-Quality Video Generation3 Jun
  5. 2025Diffusion Adversarial Post-Training for One-Step Video Generation14 Jan
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
  7. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Models7 May
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  9. 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
  10. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
  11. 2022Video Diffusion Models7 Apr

Other references · 50

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  10. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  11. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  12. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
38 more
  1. 2023Consistency Modelscited by 1,778
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  5. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  6. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  7. 2023Adversarial Diffusion Distillationcited by 741
  8. 2022On Distillation of Guided Diffusion Modelscited by 721
  9. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  10. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  11. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 526
  12. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  13. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
  14. 2016Generating Videos with Scene Dynamicscited by 376
  15. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  16. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
  17. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
  18. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
  19. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  20. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
  21. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
  22. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 165
  23. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 153
  24. 2024Phased Consistency Modelscited by 83
  25. 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 81
  26. 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 81
  27. 2024Distilling Diffusion Models into Conditional GANscited by 78
  28. 2024Multistep Distillation of Diffusion Models via Moment Matchingcited by 76
  29. 2024One-Step Diffusion Distillation through Score Implicit Matchingcited by 68
  30. 2024EM Distillation for One-step Diffusion Modelscited by 60
  31. 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 49
  32. 2025One-step Diffusion Models with f-Divergence Distribution Matchingcited by 43
  33. 2025Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesiscited by 39
  34. 2019Adversarial Video Generation on Complex Datasetscited by 33
  35. 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANscited by 25
  36. 2024Truncated Consistency Modelscited by 21
  37. 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervalscited by 21
  38. 2025Adding Additional Control to One-Step Diffusion with Joint Distribution Matchingcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators
  2. 2026Efficient Video Diffusion Models: Advancements and Challenges
  3. 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening
  4. 2026From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models
  5. 2026Dynamic-in-Few-Step: Unifying Dynamic Computation and Few-Step Distillation for Efficient Video Generation
  6. 2024DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization
  7. 2026Transition Matching Distillation for Fast Video Generation
  8. 2026Image-to-Video Diffusion: From Foundations to Open Frontiers