Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite its significance, there is a scarcity of methods specifically designed for video diffusion models. Prevailing approaches often directly adapt image distillation techniques, which frequently lead to artifacts such as oversaturation, temporal inconsistency, and mode collapse. To address these challenges, we propose a novel distillation framework tailored specifically for video diffusion models. Its core innovations include: (1) an adaptive regression loss that dynamically adjusts spatial supervision weights to prevent artifacts arising from excessive distribution shifts; (2) a temporal regularization loss to counteract temporal collapse, promoting smooth and physically plausible sampling trajectories; and (3) an inference-time frame interpolation strategy that reduces sampling overhead while preserving perceptual quality. Extensive experiments and ablation studies on the VBench and VBench2 benchmarks demonstrate that our method achieves stable few-step video synthesis, significantly enhancing perceptual fidelity and motion realism. It consistently outperforms existing distillation baselines across multiple metrics.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 61 of its 63 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
61 of 63 references.
Closest ancestors · 11
Same direction, newest first
- 2026Streaming Autoregressive Video Generation via Diagonal Distillation10 Mar
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generation2 Oct
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2025Dual-Expert Consistency Model for Efficient and High-Quality Video Generation3 Jun
- 2025Diffusion Adversarial Post-Training for One-Step Video Generation14 Jan
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
- 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Models7 May
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
- 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct
- 2022Video Diffusion Models7 Apr
Other references · 50
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
38 more
- 2023Consistency Modelscited by 1,778
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2023Adversarial Diffusion Distillationcited by 741
- 2022On Distillation of Guided Diffusion Modelscited by 721
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 526
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
- 2016Generating Videos with Scene Dynamicscited by 376
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 232
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
- 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 165
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 153
- 2024Phased Consistency Modelscited by 83
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 81
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 81
- 2024Distilling Diffusion Models into Conditional GANscited by 78
- 2024Multistep Distillation of Diffusion Models via Moment Matchingcited by 76
- 2024One-Step Diffusion Distillation through Score Implicit Matchingcited by 68
- 2024EM Distillation for One-step Diffusion Modelscited by 60
- 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 49
- 2025One-step Diffusion Models with f-Divergence Distribution Matchingcited by 43
- 2025Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesiscited by 39
- 2019Adversarial Video Generation on Complex Datasetscited by 33
- 2024You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANscited by 25
- 2024Truncated Consistency Modelscited by 21
- 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervalscited by 21
- 2025Adding Additional Control to One-Step Diffusion with Joint Distribution Matchingcited by 8
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Modelscited by 23
- 2026DistillAlign: Coordinating Mode Covering and Mode Seeking in Autoregressive Video Distillationcited by 4
- 2026CoDMD: Copula-aware Distribution Matching Distillation for Fast Video Generationcited by 3
- 2026DyMD: Preserving Interaction Dynamics through Distribution Matching Distillation in Few-Step Video World Modelscited by 0
- 2026OneFixer: High-Quality and Consistent One-Step Autoregressive 3DGS Refinement for Driving Scenescited by 0
- 2026PDMD: Projected Distribution Matching Distillation for Video Diffusion Modelscited by 0
- 2026Self-Aligned Forcing: Streaming Video Diffusion with Differentiable Noisy Historycited by 0
- 2026Self-Aligned Forcing: Streaming Video Diffusion with Differentiable Noisy History29 Sep 2026
- 2026PDMD: Projected Distribution Matching Distillation for Video Diffusion Models28 Sep 2026
- 2026OneFixer: High-Quality and Consistent One-Step Autoregressive 3DGS Refinement for Driving Scenes26 Sep 2026
- 2026DyMD: Preserving Interaction Dynamics through Distribution Matching Distillation in Few-Step Video World Models25 Sep 2026
- 2026DistillAlign: Coordinating Mode Covering and Mode Seeking in Autoregressive Video Distillation29 Jul 2026
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun 2026
- 2026CoDMD: Copula-aware Distribution Matching Distillation for Fast Video Generation20 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators
- 2026Efficient Video Diffusion Models: Advancements and Challenges
- 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening
- 2026From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models
- 2026Dynamic-in-Few-Step: Unifying Dynamic Computation and Few-Step Distillation for Efficient Video Generation
- 2024DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization
- 2026Transition Matching Distillation for Fast Video Generation
- 2026Image-to-Video Diffusion: From Foundations to Open Frontiers