Towards One-step Causal Video Generation via Adversarial Self-Distillation
Not on the map. Why?
Abstract (arXiv)
Recent hybrid video generation models combine autoregressive temporal dynamics with diffusion-based spatial denoising, but their sequential, iterative nature leads to error accumulation and long inference times. In this work, we propose a distillation-based framework for efficient causal video generation that enables high-quality synthesis with extremely limited denoising steps. Our approach builds upon the Distribution Matching Distillation (DMD) framework and proposes a novel Adversarial Self-Distillation (ASD) strategy, which aligns the outputs of the student model's n-step denoising process with its (n+1)-step version at the distribution level. This design provides smoother supervision by bridging small intra-student gaps and more informative guidance by combining teacher knowledge with locally consistent student behavior, substantially improving training stability and generation quality in extremely few-step scenarios (e.g., 1-2 steps). In addition, we present a First-Frame Enhancement (FFE) strategy, which allocates more denoising steps to the initial frames to mitigate error propagation while applying larger skipping steps to later frames. Extensive experiments on VBench demonstrate that our method surpasses state-of-the-art approaches in both one-step and two-step video generation. Notably, our framework produces a single distilled model that flexibly supports multiple inference-step settings, eliminating the need for repeated re-distillation and enabling efficient, high-quality video synthesis.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 54 of its 55 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
54 of 55 references.
References · 54
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Generative Adversarial Networkscited by 5,603
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
38 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023Consistency Modelscited by 1,778
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2023Adversarial Diffusion Distillationcited by 741
- 2022On Distillation of Guided Diffusion Modelscited by 721
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 504
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2023Improved Techniques for Training Consistency Modelscited by 430
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
- 2018The relativistic discriminator: a key element missing from standard GANcited by 234
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
- 2024Autoregressive Video Generation without Vector Quantizationcited by 180
- 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 165
- 2024GameGen-X: Interactive Open-world Game Video Generationcited by 124
- 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillationcited by 115
- 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
- 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
- 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 74
- 2022NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesiscited by 71
- 2025The GAN is dead; long live the GAN! A Modern GAN Baselinecited by 57
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 13.
15 papers.
Sort:
By area:
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
- 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Modelscited by 19
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 13
- 2026Causality in Video Diffusers is Separable from Denoisingcited by 4
- 2025JoyStreamer-Flash: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusioncited by 3
- 2026ChopGrad: Pixel-Wise Losses for Latent Video Diffusion via Truncated Backpropagationcited by 1
- 2026TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generationcited by 1
- 2025DiffusionBrowser: Interactive Diffusion Previews via Multi-Branch Decoderscited by 0
- 2026OSVE: One Step Video Editing with One Step Diffusion Modelscited by 0
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulationcited by 0
- 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generationcited by 0
3 more
- 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillation30 Sep 2026
- 2026Uncertainty-Aware Consistency Distillation for Few-Step Video Generation30 Sep 2026
- 2026UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillation26 Sep 2026
- 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation24 Sep 2026
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation18 Sep 2026
- 2026OSVE: One Step Video Editing with One Step Diffusion Models22 Jul 2026
- 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models28 May 2026
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generation22 May 2026
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation14 May 2026
- 2026TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation16 Apr 2026
- 2026ChopGrad: Pixel-Wise Losses for Latent Video Diffusion via Truncated Backpropagation18 Mar 2026
- 2026Causality in Video Diffusers is Separable from Denoising10 Feb 2026
3 more
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb 2026
- 2025DiffusionBrowser: Interactive Diffusion Previews via Multi-Branch Decoders15 Dec 2025
- 2025JoyStreamer-Flash: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusion12 Dec 2025
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
- 2026ChopGrad: Pixel-Wise Losses for Latent Video Diffusion via Truncated Backpropagationcited by 1
- 2025DiffusionBrowser: Interactive Diffusion Previews via Multi-Branch Decoderscited by 0
- 2026OSVE: One Step Video Editing with One Step Diffusion Modelscited by 0
- 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generationcited by 0
- 2026UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillationcited by 0
- 2026UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillation26 Sep 2026
- 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation24 Sep 2026
- 2026OSVE: One Step Video Editing with One Step Diffusion Models22 Jul 2026
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation14 May 2026
- 2026ChopGrad: Pixel-Wise Losses for Latent Video Diffusion via Truncated Backpropagation18 Mar 2026
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb 2026
- 2025DiffusionBrowser: Interactive Diffusion Previews via Multi-Branch Decoders15 Dec 2025
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 13
- 2026Causality in Video Diffusers is Separable from Denoisingcited by 4
- 2025JoyStreamer-Flash: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusioncited by 3
- 2026TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generationcited by 1
- 2026Uncertainty-Aware Consistency Distillation for Few-Step Video Generationcited by 0
- 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillationcited by 0
- 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillation30 Sep 2026
- 2026Uncertainty-Aware Consistency Distillation for Few-Step Video Generation30 Sep 2026
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generation22 May 2026
- 2026TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation16 Apr 2026
- 2026Causality in Video Diffusers is Separable from Denoising10 Feb 2026
- 2025JoyStreamer-Flash: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusion12 Dec 2025