mlsanityData to 7 Oct 2026

Towards One-step Causal Video Generation via Adversarial Self-Distillation

arXiv 2511.01419 ↗First posted 3 Nov 2025cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

Recent hybrid video generation models combine autoregressive temporal dynamics with diffusion-based spatial denoising, but their sequential, iterative nature leads to error accumulation and long inference times. In this work, we propose a distillation-based framework for efficient causal video generation that enables high-quality synthesis with extremely limited denoising steps. Our approach builds upon the Distribution Matching Distillation (DMD) framework and proposes a novel Adversarial Self-Distillation (ASD) strategy, which aligns the outputs of the student model's n-step denoising process with its (n+1)-step version at the distribution level. This design provides smoother supervision by bridging small intra-student gaps and more informative guidance by combining teacher knowledge with locally consistent student behavior, substantially improving training stability and generation quality in extremely few-step scenarios (e.g., 1-2 steps). In addition, we present a First-Frame Enhancement (FFE) strategy, which allocates more denoising steps to the initial frames to mitigate error propagation while applying larger skipping steps to later frames. Extensive experiments on VBench demonstrate that our method surpasses state-of-the-art approaches in both one-step and two-step video generation. Notably, our framework produces a single distilled model that flexibly supports multiple inference-step settings, eliminating the need for repeated re-distillation and enabling efficient, high-quality video synthesis.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 54 of its 55 references that are in the map. First posted on arXiv 3 Nov 2025.

Builds on

54 of 55 references.

References · 54

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
38 more
  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  3. 2022Video Diffusion Modelscited by 2,280
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  5. 2023Consistency Modelscited by 1,778
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  7. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  8. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  10. 2023Adversarial Diffusion Distillationcited by 741
  11. 2022On Distillation of Guided Diffusion Modelscited by 721
  12. 2018Which Training Methods for GANs do actually Converge?cited by 672
  13. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  14. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  15. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  16. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  17. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  18. 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 504
  19. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  20. 2023Improved Techniques for Training Consistency Modelscited by 430
  21. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  22. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
  23. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
  24. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  25. 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
  26. 2018The relativistic discriminator: a key element missing from standard GANcited by 234
  27. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
  28. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  29. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
  30. 2024Autoregressive Video Generation without Vector Quantizationcited by 180
  31. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 165
  32. 2024GameGen-X: Interactive Open-world Game Video Generationcited by 124
  33. 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillationcited by 115
  34. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
  35. 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
  36. 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 74
  37. 2022NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesiscited by 71
  38. 2025The GAN is dead; long live the GAN! A Modern GAN Baselinecited by 57

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 13.

15 papers.

Sort:

By area:

  1. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  2. 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 44
  3. 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Modelscited by 19
  4. 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 13
  5. 2026Causality in Video Diffusers is Separable from Denoisingcited by 4
  6. 2025JoyStreamer-Flash: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusioncited by 3
  7. 2026ChopGrad: Pixel-Wise Losses for Latent Video Diffusion via Truncated Backpropagationcited by 1
  8. 2026TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generationcited by 1
  9. 2025DiffusionBrowser: Interactive Diffusion Previews via Multi-Branch Decoderscited by 0
  10. 2026OSVE: One Step Video Editing with One Step Diffusion Modelscited by 0
  11. 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulationcited by 0
  12. 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generationcited by 0
3 more
  1. 2026UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillationcited by 0
  2. 2026Uncertainty-Aware Consistency Distillation for Few-Step Video Generationcited by 0
  3. 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillationcited by 0