mlsanityData to 7 Oct 2026

AnimateDiff-Lightning: Cross-Model Diffusion Distillation

arXiv 2403.12706 ↗First posted 19 Mar 2024cs.CV cs.AIcited by 47

On the map: Diffusion models → Video generation

Abstract (arXiv)

We present AnimateDiff-Lightning for lightning-fast video generation. Our model uses progressive adversarial diffusion distillation to achieve new state-of-the-art in few-step video generation. We discuss our modifications to adapt it for the video modality. Furthermore, we propose to simultaneously distill the probability flow of multiple base diffusion models, resulting in a single distilled motion module with broader style compatibility. We are pleased to release our distilled AnimateDiff-Lightning model for the community's use.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 33 of its 45 references that are in the map. First posted on arXiv 19 Mar 2024.

Builds on

33 of 45 references.

Closest ancestors · 5

Same direction, newest first

  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  2. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  3. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
  4. 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
  5. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Models20 Nov

Other references · 28

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2023Consistency Modelscited by 1,778
  11. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  12. 2018Group Normalizationcited by 1,514
16 more
  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  2. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  4. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  5. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  6. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  7. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  8. 2015Holistically-Nested Edge Detectioncited by 590
  9. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 448
  10. 2023Improved Techniques for Training Consistency Modelscited by 430
  11. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  12. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
  13. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  14. 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
  15. 2024AnimateLCM: Computation-Efficient Personalized Style Video Generation without Personalized Video Datacited by 42
  16. 2023Diffusion Model with Perceptual Losscited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 13; 2025: 23; 2026: 11.

47 papers.

Sort:

By area:

  1. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  2. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
  3. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
  4. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 115
  5. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 84
  6. 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 45
  7. 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 43
  8. 2024SF-V: Single Forward Video Generation Modelcited by 40
  9. 2024Looking Backward: Streaming Video-to-Video Translation with Feature Bankscited by 38
  10. 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 38
  11. 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
  12. 2024SnapGen-V: Generating a Five-Second Video within Five Seconds on a Mobile Devicecited by 25
35 more
  1. 2025Dual-Expert Consistency Model for Efficient and High-Quality Video Generationcited by 21
  2. 2025DC-VideoGen: Efficient Video Generation with Deep Compression Video Autoencodercited by 15
  3. 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devicescited by 14
  4. 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generationcited by 14
  5. 2025AccVideo: Accelerating Video Diffusion Model with Synthetic Datasetcited by 13
  6. 2026Your One-Stop Solution for AI-Generated Video Detectioncited by 13
  7. 2024Accelerating Video Diffusion Models via Distribution Matchingcited by 10
  8. 2025Adversarial Flow Modelscited by 10
  9. 2025Understanding Attention Mechanism in Video Diffusion Modelscited by 7
  10. 2025LLIA -- Enabling Low-Latency Interactive Avatars: Real-Time Audio-Driven Portrait Video Generation with Diffusion Modelscited by 7
  11. 2025DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Spacecited by 7
  12. 2026Efficient Video Diffusion Models: Advancements and Challengescited by 6
  13. 2025Protecting Your Video Content: Disrupting Automated Video-based LLM Annotationscited by 5
  14. 2024Human Action CLIPs: Detecting AI-generated Human Motioncited by 4
  15. 2024Inference-Time Diffusion Model Distillationcited by 4
  16. 2026Continuous Adversarial Flow Modelscited by 4
  17. 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detectioncited by 3
  18. 2025Mobius: Text to Seamless Looping Video Generation via Latent Shiftcited by 3
  19. 2025AgeBooth: Controllable Facial Aging and Rejuvenation via Diffusion Modelscited by 3
  20. 2026Efficient Camera-Controlled Video Generation of Static Scenes via Sparse Diffusion and 3D Renderingcited by 3
  21. 2026FastSTAR: Spatiotemporal Token Pruning for Efficient Autoregressive Video Synthesiscited by 2
  22. 2026DriftWorld: Fast World Modeling through Driftingcited by 2
  23. 2026Multi-Dimensional Quality Assessment for AI-Generated Human-Centric Videos: Dataset and Modelcited by 2
  24. 2025Accelerating Diffusion Sampling via Exploiting Local Transition Coherencecited by 1
  25. 2025When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generatorscited by 1
  26. 2025Encapsulated Composition of Text-to-Image and Text-to-Video Models for High-Quality Video Synthesiscited by 1
  27. 2025V.I.P. : Iterative Online Preference Distillation for Efficient Video Diffusion Modelscited by 1
  28. 2025Input-Aware Sparse Attention for Real-Time Co-Speech Video Generationcited by 1
  29. 2024Decoupled Video Generation with Chain of Training-free Diffusion Model Expertscited by 0
  30. 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devicescited by 0
  31. 2025The HCI GenAI CO2ST Calculator: A Tool for Calculating the Carbon Footprint of Generative AI Use in Human-Computer Interaction Researchcited by 0
  32. 2026OSVE: One Step Video Editing with One Step Diffusion Modelscited by 0
  33. 2026SparSTAR: Sparse Attention for SpaceTime AutoRegressive Video Synthesiscited by 0
  34. 2026Magnitude-Direction Decoupling for Fast Video Generation with Flow Matching Modelscited by 0
  35. 2026Few-Step Generation via Data-Space Iterationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024OSV: One Step is Enough for High-Quality Image to Video Generation
  2. 2026Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation
  3. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillation
  4. 2022Video Diffusion Models
  5. 2025Survey of Video Diffusion Models: Foundations, Implementations, and Applications
  6. 2026GPD: Guided Progressive Distillation for Fast and High-Quality Video Generation
  7. 2022Imagen Video: High Definition Video Generation with Diffusion Models
  8. 2024Video Diffusion Models: A Survey