mlsanityData to 7 Oct 2026

Video Diffusion Models

arXiv 2204.03458 ↗First posted 7 Apr 2022cs.CV cs.AI cs.LGcited by 2,280

On the map: Diffusion models → Video generation

Abstract (arXiv)

Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial results. Our model is a natural extension of the standard image diffusion architecture, and it enables jointly training from image and video data, which we find to reduce the variance of minibatch gradients and speed up optimization. To generate long and higher resolution videos we introduce a new conditional sampling technique for spatial and temporal video extension that performs better than previously proposed methods. We present the first results on a large text-conditioned video generation task, as well as state-of-the-art results on established benchmarks for video prediction and unconditional video generation. Supplementary material is available at https://video-diffusion.github.io/

Key facts. Cited by 2,280 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 54 of its 81 references that are in the map. First posted on arXiv 7 Apr 2022.

Builds on

54 of 81 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Diffusion Probabilistic Modeling for Video Generation16 Mar

Other references · 53

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  10. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  11. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  12. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
38 more
  1. 2016Wide Residual Networkscited by 3,057
  2. 2016Improved Techniques for Training GANscited by 2,938
  3. 2017Non-local Neural Networkscited by 2,290
  4. 2017The Kinetics Human Action Video Datasetcited by 1,894
  5. 2021ViViT: A Video Vision Transformercited by 1,610
  6. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  7. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  8. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  9. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  10. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  11. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  12. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  13. 2021Variational Diffusion Modelscited by 1,145
  14. 2018Self-Attention with Relative Position Representationscited by 1,112
  15. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  16. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  17. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  18. 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 415
  19. 2019Axial Attention in Multidimensional Transformerscited by 350
  20. 2018A Short Note about Kinetics-600cited by 331
  21. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  22. 2021Deblurring via Stochastic Refinementcited by 248
  23. 2018Women also Snowboard: Overcoming Bias in Captioning Modelscited by 236
  24. 2017Stochastic Variational Video Predictioncited by 234
  25. 2019Scaling Autoregressive Video Modelscited by 189
  26. 2018Stochastic Adversarial Video Predictioncited by 173
  27. 2019Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limitcited by 168
  28. 2017Self-Supervised Visual Planning with Temporal Skip Connectionscited by 137
  29. 2017PixelSNAIL: An Improved Autoregressive Generative Modelcited by 137
  30. 2018Train Sparsely, Generate Densely: Memory-efficient Unsupervised Training of High-resolution Temporal GANcited by 120
  31. 2020Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biasescited by 107
  32. 2021FitVid: Overfitting in Pixel-Level Video Predictioncited by 86
  33. 2020Solving Linear Inverse Problems Using the Prior Implicit in a Denoisercited by 78
  34. 2018Generating High Fidelity Images with Subscale Pixel Networks and Multidimensional Upscalingcited by 74
  35. 2021CCVS: Context-aware Controllable Video Synthesiscited by 68
  36. 2020Transformation-based Adversarial Video Prediction on Large-Scale Datacited by 66
  37. 2021Predicting Video with VQVAEcited by 61
  38. 2019Lower Dimensional Kernels for Video Discriminatorscited by 37

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 101; 2023: 404; 2024: 559; 2025: 742; 2026: 474.

2,280 papers.

Sort:

By area:

  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  2. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  7. 2023Consistency Modelscited by 1,778
  8. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
  1. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  2. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  3. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  4. 2022Human Motion Diffusion Modelcited by 1,062
  5. 2022Diffusion Models in Vision: A Surveycited by 1,008
  6. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  7. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  8. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  9. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  10. 2024Genie: Generative Interactive Environmentscited by 706
  11. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  12. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  13. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  14. 2023ModelScope Text-to-Video Technical Reportcited by 651
  15. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  16. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  17. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  18. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
  19. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  20. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  21. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  22. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
  23. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
  24. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  25. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
  26. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  27. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
  28. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  29. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
  30. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  31. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  32. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
  33. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  34. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
  35. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  36. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
  37. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  38. 2023Learning Interactive Real-World Simulatorscited by 440

50 most cited of 2,280 All 2,280 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Efficient Video Diffusion Models: Advancements and Challenges
  2. 2026Image-to-Video Diffusion: From Foundations to Open Frontiers
  3. 2024Progressive Autoregressive Video Diffusion Models
  4. 2024Accelerating Video Diffusion Models via Distribution Matching
  5. 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model
  6. 2024Towards Precise Scaling Laws for Video Diffusion Transformers
  7. 2024S2DM: Sector-Shaped Diffusion Models for Video Generation
  8. 2024Decoupled Video Generation with Chain of Training-free Diffusion Model Experts