mlsanityData to 7 Oct 2026

Imagen Video: High Definition Video Generation with Diffusion Models

arXiv 2210.02303 ↗First posted 5 Oct 2022cs.CV cs.LGcited by 1,765

On the map: Diffusion models → Video generation

Abstract (arXiv)

We present Imagen Video, a text-conditional video generation system based on a cascade of video diffusion models. Given a text prompt, Imagen Video generates high definition videos using a base video generation model and a sequence of interleaved spatial and temporal video super-resolution models. We describe how we scale up the system as a high definition text-to-video model including design decisions such as the choice of fully-convolutional temporal and spatial super-resolution models at certain resolutions, and the choice of the v-parameterization of diffusion models. In addition, we confirm and transfer findings from previous work on diffusion-based image generation to the video generation setting. Finally, we apply progressive distillation to our video models with classifier-free guidance for fast, high quality sampling. We find Imagen Video not only capable of generating videos of high fidelity, but also having a high degree of controllability and world knowledge, including the ability to generate diverse videos and text animations in various artistic styles and with 3D object understanding. See https://imagen.research.google/video/ for samples.

Key facts. Cited by 1,765 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 45 of its 51 references that are in the map. First posted on arXiv 5 Oct 2022.

Builds on

45 of 51 references.

Closest ancestors · 3

Same direction, newest first

  1. 2022Flexible Diffusion Modeling of Long Videos23 May
  2. 2022Video Diffusion Models7 Apr
  3. 2022Diffusion Probabilistic Modeling for Video Generation16 Mar

Other references · 42

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
30 more
  1. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  3. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  4. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  5. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  6. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  7. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  8. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  9. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  10. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  11. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  12. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  13. 2021Variational Diffusion Modelscited by 1,145
  14. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  15. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  16. 2017PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modificationscited by 415
  17. 2016Generating Videos with Scene Dynamicscited by 376
  18. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 326
  19. 2015Deep multi-scale video prediction beyond mean square errorcited by 297
  20. 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 256
  21. 2021Deblurring via Stochastic Refinementcited by 248
  22. 2017Stochastic Variational Video Predictioncited by 234
  23. 2019Identifying and Reducing Gender Bias in Word-Level Language Modelscited by 214
  24. 2019Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limitcited by 168
  25. 2022MaskViT: Masked Visual Pre-Training for Video Predictioncited by 112
  26. 2016Video Pixel Networkscited by 108
  27. 2014Video (language) modeling: a baseline for generative models of natural videoscited by 92
  28. 2021FitVid: Overfitting in Pixel-Level Video Predictioncited by 86
  29. 2019VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generationcited by 74
  30. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 42; 2023: 460; 2024: 654; 2025: 396; 2026: 213.

1,765 papers.

Sort:

By area:

  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  4. 2023Consistency Modelscited by 1,778
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  7. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  9. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
  10. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  11. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  12. 2023Training Diffusion Models with Reinforcement Learningcited by 939
38 more
  1. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  2. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  3. 2023Adversarial Diffusion Distillationcited by 741
  4. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  5. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  6. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  7. 2023ModelScope Text-to-Video Technical Reportcited by 651
  8. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  9. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  10. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  11. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  12. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  13. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  14. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  15. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
  16. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  17. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  18. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  19. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  20. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  21. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  22. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  23. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  24. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
  25. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  26. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
  27. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  28. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  29. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  30. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  31. 2023Learning Interactive Real-World Simulatorscited by 440
  32. 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 431
  33. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  34. 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 396
  35. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
  36. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  37. 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
  38. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385

50 most cited of 1,765 All 1,765 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Image-to-Video Diffusion: From Foundations to Open Frontiers
  2. 2026Efficient Video Diffusion Models: Advancements and Challenges
  3. 2024Conditional Image Synthesis with Diffusion Models: A Survey
  4. 2023Dual-Stream Diffusion Net for Text-to-Video Generation
  5. 2022VIDM: Video Implicit Diffusion Models
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models
  7. 2024VideoTetris: Towards Compositional Text-to-Video Generation
  8. 2025Lumina-Video: Efficient and Flexible Video Generation with Multi-scale Next-DiT