mlsanityData to 7 Oct 2026

VideoLCM: Video Latent Consistency Model

arXiv 2312.09109 ↗First posted 14 Dec 2023cs.CV cs.AIcited by 90

On the map: Diffusion models → Video generation

Abstract (arXiv)

Consistency models have demonstrated powerful capability in efficient image generation and allowed synthesis within a few sampling steps, alleviating the high computational cost in diffusion models. However, the consistency model in the more challenging and resource-consuming video generation is still less explored. In this report, we present the VideoLCM framework to fill this gap, which leverages the concept of consistency models from image generation to efficiently synthesize videos with minimal steps while maintaining high quality. VideoLCM builds upon existing latent video diffusion models and incorporates consistency distillation techniques for training the latent consistency model. Experimental results reveal the effectiveness of our VideoLCM in terms of computational efficiency, fidelity and temporal consistency. Notably, VideoLCM achieves high-fidelity and smooth video synthesis with only four sampling steps, showcasing the potential for real-time synthesis. We hope that VideoLCM can serve as a simple yet effective baseline for subsequent research. The source code and models will be publicly available.

Key facts. Cited by 90 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 53 of its 62 references that are in the map. First posted on arXiv 14 Dec 2023.

Builds on

53 of 62 references.

Closest ancestors · 23

Same direction, newest first

  1. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
  2. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  4. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models7 Nov
  5. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation27 Sep
  6. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editing18 Aug
  7. 2023ModelScope Text-to-Video Technical Report12 Aug
  8. 2023AnyDoor: Zero-shot Object-level Image Customization18 Jul
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  10. 2023ControlVideo: Training-free Controllable Text-to-Video Generation22 May
  11. 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models17 May
  12. 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesis27 Apr
11 more
  1. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
  2. 2023Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generation17 Apr
  3. 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Models24 Mar
  4. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
  5. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation15 Mar
  6. 2023Video Probabilistic Diffusion Models in Projected Latent Space15 Feb
  7. 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
  8. 2023Dreamix: Video Diffusion Models are General Video Editors2 Feb
  9. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
  10. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Models20 Nov
  11. 2022Imagen Video: High Definition Video Generation with Diffusion Models5 Oct

Other references · 30

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2023Consistency Modelscited by 1,778
  11. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  12. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
18 more
  1. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  2. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  3. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  4. 2023Adversarial Diffusion Distillationcited by 741
  5. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  6. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  7. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  8. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  9. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  10. 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
  11. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
  12. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
  13. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
  14. 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
  15. 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 153
  16. 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
  17. 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generationcited by 19
  18. 2023CCM: Adding Conditional Controls to Text-to-Image Consistency Modelscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 31; 2025: 28; 2026: 28.

90 papers.

Sort:

By area:

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  3. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
  4. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
  5. 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 144
  6. 2024GameGen-X: Interactive Open-world Game Video Generationcited by 124
  7. 2025Training Agents Inside of Scalable World Modelscited by 122
  8. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
  9. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 85
  10. 2024T2V-Turbo: Breaking the Quality Bottleneck of Video Consistency Model with Mixed Reward Feedbackcited by 84
  11. 2025Yume: An Interactive World Generation Modelcited by 73
  12. 2024ManiCM: Real-time 3D Diffusion Policy via Consistency Model for Robotic Manipulationcited by 57
38 more
  1. 2024T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Designcited by 54
  2. 2023A Recipe for Scaling up Text-to-Video Generation with Text-free Videoscited by 51
  3. 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 42
  4. 2024LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexitycited by 41
  5. 2024SF-V: Single Forward Video Generation Modelcited by 40
  6. 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 38
  7. 2024OSV: One Step is Enough for High-Quality Image to Video Generationcited by 36
  8. 2025MagCache: Fast Video Generation with Magnitude-Aware Cachecited by 36
  9. 2025Efficient Diffusion Models: A Surveycited by 35
  10. 2025DiCache: Let Diffusion Model Determine Its Own Cachecited by 34
  11. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  12. 2025VideoScene: Distilling Video Diffusion Model to Generate 3D Scenes in One Stepcited by 27
  13. 2024From Sora What We Can See: A Survey of Text-to-Video Generationcited by 26
  14. 2025Efficient-vDiT: Efficient Video Diffusion Transformers With Attention Tilecited by 26
  15. 2024Towards a mathematical theory for consistency training in diffusion modelscited by 25
  16. 2024SnapGen-V: Generating a Five-Second Video within Five Seconds on a Mobile Devicecited by 25
  17. 2024DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimizationcited by 25
  18. 2025DreamRelation: Relation-Centric Video Customizationcited by 23
  19. 2025A Survey of Interactive Generative Videocited by 23
  20. 2024Consistency Diffusion Bridge Modelscited by 22
  21. 2024AudioLCM: Text-to-Audio Generation with Latent Consistency Modelscited by 21
  22. 2024VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMscited by 20
  23. 2026Flow caching for autoregressive video generationcited by 19
  24. 2026Flash-WAM: Modality-Aware Distillation for World Action Modelscited by 16
  25. 2025DC-VideoGen: Efficient Video Generation with Deep Compression Video Autoencodercited by 15
  26. 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
  27. 2023DreamTalk: When Emotional Talking Head Generation Meets Diffusion Probabilistic Modelscited by 13
  28. 2025Position: Interactive Generative Video as Next-Generation Game Enginecited by 13
  29. 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generationcited by 12
  30. 2025UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedbackcited by 12
  31. 2024Accelerating Video Diffusion Models via Distribution Matchingcited by 10
  32. 2024EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Modelscited by 8
  33. 2025AMD-Hummingbird: Towards an Efficient Text-to-Video Modelcited by 8
  34. 2025HiStream: Efficient High-Resolution Video Generation via Redundancy-Eliminated Streamingcited by 8
  35. 2024Music Consistency Modelscited by 7
  36. 2025SRDiffusion: Accelerate Video Diffusion Inference via Sketching-Rendering Cooperationcited by 7
  37. 2025DC-Gen: Post-Training Diffusion Acceleration with Deeply Compressed Latent Spacecited by 7
  38. 2024Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Bettercited by 6

50 most cited of 90 All 90 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Phased Consistency Models
  2. 2025Dual-Expert Consistency Model for Efficient and High-Quality Video Generation
  3. 2024Frame by Familiar Frame: Understanding Replication in Video Diffusion Models
  4. 2025Tuning-Free Long Video Generation via Global-Local Collaborative Diffusion
  5. 2024TLCM: Training-efficient Latent Consistency Model for Image Generation with 2-8 Steps
  6. 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency
  7. 2026DCDM: Divide-and-Conquer Diffusion Models for Consistency-Preserving Video Generation
  8. 2026Consistency-Preserving Diverse Video Generation