mlsanityData to 7 Oct 2026

Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference

arXiv 2310.04378 ↗First posted 6 Oct 2023cs.CV cs.LGcited by 826

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Latent Diffusion models (LDMs) have achieved remarkable results in synthesizing high-resolution images. However, the iterative sampling process is computationally intensive and leads to slow generation. Inspired by Consistency Models (song et al.), we propose Latent Consistency Models (LCMs), enabling swift inference with minimal steps on any pre-trained LDMs, including Stable Diffusion (rombach et al). Viewing the guided reverse diffusion process as solving an augmented probability flow ODE (PF-ODE), LCMs are designed to directly predict the solution of such ODE in latent space, mitigating the need for numerous iterations and allowing rapid, high-fidelity sampling. Efficiently distilled from pre-trained classifier-free guided diffusion models, a high-quality 768 x 768 2~4-step LCM takes only 32 A100 GPU hours for training. Furthermore, we introduce Latent Consistency Fine-tuning (LCF), a novel method that is tailored for fine-tuning LCMs on customized image datasets. Evaluation on the LAION-5B-Aesthetics dataset demonstrates that LCMs achieve state-of-the-art text-to-image generation performance with few-step inference. Project Page: https://latent-consistency-models.github.io/

Key facts. Cited by 826 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 28 of its 38 references that are in the map. First posted on arXiv 6 Oct 2023.

Builds on

28 of 38 references.

Closest ancestors · 17

Same direction, newest first

  1. 2023Consistency Models2 Mar
  2. 2022Fast Sampling of Diffusion Models via Operator Learning24 Nov
  3. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
  4. 2022On Distillation of Guided Diffusion Models6 Oct
  5. 2022Classifier-Free Diffusion Guidance26 Jul
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  8. 2022Accelerating Diffusion Models via Early Stop of the Diffusion Process25 May
  9. 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders19 Feb
  10. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  11. 2021Learning to Efficiently Sample from Diffusion Probabilistic Models7 Jun
  12. 2021Gotta Go Fast When Generating Data with Score-Based Models28 May
5 more
  1. 2021Improved Denoising Diffusion Probabilistic Models18 Feb
  2. 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  4. 2020Denoising Diffusion Implicit Models6 Oct
  5. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 11

  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  3. 2022Generative Adversarial Networkscited by 5,603
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  7. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  9. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  10. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
  11. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 28; 2024: 298; 2025: 261; 2026: 239.

826 papers.

Sort:

By area:

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  3. 2023Adversarial Diffusion Distillationcited by 741
  4. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  5. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  6. 2024One Step Diffusion via Shortcut Modelscited by 373
  7. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
  8. 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 298
  9. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
  10. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  11. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
  12. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
38 more
  1. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  2. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  3. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  4. 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
  5. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
  6. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 209
  7. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 204
  8. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  9. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 169
  10. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 165
  11. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
  12. 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Modelscited by 161
  13. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
  14. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  15. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 153
  16. 2023Cache Me if You Can: Accelerating Diffusion Models through Block Cachingcited by 149
  17. 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
  18. 2026Advancing Open-source World Modelscited by 144
  19. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
  20. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
  21. 2024Consistency Models Made Easycited by 140
  22. 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
  23. 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Cachingcited by 138
  24. 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Modelscited by 138
  25. 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
  26. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
  27. 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
  28. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 115
  29. 2024One-Step Image Translation with Text-to-Image Modelscited by 111
  30. 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
  31. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
  32. 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillationcited by 109
  33. 2023Inversion-Free Image Editing with Natural Languagecited by 106
  34. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 100
  35. 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 99
  36. 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Modelscited by 98
  37. 2025How to build a consistency model: Learning flow maps via self-distillationcited by 96
  38. 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 95

50 most cited of 826 All 826 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models
  2. 2024RepLDM: Reprogramming Pretrained Latent Diffusion Models for High-Quality, High-Efficiency, High-Resolution Image Generation
  3. 2025Alias-Free Latent Diffusion Models: Improving Fractional Shift Equivariance of Diffusion Latent Space
  4. 2024Stable Consistency Tuning: Understanding and Improving Consistency Models
  5. 2024FAM Diffusion: Frequency and Attention Modulation for High-Resolution Image Generation with Stable Diffusion
  6. 2026LDM-is-AE: Latent Diffusion Model is an Auto-Encoder for End-to-End Image Generation
  7. 2026Taming Sampling Perturbations with Variance Expansion Loss for Latent Diffusion Models
  8. 2025Noise Consistency Regularization for Improved Subject-Driven Image Synthesis