mlsanityData to 7 Oct 2026

Dual-End Consistency Model

arXiv 2602.10764 ↗First posted 11 Feb 2026cs.CVcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

The slow iterative sampling nature remains a major bottleneck for the practical deployment of diffusion and flow-based generative models. While consistency models (CMs) represent a state-of-the-art distillation-based approach for efficient generation, their large-scale application is still limited by two key issues: training instability and inflexible sampling. Existing methods seek to mitigate these problems through architectural adjustments or regularized objectives, yet overlook the critical reliance on trajectory selection. In this work, we first conduct an analysis on these two limitations: training instability originates from loss divergence induced by unstable self-supervised term, whereas sampling inflexibility arises from error accumulation. Based on these insights and analysis, we propose the Dual-End Consistency Model (DE-CM) that selects vital sub-trajectory clusters to achieve stable and effective training. DE-CM decomposes the PF-ODE trajectory and selects three critical sub-trajectories as optimization targets. Specifically, our approach leverages continuous-time CMs objectives to achieve few-step distillation and utilizes flow matching as a boundary regularizer to stabilize the training process. Furthermore, we propose a novel noise-to-noisy (N2N) mapping that can map noise to any point, thereby alleviating the error accumulation in the first step. Extensive experimental results show the effectiveness of our method: it achieves a state-of-the-art FID score of 1.70 in one-step generation on the ImageNet 256x256 dataset, outperforming existing CM-based one-step approaches.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 62 of its 71 references that are in the map. First posted on arXiv 11 Feb 2026.

Builds on

62 of 71 references.

Closest ancestors · 28

Same direction, newest first

  1. 2025Inductive Moment Matching10 Mar
  2. 2025Improved Training Technique for Latent Consistency Models3 Feb
  3. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models2 Jan
  4. 2024One Step Diffusion via Shortcut Models16 Oct
  5. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Models14 Oct
  6. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think9 Oct
  7. 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Models3 Oct
  8. 2024Consistency Models Made Easy20 Jun
  9. 2024Phased Consistency Models28 May
  10. 2024Improved Distribution Matching Distillation for Fast Image Synthesis23 May
  11. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis21 Apr
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
16 more
  1. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers16 Jan
  2. 2023One-step Diffusion with Distribution Matching Distillation30 Nov
  3. 2023Adversarial Diffusion Distillation28 Nov
  4. 2023Improved Techniques for Training Consistency Models22 Oct
  5. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
  6. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion1 Oct
  7. 2023BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping8 Jun
  8. 2022Scalable Diffusion Models with Transformers19 Dec
  9. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
  10. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  11. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  12. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  13. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  14. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  15. 2020Denoising Diffusion Implicit Models6 Oct
  16. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2022Flow Matching for Generative Modelingcited by 5,426
  7. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
22 more
  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  4. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  5. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  6. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  7. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  8. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  9. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  10. 2024Autoregressive Image Generation without Vector Quantizationcited by 644
  11. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  12. 2025Mean Flows for One-step Generative Modelingcited by 524
  13. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  14. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
  15. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
  16. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 102
  17. 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 81
  18. 2024Optimal Flow Matching: Learning Straight Trajectories in Just One Stepcited by 74
  19. 2025AlphaFlow: Understanding and Improving MeanFlow Modelscited by 40
  20. 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modelingcited by 26
  21. 2025CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Modelscited by 18
  22. 2025FACM: Flow-Anchored Consistency Modelscited by 16

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Stabilizing Consistency Training: A Flow Map Analysis and Self-Distillation
  2. 2024Truncated Consistency Models
  3. 2024Improving Consistency Models with Generator-Augmented Flows
  4. 2025How to build a consistency model: Learning flow maps via self-distillation
  5. 2026Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Models
  6. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
  7. 2025Image-Free Timestep Distillation via Continuous-Time Consistency with Trajectory-Sampled Pairs
  8. 2024Towards Faster Training of Diffusion Models: An Inspiration of A Consistency Phenomenon