Dual-End Consistency Model
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
The slow iterative sampling nature remains a major bottleneck for the practical deployment of diffusion and flow-based generative models. While consistency models (CMs) represent a state-of-the-art distillation-based approach for efficient generation, their large-scale application is still limited by two key issues: training instability and inflexible sampling. Existing methods seek to mitigate these problems through architectural adjustments or regularized objectives, yet overlook the critical reliance on trajectory selection. In this work, we first conduct an analysis on these two limitations: training instability originates from loss divergence induced by unstable self-supervised term, whereas sampling inflexibility arises from error accumulation. Based on these insights and analysis, we propose the Dual-End Consistency Model (DE-CM) that selects vital sub-trajectory clusters to achieve stable and effective training. DE-CM decomposes the PF-ODE trajectory and selects three critical sub-trajectories as optimization targets. Specifically, our approach leverages continuous-time CMs objectives to achieve few-step distillation and utilizes flow matching as a boundary regularizer to stabilize the training process. Furthermore, we propose a novel noise-to-noisy (N2N) mapping that can map noise to any point, thereby alleviating the error accumulation in the first step. Extensive experimental results show the effectiveness of our method: it achieves a state-of-the-art FID score of 1.70 in one-step generation on the ImageNet 256x256 dataset, outperforming existing CM-based one-step approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 62 of its 71 references that are in the map. First posted on arXiv 11 Feb 2026.
Builds on
62 of 71 references.
Closest ancestors · 28
Same direction, newest first
- 2025Inductive Moment Matching10 Mar
- 2025Improved Training Technique for Latent Consistency Models3 Feb
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models2 Jan
- 2024One Step Diffusion via Shortcut Models16 Oct
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Models14 Oct
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think9 Oct
- 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Models3 Oct
- 2024Consistency Models Made Easy20 Jun
- 2024Phased Consistency Models28 May
- 2024Improved Distribution Matching Distillation for Fast Image Synthesis23 May
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis21 Apr
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
16 more
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers16 Jan
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov
- 2023Adversarial Diffusion Distillation28 Nov
- 2023Improved Techniques for Training Consistency Models22 Oct
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion1 Oct
- 2023BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping8 Jun
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
22 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2024Autoregressive Image Generation without Vector Quantizationcited by 644
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
- 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 102
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 81
- 2024Optimal Flow Matching: Learning Straight Trajectories in Just One Stepcited by 74
- 2025AlphaFlow: Understanding and Improving MeanFlow Modelscited by 40
- 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modelingcited by 26
- 2025CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Modelscited by 18
- 2025FACM: Flow-Anchored Consistency Modelscited by 16
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Stabilizing Consistency Training: A Flow Map Analysis and Self-Distillation
- 2024Truncated Consistency Models
- 2024Improving Consistency Models with Generator-Augmented Flows
- 2025How to build a consistency model: Learning flow maps via self-distillation
- 2026Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Models
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
- 2025Image-Free Timestep Distillation via Continuous-Time Consistency with Trajectory-Sampled Pairs
- 2024Towards Faster Training of Diffusion Models: An Inspiration of A Consistency Phenomenon