FACM: Flow-Anchored Consistency Models
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Continuous-time Consistency Models (CMs) promise efficient few-step generation but face significant challenges with training instability. We argue this instability stems from a fundamental conflict: Training the network exclusively on a shortcut objective leads to the catastrophic forgetting of the instantaneous velocity field that defines the flow. Our solution is to explicitly anchor the model in the underlying flow, ensuring high trajectory fidelity during training. We introduce the Flow-Anchored Consistency Model (FACM), where a Flow Matching (FM) task serves as a dynamic anchor for the primary CM shortcut objective. Key to this Flow-Anchoring approach is a novel expanded time interval strategy that unifies optimization for a single model while decoupling the two tasks to ensure stable, architecturally-agnostic training. By distilling a pre-trained LightningDiT model, our method achieves a state-of-the-art FID of 1.32 with two steps (NFE=2) and 1.70 with just one step (NFE=1) on ImageNet 256x256. To address the challenge of scalability, we develop a memory-efficient Chain-JVP that resolves key incompatibilities with FSDP. This method allows us to scale FACM training on a 14B parameter model (Wan 2.2), accelerating its Text-to-Image inference from 2x40 to 2-8 steps. Our code and pretrained models: https://github.com/ali-vilab/FACM.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 26 of its 33 references that are in the map. First posted on arXiv 4 Jul 2025.
Builds on
26 of 33 references.
Closest ancestors · 4
Same direction, newest first
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillation17 Jun
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models11 Jun
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 22
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2023Consistency Modelscited by 1,822
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
10 more
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 304
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
- 2024Consistency Models Made Easycited by 144
- 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillationcited by 116
- 2025Unified Continuous Generative Modelscited by 19
Built on by
Citing papers per year: 2025: 10; 2026: 6.
16 papers.
Sort:
By area:
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2025AlphaFlow: Understanding and Improving MeanFlow Modelscited by 41
- 2025Transition Models: Rethinking the Generative Learning Objectivecited by 34
- 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modelingcited by 26
- 2025Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Samplingcited by 20
- 2025Flow Map Distillation Without Datacited by 14
- 2025SoFlow: Solution Flow Models for One-Step Generative Modelingcited by 13
- 2025Bidirectional Normalizing Flow: From Data to Noise and Backcited by 7
- 2025Universal Inverse Distillation for Matching Models with Real-Data Supervision (No GANs)cited by 5
- 2026CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenizationcited by 5
- 2025From Structure to Detail: Hierarchical Distillation for Efficient Diffusion Modelcited by 3
- 2026MFSR: MeanFlow Distillation for One Step Real-World Image Super Resolutioncited by 2
4 more
- 2026A Latent Distribution Perspective on Evaluating and Improving Latent Generative Models21 Sep 2026
- 2026MFSR: MeanFlow Distillation for One Step Real-World Image Super Resolution21 Mar 2026
- 2026CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenization6 Mar 2026
- 2026Dual-End Consistency Model11 Feb 2026
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectory6 Feb 2026
- 2026WFR-MFM: One-Step Inference for Dynamic Unbalanced Optimal Transport28 Jan 2026
- 2025SoFlow: Solution Flow Models for One-Step Generative Modeling17 Dec 2025
- 2025Bidirectional Normalizing Flow: From Data to Noise and Back11 Dec 2025
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Models1 Dec 2025
- 2025Flow Map Distillation Without Data24 Nov 2025
- 2025From Structure to Detail: Hierarchical Distillation for Efficient Diffusion Model12 Nov 2025
- 2025Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Sampling28 Oct 2025
4 more
- 2025AlphaFlow: Understanding and Improving MeanFlow Models23 Oct 2025
- 2025Universal Inverse Distillation for Matching Models with Real-Data Supervision (No GANs)26 Sep 2025
- 2025Transition Models: Rethinking the Generative Learning Objective4 Sep 2025
- 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modeling22 Jul 2025
- 2025AlphaFlow: Understanding and Improving MeanFlow Modelscited by 41
- 2025Transition Models: Rethinking the Generative Learning Objectivecited by 34
- 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modelingcited by 26
- 2025SoFlow: Solution Flow Models for One-Step Generative Modelingcited by 13
- 2025Universal Inverse Distillation for Matching Models with Real-Data Supervision (No GANs)cited by 5
- 2025From Structure to Detail: Hierarchical Distillation for Efficient Diffusion Modelcited by 3
- 2026WFR-MFM: One-Step Inference for Dynamic Unbalanced Optimal Transportcited by 1
- 2026Dual-End Consistency Modelcited by 0
- 2026Dual-End Consistency Model11 Feb 2026
- 2026WFR-MFM: One-Step Inference for Dynamic Unbalanced Optimal Transport28 Jan 2026
- 2025SoFlow: Solution Flow Models for One-Step Generative Modeling17 Dec 2025
- 2025From Structure to Detail: Hierarchical Distillation for Efficient Diffusion Model12 Nov 2025
- 2025AlphaFlow: Understanding and Improving MeanFlow Models23 Oct 2025
- 2025Universal Inverse Distillation for Matching Models with Real-Data Supervision (No GANs)26 Sep 2025
- 2025Transition Models: Rethinking the Generative Learning Objective4 Sep 2025
- 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modeling22 Jul 2025
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2025Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Samplingcited by 20
- 2025Flow Map Distillation Without Datacited by 14
- 2025Bidirectional Normalizing Flow: From Data to Noise and Backcited by 7
- 2026CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenizationcited by 5
- 2026MFSR: MeanFlow Distillation for One Step Real-World Image Super Resolutioncited by 2
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectorycited by 0
- 2026A Latent Distribution Perspective on Evaluating and Improving Latent Generative Modelscited by 0
- 2026A Latent Distribution Perspective on Evaluating and Improving Latent Generative Models21 Sep 2026
- 2026MFSR: MeanFlow Distillation for One Step Real-World Image Super Resolution21 Mar 2026
- 2026CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenization6 Mar 2026
- 2026FlowConsist: Make Your Flow Consistent with Real Trajectory6 Feb 2026
- 2025Bidirectional Normalizing Flow: From Data to Noise and Back11 Dec 2025
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Models1 Dec 2025
- 2025Flow Map Distillation Without Data24 Nov 2025
- 2025Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Sampling28 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Exploring and Exploiting Stability in Latent Flow Matching
- 2024Consistency Flow Matching: Defining Straight Flows with Velocity Consistency
- 2025CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Models
- 2026Stable Velocity: A Variance Perspective on Flow Matching
- 2026Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Models
- 2026Temporal Pair Consistency for Variance-Reduced Flow Matching
- 2026Source Anchoring for Physical Consistency in Flow Matching Models
- 2026The Velocity Deficit: Initial Energy Injection for Flow Matching