mlsanityData to 14 Oct 2026

FACM: Flow-Anchored Consistency Models

arXiv 2507.03738 ↗First posted 4 Jul 2025cs.CVcited by 16

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Continuous-time Consistency Models (CMs) promise efficient few-step generation but face significant challenges with training instability. We argue this instability stems from a fundamental conflict: Training the network exclusively on a shortcut objective leads to the catastrophic forgetting of the instantaneous velocity field that defines the flow. Our solution is to explicitly anchor the model in the underlying flow, ensuring high trajectory fidelity during training. We introduce the Flow-Anchored Consistency Model (FACM), where a Flow Matching (FM) task serves as a dynamic anchor for the primary CM shortcut objective. Key to this Flow-Anchoring approach is a novel expanded time interval strategy that unifies optimization for a single model while decoupling the two tasks to ensure stable, architecturally-agnostic training. By distilling a pre-trained LightningDiT model, our method achieves a state-of-the-art FID of 1.32 with two steps (NFE=2) and 1.70 with just one step (NFE=1) on ImageNet 256x256. To address the challenge of scalability, we develop a memory-efficient Chain-JVP that resolves key incompatibilities with FSDP. This method allows us to scale FACM training on a 14B parameter model (Wan 2.2), accelerating its Text-to-Image inference from 2x40 to 2-8 steps. Our code and pretrained models: https://github.com/ali-vilab/FACM.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 26 of its 33 references that are in the map. First posted on arXiv 4 Jul 2025.

Builds on

26 of 33 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillation17 Jun
  2. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models11 Jun
  3. 2022Flow Matching for Generative Modeling6 Oct
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  8. 2023Consistency Modelscited by 1,822
  9. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  10. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  11. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  12. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
10 more
  1. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  2. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  3. 2023Improved Techniques for Training Consistency Modelscited by 439
  4. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
  5. 2024One Step Diffusion via Shortcut Modelscited by 391
  6. 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 304
  7. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
  8. 2024Consistency Models Made Easycited by 144
  9. 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillationcited by 116
  10. 2025Unified Continuous Generative Modelscited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 6.

16 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Exploring and Exploiting Stability in Latent Flow Matching
  2. 2024Consistency Flow Matching: Defining Straight Flows with Velocity Consistency
  3. 2025CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Models
  4. 2026Stable Velocity: A Variance Perspective on Flow Matching
  5. 2026Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Models
  6. 2026Temporal Pair Consistency for Variance-Reduced Flow Matching
  7. 2026Source Anchoring for Physical Consistency in Flow Matching Models
  8. 2026The Velocity Deficit: Initial Energy Injection for Flow Matching