mlsanityData to 7 Oct 2026

The Velocity Deficit: Initial Energy Injection for Flow Matching

arXiv 2605.14819 ↗First posted 14 May 2026cs.CVcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

While Flow Matching theoretically guarantees constant-velocity trajectories, we identify a critical breakdown in high-dimensional practice: the Velocity Deficit. We show that the MSE objective systematically underestimates velocity magnitude, causing generated samples to fail to reach the data manifold-a phenomenon we term Integration Lag. To rectify this, we propose Initial Energy Injection, instantiated via two complementary methods: the training-based Magnitude-Aware Flow Matching (MAFM) and the training-free Scale Schedule Corrector (SSC). Both are grounded in our discovery of a crucial asymmetry: velocity contraction causes harmful kinetic stagnation at the trajectory's start, yet acts as a beneficial denoising mechanism at its end. Empirically, SSC yields significant efficiency gains with zero retraining and just one line of code. On ImageNet-1k (256x256), it improves FID by 44.6% (from 13.68 to 7.58) and achieves a 5x speedup, enabling a 50-step generator (FID 7.58) to beat a 250-step baseline (FID 8.65). Furthermore, our methods generalize to Text-to-Image tasks and high-resolution generation, improving FID on MS-COCO by ~22%.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 23 of its 29 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

23 of 29 references.

Closest ancestors · 5

Same direction, newest first

  1. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation12 Sep
  2. 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplings28 Apr
  3. 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
  4. 2022Flow Matching for Generative Modeling6 Oct
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 18

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2018Neural Ordinary Differential Equationscited by 3,733
  10. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  11. 2016Improved Techniques for Training GANscited by 2,938
  12. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
6 more
  1. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  2. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  3. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
  4. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
  5. 2021Generating Images with Sparse Representationscited by 262
  6. 2023Efficient Diffusion Training via Min-SNR Weighting Strategycited by 242

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Velocity Scaling in Flow Matching
  2. 2026Stable Velocity: A Variance Perspective on Flow Matching
  3. 2026ReAL: Accelerating Flow Matching through Segment Advancement with Shared Lookahead
  4. 2025Graph Flow Matching: Enhancing Image Generation with Neighbor-Aware Flow Fields
  5. 2026Temporal Pair Consistency for Variance-Reduced Flow Matching
  6. 2026InjectFlow: Weak Guides Strong via Orthogonal Injection for Flow Matching
  7. 2026Energy-Guided Flow Matching
  8. 2026MeanCache: From Instantaneous to Average Velocity for Accelerating Flow Matching Inference