mlsanityData to 14 Oct 2026

On The Hidden Biases of Flow Matching Samplers

arXiv 2512.16768 ↗First posted 18 Dec 2025stat.ML cs.LG math.PRcited by 2

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Flow matching (FM) constructs continuous-time ODE samplers by prescribing probability paths between a base distribution and a target distribution. In this note, we study FM through the lens of finite-sample plug-in estimation. In addition to replacing population expectations by sample averages, one may replace the target distribution itself by a finite-sample surrogate, ranging from the empirical measure to a smoothed estimator. This viewpoint yields a natural hierarchy of empirical FM models. For affine conditional flows, we derive the exact empirical minimizer and identify a smoothed plug-in regime in which the terminal law is exactly a kernel-mixture estimator. This plug-in perspective clarifies several coupled finite-sample biases of empirical FM. First, replacing the target law by a finite-sample surrogate changes the statistical target. Second, the empirical minimizer is generally not a gradient field, even when each conditional flow is. Third, a fixed empirical marginal path does not determine a unique particle dynamics: one may add extra vector fields whose probability flux has zero divergence without changing the marginal path. For Gaussian affine conditional paths, we give explicit families of such flux-null corrections. Finally, the source distribution provides a primary mechanism controlling upper tails of kinetic energy. In particular, Gaussian bases yield exponential upper-tail bounds for instantaneous and integrated kinetic energies, whereas polynomially tailed bases yield corresponding polynomial upper-tail bounds.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 45 of its 58 references that are in the map. First posted on arXiv 18 Dec 2025.

Builds on

45 of 58 references.

Closest ancestors · 20

Same direction, newest first

  1. 2025EnfoPath: Energy-Informed Analysis of Generative Trajectories in Flow Matching24 Nov
  2. 2025Statistical Properties of Rectified Flow5 Nov
  3. 2025The Generation Phases of Flow Matching: a Denoising Perspective28 Oct
  4. 2025Gradient Variance Reveals Failure Modes in Flow-Based Generative Models20 Oct
  5. 2025Carr'e du champ flow matching: better quality-generalisation tradeoff in generative models7 Oct
  6. 2025Distribution estimation via Flow Matching with Lipschitz guarantees2 Sep
  7. 2025On the Closed-Form of Flow Matching: Generalization Does Not Arise from Target Stochasticity4 Jun
  8. 2025On the Relation between Rectified Flows and Optimal Transport26 May
  9. 2025FLEX: A Backbone for Diffusion-Based Modeling of Spatio-temporal Physical Systems23 May
  10. 2025On the minimax optimality of Flow Matching through the connection to kernel density estimation17 Apr
  11. 2025On the Guidance of Flow Matching4 Feb
  12. 2025Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans28 Jan
8 more
  1. 2024Flow Matching Guide and Code9 Dec
  2. 2024How Do Flow Matching Models Memorize and Generalize in Sample Data Subspaces?31 Oct
  3. 2024Elucidating the Design Choice of Probability Paths in Flow Matching for Forecasting4 Oct
  4. 2024Flow Priors for Linear Inverse Problems via Iterative Corrupted Trajectory Matching29 May
  5. 2023Improving and generalizing flow-based generative models with minibatch optimal transport1 Feb
  6. 2022Flow Matching for Generative Modeling6 Oct
  7. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transport29 Sep
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 25

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  3. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  4. 2022Score-Based Generative Models Detect Manifoldscited by 122
  5. 2025The Principles of Diffusion Modelscited by 76
  6. 2019A Wasserstein-type distance in the space of Gaussian Mixture Modelscited by 75
  7. 2021Plugin Estimation of Smooth Optimal Transport Mapscited by 68
  8. 2024Statistical optimal transportcited by 47
  9. 2023Closed-Form Diffusion Modelscited by 46
  10. 2023On Kinetic Optimal Probability Paths for Generative Modelscited by 42
  11. 2025Memorization and Regularization in Generative Diffusion Modelscited by 40
  12. 2024A Good Score Does not Lead to A Good Generative Modelcited by 36
13 more
  1. 2024On gauge freedom, conservativity and intrinsic dimensionality estimation in diffusion modelscited by 23
  2. 2025Lipschitz-Guided Design of Interpolation Schedules in Generative Modelscited by 17
  3. 2016An introduction to sampling via measure transportcited by 16
  4. 2025Entropic Time Schedulers for Generative Diffusion Modelscited by 16
  5. 2025On the Interpolation Effect of Score Smoothing in Diffusion Modelscited by 15
  6. 2025Provable Separations between Memorization and Generalization in Diffusion Modelscited by 14
  7. 2023Deterministic Guidance Diffusion Model for Probabilistic Weather Forecastingcited by 9
  8. 2025From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Settingcited by 9
  9. 2021Iterated Vector Fields and Conservatism, with Applications to Federated Learningcited by 8
  10. 2025Resolving Memorization in Empirical Diffusion Model for Manifold Data in High-Dimensional Spacescited by 8
  11. 2025Optimal and Diffusion Transports in Machine Learningcited by 6
  12. 2023Learning to Sample Bettercited by 4
  13. 2025Generation Properties of Stochastic Interpolation under Finite Training Setcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Elucidating Flow Matching ODE Dynamics with Respect to Data Geometries and Denoisers
  2. 2024Flow matching achieves almost minimax optimal convergence
  3. 2025Score-Regularized Joint Sampling with Importance Weights for Flow Matching
  4. 2026Discrete Flow Matching: Convergence Guarantees Under Minimal Assumptions
  5. 2026Prediction--Loss Alignment for Sampler--Robust Flow Matching Training
  6. 2024Theoretical guarantees in KL for Diffusion Flow Matching
  7. 2025Generative Modeling with Continuous Flows: Sample Complexity of Flow Matching
  8. 2026FlowBudget: Training-Free Sampling-Budget Estimation for Flow Matching Models