mlsanityData to 14 Oct 2026

Demystifying Transition Matching: When and Why It Can Beat Flow Matching

arXiv 2510.17991 ↗First posted 20 Oct 2025cs.LG cs.CVcited by 0

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Flow Matching (FM) underpins many state-of-the-art generative models, yet recent results indicate that Transition Matching (TM) can achieve higher quality with fewer sampling steps. This work answers the question of when and why TM outperforms FM. First, when the target is a unimodal Gaussian distribution, we prove that TM attains strictly lower KL divergence than FM for finite number of steps. The improvement arises from stochastic difference latent updates in TM, which preserve target covariance that deterministic FM underestimates. We then characterize convergence rates, showing that TM achieves faster convergence than FM under a fixed compute budget, establishing its advantage in the unimodal Gaussian setting. Second, we extend the analysis to Gaussian mixtures and identify local-unimodality regimes in which the sampling dynamics approximate the unimodal case, where TM can outperform FM. The approximation error decreases as the minimal distance between component means increases, highlighting that TM is favored when the modes are well separated. However, when the target variance approaches zero, each TM update converges to the FM update, and the performance advantage of TM diminishes. In summary, we show that TM outperforms FM when the target distribution has well-separated modes and non-negligible variances. We validate our theoretical results with controlled experiments on Gaussian distributions, and extend the comparison to real-world applications in image and video generation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 35 of its 52 references that are in the map. First posted on arXiv 20 Oct 2025.

Builds on

35 of 52 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Transition Matching: Scalable and Flexible Generative Modeling30 Jun
  2. 2025On the Closed-Form of Flow Matching: Generalization Does Not Arise from Target Stochasticity4 Jun
  3. 2024Generator Matching: Generative modeling with arbitrary Markov processes27 Oct
  4. 2024Discrete Flow Matching22 Jul
  5. 2024Explicit Flow Matching: On The Theory of Flow Matching Algorithms with Applications5 Feb
  6. 2022Flow Matching for Generative Modeling6 Oct
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 28

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  9. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  10. 2016Improved Techniques for Training GANscited by 2,970
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
16 more
  1. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  2. 2021Variational Diffusion Modelscited by 1,153
  3. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  4. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  5. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  6. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  7. 2025History-Guided Video Diffusioncited by 171
  8. 2024Dynamical Regimes of Diffusion Modelscited by 142
  9. 2024FlowMM: Generating Materials with Riemannian Flow Matchingcited by 109
  10. 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
  11. 2023Monte Carlo guided Diffusion for Bayesian linear inverse problemscited by 66
  12. 2025Proteina: Scaling Flow-based Protein Structure Generative Modelscited by 65
  13. 2023Closed-Form Diffusion Modelscited by 46
  14. 2023Stable Target Field for Reduced Variance Score Estimation in Diffusion Modelscited by 44
  15. 2023On Kinetic Optimal Probability Paths for Generative Modelscited by 42
  16. 2024Improving Probabilistic Diffusion Models With Optimal Diagonal Covariance Matchingcited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Exploring the Design Space of Transition Matching
  2. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
  3. 2024Exploring Diffusion and Flow Matching Under Generator Matching
  4. 2024Flow matching achieves almost minimax optimal convergence
  5. 2026Gradual Fine-Tuning for Flow Matching Models
  6. 2025GLASS Flows: Transition Sampling for Alignment of Flow and Diffusion Models
  7. 2024Local Flow Matching Generative Models
  8. 2026Tracing Generated Samples to Training-Data Clusters in Flow-Matching Models