On the Convergence and Straightness of Rectified Flow
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Flow Matching has become a cornerstone of modern generative models like Stable Diffusion 3, largely due to the efficiency of its Rectified Flow (RF) variant. The success of RF hinges on iteratively learning straight trajectories, pushing generation towards fewer sampling steps. However, the theoretical link between path geometry and sampling efficiency has been underexplored. This paper fills this gap by introducing a novel textitPiecewise Straightness parameter, γ2,T. We establish the first Wasserstein convergence bound that explicitly links the discretization error of textitany general flow-model to γ2,T, proving that minimizing curvature is the key to achieving high-fidelity, one-step sampling. Building on this theory, we establish the first theoretical framework to analyze the straightness of RF. We begin by offering intuitive geometric arguments for simple cases before identifying sufficient conditions under which a single rectification step (1-RF) yields a perfectly straight or even a Monge optimal coupling. While whether these sufficient conditions are met depends on the problem geometry, they enable the first concrete proofs in this area. Critically, fulfilling these conditions makes the subsequent flow (2-RF) perfectly straight (γ2,T=0). This eliminates the discretization error in our bound and makes flawless, single-step sampling possible.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 25 of its 37 references that are in the map. First posted on arXiv 19 Oct 2024.
Builds on
25 of 37 references.
Closest ancestors · 6
Same direction, newest first
- 2024Improving the Training of Rectified Flows30 May
- 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Accelerator13 May
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation12 Sep
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transport29 Sep
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 19
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2023Consistency Modelscited by 1,778
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 440
7 more
- 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statisticscited by 161
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Modelscited by 84
- 2022Score-based Generative Modeling Secretly Minimizes the Wasserstein Distancecited by 50
- 2023On Kinetic Optimal Probability Paths for Generative Modelscited by 42
- 2024Towards a mathematical theory for consistency training in diffusion modelscited by 25
- 2023Improved Convergence of Score-Based Diffusion Models via Prediction-Correctioncited by 23
- 2023Improved Sample Complexity Bounds for Diffusion Model Trainingcited by 13
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025Curly Flow Matching for Learning Non-gradient Field Dynamicscited by 17
- 2025On the Relation between Rectified Flows and Optimal Transportcited by 15
- 2025Mirror Flow Matching with Heavy-Tailed Priors for Generative Modeling on Convex Domainscited by 8
- 2026Flow Matching is Adaptive to Manifold Structurescited by 8
- 2026Low-Dimensional Adaptation of Rectified Flow: A Diffusion and Stochastic Localization Perspectivecited by 2
- 2026Total Variation Rates for Riemannian Flow Matchingcited by 2
- 2026One-Shot Generative Flows: Existence and Obstructionscited by 2
- 2026Tessellations of Semi-Discrete Flow Matchingcited by 2
- 2025An Eulerian Perspective on Straight-Line Samplingcited by 0
- 2026Optimal Self-Distillation for Rectified Flow via Linear Probingcited by 0
- 2026Computational and Statistical Guarantees of the textitc-Rectified flowcited by 0
- 2026Computational and Statistical Guarantees of the textitc-Rectified flow3 Aug 2026
- 2026Optimal Self-Distillation for Rectified Flow via Linear Probing16 Jul 2026
- 2026Tessellations of Semi-Discrete Flow Matching8 May 2026
- 2026One-Shot Generative Flows: Existence and Obstructions16 Apr 2026
- 2026Flow Matching is Adaptive to Manifold Structures25 Feb 2026
- 2026Total Variation Rates for Riemannian Flow Matching5 Feb 2026
- 2026Low-Dimensional Adaptation of Rectified Flow: A Diffusion and Stochastic Localization Perspective21 Jan 2026
- 2025Curly Flow Matching for Learning Non-gradient Field Dynamics30 Oct 2025
- 2025An Eulerian Perspective on Straight-Line Sampling13 Oct 2025
- 2025Mirror Flow Matching with Heavy-Tailed Priors for Generative Modeling on Convex Domains10 Oct 2025
- 2025On the Relation between Rectified Flows and Optimal Transport26 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026Order-Optimal Sample Complexity of Rectified Flows
- 2024Rectified Diffusion: Straightness Is Not Your Need in Rectified Flow
- 2026Limit Points of Reflow with Minibatch Optimal Transport
- 2024Optimal Flow Matching: Learning Straight Trajectories in Just One Step
- 2025Flow Diverse and Efficient: Learning Momentum Flow Matching via Stochastic Velocity Field Sampling
- 2024Flow matching achieves almost minimax optimal convergence
- 2026The Geometry Behind Diffusion and Flow Matching: Gradient Flows and Geodesics in Wasserstein Space
- 2026Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guarantees