Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Models
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
In rectified-flow-based generative models, the neural network can be trained to predict two different targets, such as the instantaneous velocity or the data endpoint, to perform denoising. Although prior work shows that these parameterizations lead to different empirical behaviors, the mechanisms underlying their respective advantages remain to be underexplored, and how to combine them effectively is still unclear. In this work, we analyze how learning errors from different parameterizations affect the generation performance. We show that predicting the data endpoint has a clear training signal that stabilizes training, whereas predicting the velocity maintains stable sampling dynamics near the data manifold. Motivated by these insights, we propose Self-Consistent Flow (SC-Flow), a new method that unifies the benefits of both parameterizations. By employing a lightweight consistency loss, SC-Flow jointly trains a single network to predict both the local velocity and the data endpoint, and the consistency between the two predictions improves the model's performance. The method requires no major architectural changes and adds minimal computational overhead. Extensive experiments on image generation tasks demonstrate that SC-Flow substantially stabilizes optimization and improves the straightness of generation paths, leading to significant gains in generation quality over standard rectified-flow baselines.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 20 of its 25 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
20 of 25 references.
Closest ancestors · 2
Same direction, newest first
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 18
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2016Improved Techniques for Training GANscited by 2,938
6 more
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2020First Order Motion Model for Image Animationcited by 698
- 2022Dynamic Dual-Output Diffusion Modelscited by 25
- 2025Both Semantics and Reconstruction Matter: Making Representation Encoders Ready for Text-to-Image Generation and Editingcited by 22
- 2025Optimal Scheduling of Dynamic Transportcited by 12
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Mean Flows for One-step Generative Modeling
- 2026Dual-End Consistency Model
- 2025SoFlow: Solution Flow Models for One-Step Generative Modeling
- 2026Training Flow Matching: The Role of Weighting and Parameterization
- 2025A Theoretical Analysis of Discrete Flow Matching Generative Models
- 2025Graph Flow Matching: Enhancing Image Generation with Neighbor-Aware Flow Fields
- 2025Generative Modeling with Continuous Flows: Sample Complexity of Flow Matching
- 2025Improving Rectified Flow with Boundary Conditions