Overcoming the Curvature Bottleneck in MeanFlow
Not on the map. Why?
Abstract (arXiv)
MeanFlow offers a promising framework for one-step generative modeling by directly learning a mean-velocity field, bypassing expensive numerical integration. However, we find that the highly curved generative trajectories of existing models induce a noisy loss landscape, severely bottlenecking convergence and model quality. We leverage a fundamental geometric principle to overcome this: mean-velocity estimation is drastically simpler along straight paths. Building on this insight, we propose Rectified MeanFlow, a self-distillation approach that learns the mean-velocity field over a straightened velocity field, induced by rectified couplings from a pretrained model. To further promote linearity, we introduce a distance-based truncation heuristic that prunes residual high-curvature pairs. By smoothing the optimization landscape, our method achieves strong one-step generation performance. We improve the FID of baseline MeanFlow models from 30.9 to 8.6 under same training budget, and outperform the recent 2-rectified flow++ by 33.4% in FID while running 26x faster. Our work suggests that the difficulty of one-step flow generation stems partially from the rugged optimization landscapes induced by curved trajectories. Code is available at https://github.com/Xinxi-Zhang/Re-MeanFlow.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 55 of its 60 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
55 of 60 references.
References · 55
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Generative Adversarial Networkscited by 5,627
38 more
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2022Video Diffusion Modelscited by 2,305
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2017Visualizing the Loss Landscape of Neural Netscited by 1,130
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 402
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 283
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
- 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 278
- 2023Self-Consuming Generative Models Go MADcited by 250
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 225
- 2023Fast Training of Diffusion Models with Masked Transformerscited by 176
- 2024Consistency Models Made Easycited by 144
- 2020OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transportcited by 143
- 2025Inductive Moment Matchingcited by 113
- 2024Improving the Training of Rectified Flowscited by 108
- 2024Consistency Flow Matching: Defining Straight Flows with Velocity Consistencycited by 104
- 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 102
- 2024Normalizing Flows are Capable Generative Modelscited by 91
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
- 2024Self-Improving Diffusion Models with Synthetic Datacited by 35
- 2024Stretching Each Dollar: Diffusion Training from Scratch on a Micro-Budgetcited by 30
- 2024Truncated Consistency Modelscited by 22
- 2025CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Modelscited by 18
- 2025Improved Training Technique for Latent Consistency Modelscited by 13
50 most cited of 55 All 55 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Riemannian MeanFlow for One-Step Generation on Manifolds
- 2025AlphaFlow: Understanding and Improving MeanFlow Models
- 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modeling
- 2025Towards High-Order Mean Flow Generative Models: Feasibility, Expressivity, and Provably Efficient Criteria
- 2025Learning Straight Flows by Learning Curved Interpolants
- 2023Minimizing Trajectory Curvature of ODE-based Generative Models
- 2025Modular MeanFlow: Towards Stable and Scalable One-Step Generative Modeling
- 2024On the Convergence and Straightness of Rectified Flow