mlsanityData to 14 Oct 2026

Overcoming the Curvature Bottleneck in MeanFlow

arXiv 2511.23342 ↗First posted 28 Nov 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

MeanFlow offers a promising framework for one-step generative modeling by directly learning a mean-velocity field, bypassing expensive numerical integration. However, we find that the highly curved generative trajectories of existing models induce a noisy loss landscape, severely bottlenecking convergence and model quality. We leverage a fundamental geometric principle to overcome this: mean-velocity estimation is drastically simpler along straight paths. Building on this insight, we propose Rectified MeanFlow, a self-distillation approach that learns the mean-velocity field over a straightened velocity field, induced by rectified couplings from a pretrained model. To further promote linearity, we introduce a distance-based truncation heuristic that prunes residual high-curvature pairs. By smoothing the optimization landscape, our method achieves strong one-step generation performance. We improve the FID of baseline MeanFlow models from 30.9 to 8.6 under same training budget, and outperform the recent 2-rectified flow++ by 33.4% in FID while running 26x faster. Our work suggests that the difficulty of one-step flow generation stems partially from the rugged optimization landscapes induced by curved trajectories. Code is available at https://github.com/Xinxi-Zhang/Re-MeanFlow.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 55 of its 60 references that are in the map. First posted on arXiv 28 Nov 2025.

Builds on

55 of 60 references.

References · 55

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  10. 2022Classifier-Free Diffusion Guidancecited by 5,847
  11. 2022Flow Matching for Generative Modelingcited by 5,702
  12. 2022Generative Adversarial Networkscited by 5,627
38 more
  1. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  4. 2022Video Diffusion Modelscited by 2,305
  5. 2015Variational Inference with Normalizing Flowscited by 2,170
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  7. 2017Visualizing the Loss Landscape of Neural Netscited by 1,130
  8. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  9. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  10. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  11. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  12. 2025Mean Flows for One-step Generative Modelingcited by 561
  13. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
  14. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
  15. 2023Improved Techniques for Training Consistency Modelscited by 439
  16. 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 402
  17. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
  18. 2024One Step Diffusion via Shortcut Modelscited by 391
  19. 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
  20. 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 283
  21. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
  22. 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 278
  23. 2023Self-Consuming Generative Models Go MADcited by 250
  24. 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 225
  25. 2023Fast Training of Diffusion Models with Masked Transformerscited by 176
  26. 2024Consistency Models Made Easycited by 144
  27. 2020OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transportcited by 143
  28. 2025Inductive Moment Matchingcited by 113
  29. 2024Improving the Training of Rectified Flowscited by 108
  30. 2024Consistency Flow Matching: Defining Straight Flows with Velocity Consistencycited by 104
  31. 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 102
  32. 2024Normalizing Flows are Capable Generative Modelscited by 91
  33. 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
  34. 2024Self-Improving Diffusion Models with Synthetic Datacited by 35
  35. 2024Stretching Each Dollar: Diffusion Training from Scratch on a Micro-Budgetcited by 30
  36. 2024Truncated Consistency Modelscited by 22
  37. 2025CMT: Mid-Training for Efficient Learning of Consistency, Mean Flow, and Flow Map Modelscited by 18
  38. 2025Improved Training Technique for Latent Consistency Modelscited by 13

50 most cited of 55 All 55 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Riemannian MeanFlow for One-Step Generation on Manifolds
  2. 2025AlphaFlow: Understanding and Improving MeanFlow Models
  3. 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modeling
  4. 2025Towards High-Order Mean Flow Generative Models: Feasibility, Expressivity, and Provably Efficient Criteria
  5. 2025Learning Straight Flows by Learning Curved Interpolants
  6. 2023Minimizing Trajectory Curvature of ODE-based Generative Models
  7. 2025Modular MeanFlow: Towards Stable and Scalable One-Step Generative Modeling
  8. 2024On the Convergence and Straightness of Rectified Flow