mlsanityData to 14 Oct 2026

Modular MeanFlow: Towards Stable and Scalable One-Step Generative Modeling

arXiv 2508.17426 ↗First posted 24 Aug 2025cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

One-step generative modeling seeks to generate high-quality data samples in a single function evaluation, significantly improving efficiency over traditional diffusion or flow-based models. In this work, we introduce Modular MeanFlow (MMF), a flexible and theoretically grounded approach for learning time-averaged velocity fields. Our method derives a family of loss functions based on a differential identity linking instantaneous and average velocities, and incorporates a gradient modulation mechanism that enables stable training without sacrificing expressiveness. We further propose a curriculum-style warmup schedule to smoothly transition from coarse supervision to fully differentiable training. The MMF formulation unifies and generalizes existing consistency-based and flow-matching methods, while avoiding expensive higher-order derivatives. Empirical results across image synthesis and trajectory modeling tasks demonstrate that MMF achieves competitive sample quality, robust convergence, and strong generalization, particularly under low-data or out-of-distribution settings.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 34 of its 51 references that are in the map. First posted on arXiv 24 Aug 2025.

Builds on

34 of 51 references.

References · 34

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2016Density estimation using Real NVPcited by 2,042
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  7. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  8. 2014NICE: Non-linear Independent Components Estimationcited by 1,058
  9. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  10. 2025Mean Flows for One-step Generative Modelingcited by 561
  11. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
  12. 2023Improved Techniques for Training Consistency Modelscited by 439
22 more
  1. 2022Fast Sampling of Diffusion Models via Operator Learningcited by 175
  2. 2023The probability flow ODE is provably fastcited by 146
  3. 2024Improving the Training of Rectified Flowscited by 108
  4. 2020Improved Analysis of Clipping Algorithms for Non-convex Optimizationcited by 89
  5. 2024One-Step Diffusion Distillation through Score Implicit Matchingcited by 71
  6. 2024EM Distillation for One-step Diffusion Modelscited by 62
  7. 2023One-Step Diffusion Distillation via Deep Equilibrium Modelscited by 61
  8. 2024Convergence Analysis of Probability Flow ODE for Score-based Generative Modelscited by 57
  9. 2025Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecastingcited by 55
  10. 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 41
  11. 2025SepPrune: Structured Pruning for Efficient Deep Speech Separationcited by 31
  12. 2024PaGoDA: Progressive Growing of a One-Step Generator from a Low-Resolution Diffusion Teachercited by 27
  13. 2024SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Modelscited by 25
  14. 2023Neural Diffusion Modelscited by 21
  15. 2024COMAE: COMprehensive Attribute Exploration for Zero-shot Hashingcited by 16
  16. 2025Uni-Instruct: One-step Diffusion Model through Unified Diffusion Divergence Instructioncited by 13
  17. 2024Stable Consistency Tuning: Understanding and Improving Consistency Modelscited by 9
  18. 2025SRKD: Towards Efficient 3D Point Cloud Segmentation via Structure- and Relation-aware Knowledge Distillationcited by 9
  19. 2024Hamiltonian Score Matching and Generative Flowscited by 7
  20. 2024Variance reduction of diffusion model's gradients with Taylor approximation-based control variatecited by 6
  21. 2025MOVER: Multimodal Optimal Transport with Volume-based Embedding Regularizationcited by 6
  22. 2025Integration Flow Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AlphaFlow: Understanding and Improving MeanFlow Models
  2. 2025Towards High-Order Mean Flow Generative Models: Feasibility, Expressivity, and Provably Efficient Criteria
  3. 2025SplitMeanFlow: Interval Splitting Consistency in Few-Step Generative Modeling
  4. 2026Look-Ahead and Look-Back Flows: Training-Free Image Generation with Trajectory Smoothing
  5. 2025MeanFlow Transformers with Representation Autoencoders
  6. 2025Overcoming the Curvature Bottleneck in MeanFlow
  7. 2025SoFlow: Solution Flow Models for One-Step Generative Modeling
  8. 2026Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Models