mlsanityData to 14 Oct 2026

Mean Flow Distillation: Robust and Stable Distillation for Flow Matching Models

arXiv 2606.11155 ↗First posted 9 Jun 2026cs.CVcited by 5

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Flow Matching models have demonstrated strong performance across a wide range of generative tasks. However, their reliance on ODE-based iterative sampling incurs substantial computational overhead in inference, which limits their applicability in real-time scenes. While distillation is a promising solution, existing approaches largely borrow from diffusion-based score matching, often failing to exploit the intrinsic geometric structure of flows and suffering from training instability, high variance, and degraded generation quality. In this paper, we propose Mean Flow Distillation (MFD), a novel distillation framework tailored for flow matching models. We theoretically demonstrate that MFD acts as a temporal low-pass filter, effectively suppressing the high-frequency optimization noise inherent in variational score distillation (VSD) while ensuring global trajectory consistency. We further prove the Mean Flow Matching Theorem, establishing that matching expected average velocities is sufficient for strict distribution alignment. Empirically, on challenging tasks of high-dimensional manifolds including 4D occupancy forecasting and text-to-image generation, MFD achieves state-of-the-art performance, enabling high-fidelity single-step generation.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 43 of its 50 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

43 of 50 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026Hierarchical Discrete Flow Matching for Graph Generation31 Mar
  2. 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillation17 Jun
  3. 2024Flow Matching Guide and Code9 Dec
  4. 2024Text-to-Image Rectified Flow as Plug-and-Play Priors5 Jun
  5. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation12 Sep
  6. 2022Flow Matching for Generative Modeling6 Oct
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 36

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2022Generative Adversarial Networkscited by 5,627
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  9. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  10. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  12. 2023Consistency Modelscited by 1,822
24 more
  1. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  2. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  3. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  4. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  5. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  6. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  7. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  8. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  9. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  10. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
  11. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  12. 2025Mean Flows for One-step Generative Modelingcited by 561
  13. 2016Semantic Scene Completion from a Single Depth Imagecited by 472
  14. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
  15. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
  16. 2025Inductive Moment Matchingcited by 113
  17. 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillationcited by 110
  18. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
  19. 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 96
  20. 2024Multistep Consistency Modelscited by 67
  21. 2025SenseFlow: Scaling Distribution Matching for Flow-based Text-to-Image Distillationcited by 32
  22. 2025Towards foundational LiDAR world models with efficient latent flow matchingcited by 10
  23. 2025Score Distillation of Flow Matching Modelscited by 8
  24. 2025Flow Distillation Sampling: Regularizing 3D Gaussians with Pre-trained Matching Priorscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Flow Matching is Adaptive to Manifold Structures
  2. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
  3. 2026InjectFlow: Weak Guides Strong via Orthogonal Injection for Flow Matching
  4. 2025Score-Regularized Joint Sampling with Importance Weights for Flow Matching
  5. 2026Path-Guided Flow Matching for Dataset Distillation
  6. 2026Stable Velocity: A Variance Perspective on Flow Matching
  7. 2024Flow Matching Posterior Sampling: A Training-free Conditional Generation for Flow Matching
  8. 2026Temporal Pair Consistency for Variance-Reduced Flow Matching