Mean Flow Distillation: Robust and Stable Distillation for Flow Matching Models
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Flow Matching models have demonstrated strong performance across a wide range of generative tasks. However, their reliance on ODE-based iterative sampling incurs substantial computational overhead in inference, which limits their applicability in real-time scenes. While distillation is a promising solution, existing approaches largely borrow from diffusion-based score matching, often failing to exploit the intrinsic geometric structure of flows and suffering from training instability, high variance, and degraded generation quality. In this paper, we propose Mean Flow Distillation (MFD), a novel distillation framework tailored for flow matching models. We theoretically demonstrate that MFD acts as a temporal low-pass filter, effectively suppressing the high-frequency optimization noise inherent in variational score distillation (VSD) while ensuring global trajectory consistency. We further prove the Mean Flow Matching Theorem, establishing that matching expected average velocities is sufficient for strict distribution alignment. Empirically, on challenging tasks of high-dimensional manifolds including 4D occupancy forecasting and text-to-image generation, MFD achieves state-of-the-art performance, enabling high-fidelity single-step generation.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 43 of its 50 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
43 of 50 references.
Closest ancestors · 7
Same direction, newest first
- 2026Hierarchical Discrete Flow Matching for Graph Generation31 Mar
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillation17 Jun
- 2024Flow Matching Guide and Code9 Dec
- 2024Text-to-Image Rectified Flow as Plug-and-Play Priors5 Jun
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation12 Sep
- 2022Flow Matching for Generative Modeling6 Oct
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Generative Adversarial Networkscited by 5,627
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023Consistency Modelscited by 1,822
24 more
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
- 2025Inductive Moment Matchingcited by 113
- 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillationcited by 110
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 96
- 2024Multistep Consistency Modelscited by 67
- 2025SenseFlow: Scaling Distribution Matching for Flow-based Text-to-Image Distillationcited by 32
- 2025Towards foundational LiDAR world models with efficient latent flow matchingcited by 10
- 2025Score Distillation of Flow Matching Modelscited by 8
- 2025Flow Distillation Sampling: Regularizing 3D Gaussians with Pre-trained Matching Priorscited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Generative World Renderer at the Speed of Playcited by 4
- 2026Poly-OPD: Heterogeneous Multi-Teacher On-Policy Distillation for Capability-Selectable Flow Modelscited by 4
- 2026DriftOPD: Sequence-Level Reverse-KL Distillation for One-Step VLA Policiescited by 0
- 2026Geometry-Aware Time Reparameterization for Flow-Map Distillationcited by 0
- 2026Consistent Distribution Matching for Data-Free Diffusion Distillationcited by 0
- 2026Consistent Distribution Matching for Data-Free Diffusion Distillation6 Oct 2026
- 2026Geometry-Aware Time Reparameterization for Flow-Map Distillation1 Oct 2026
- 2026DriftOPD: Sequence-Level Reverse-KL Distillation for One-Step VLA Policies29 Sep 2026
- 2026Poly-OPD: Heterogeneous Multi-Teacher On-Policy Distillation for Capability-Selectable Flow Models5 Aug 2026
- 2026Generative World Renderer at the Speed of Play21 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Flow Matching is Adaptive to Manifold Structures
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
- 2026InjectFlow: Weak Guides Strong via Orthogonal Injection for Flow Matching
- 2025Score-Regularized Joint Sampling with Importance Weights for Flow Matching
- 2026Path-Guided Flow Matching for Dataset Distillation
- 2026Stable Velocity: A Variance Perspective on Flow Matching
- 2024Flow Matching Posterior Sampling: A Training-free Conditional Generation for Flow Matching
- 2026Temporal Pair Consistency for Variance-Reduced Flow Matching