Distribution Matching Distillation without Fake Score Network
Not on the map. Why?
Abstract (arXiv)
Distribution Matching Distillation (DMD) provides an effective distribution-level correction for few-step generation, while relying on an auxiliary fake-score network to track the evolving generative distribution. Recent work combines DMD-style objectives with flow-map generators to exploit both forward-divergence training and reverse-divergence correction. The fake-score estimator remains an additional component with memory and update overhead. In this work, we study whether this explicit tracker can be avoided when the generator itself has a flow-map structure. We propose Fake-Score-network-Free DMD (FSF-DMD), a DMD formulation for flow-map generators that replaces the auxiliary fake-score estimator with a generator-induced pseudo-velocity surrogate. The key observation is that the endpoint pseudo-velocity of a flow-map generator provides a tractable proxy for fake-velocity estimation, allowing the generator itself to supply the reverse-divergence signal. Building on this observation, we derive a practical objective, extend it with flow-map-consistent backward simulation, and introduce a self-teacher variant for training from scratch. In our ImageNet-1K 256 × 256 experiments, FSF-DMD improves flow-map baselines, reaches lower FID than the listed DMD2 comparisons in the flow-map-initialized setting, and remains effective under flow-matching initialization and training from scratch.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
26 of 30 references.
References · 26
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2016Improved Techniques for Training GANscited by 2,970
- 2023Consistency Modelscited by 1,822
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2025Mean Flows for One-step Generative Modelingcited by 561
14 more
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
- 2024Multistep Distillation of Diffusion Models via Moment Matchingcited by 82
- 2025Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesiscited by 41
- 2025SenseFlow: Scaling Distribution Matching for Flow-based Text-to-Image Distillationcited by 32
- 2025Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Samplingcited by 20
- 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flowscited by 17
- 2025Transition Matching: Scalable and Flexible Generative Modelingcited by 11
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Distilling Drifting Transformers with Representation Autoencoderscited by 3
- 2026Elucidating the Design Space of Regression-based Diffusion Reinforcement Learningcited by 0
- 2026PDMD: Projected Distribution Matching Distillation for Video Diffusion Modelscited by 0
- 2026DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generationcited by 0
- 2026DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation1 Oct 2026
- 2026PDMD: Projected Distribution Matching Distillation for Video Diffusion Models28 Sep 2026
- 2026Elucidating the Design Space of Regression-based Diffusion Reinforcement Learning27 Sep 2026
- 2026Distilling Drifting Transformers with Representation Autoencoders14 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Consistent Distribution Matching for Data-Free Diffusion Distillation
- 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervals
- 2026Continuous-Time Distribution Matching for Few-Step Diffusion Distillation
- 2026Diversity-Preserved Distribution Matching Distillation for Fast Visual Synthesis
- 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shield
- 2026Reinforcing Few-step Generators via Reward-Tilted Distribution Matching
- 2026SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion Distillation
- 20261.x-Distill: Breaking the Diversity, Quality, and Efficiency Barrier in Distribution Matching Distillation