mlsanityData to 14 Oct 2026

Distribution Matching Distillation without Fake Score Network

arXiv 2605.19256 ↗First posted 19 May 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Distribution Matching Distillation (DMD) provides an effective distribution-level correction for few-step generation, while relying on an auxiliary fake-score network to track the evolving generative distribution. Recent work combines DMD-style objectives with flow-map generators to exploit both forward-divergence training and reverse-divergence correction. The fake-score estimator remains an additional component with memory and update overhead. In this work, we study whether this explicit tracker can be avoided when the generator itself has a flow-map structure. We propose Fake-Score-network-Free DMD (FSF-DMD), a DMD formulation for flow-map generators that replaces the auxiliary fake-score estimator with a generator-induced pseudo-velocity surrogate. The key observation is that the endpoint pseudo-velocity of a flow-map generator provides a tractable proxy for fake-velocity estimation, allowing the generator itself to supply the reverse-divergence signal. Building on this observation, we derive a practical objective, extend it with flow-map-consistent backward simulation, and introduce a self-teacher variant for training from scratch. In our ImageNet-1K 256 × 256 experiments, FSF-DMD improves flow-map baselines, reaches lower FID than the listed DMD2 comparisons in the flow-map-initialized setting, and remains effective under flow-matching initialization and training from scratch.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

26 of 30 references.

References · 26

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  6. 2016Improved Techniques for Training GANscited by 2,970
  7. 2023Consistency Modelscited by 1,822
  8. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  9. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  10. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  11. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  12. 2025Mean Flows for One-step Generative Modelingcited by 561
14 more
  1. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
  2. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
  3. 2024One Step Diffusion via Shortcut Modelscited by 391
  4. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
  5. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
  6. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
  7. 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
  8. 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
  9. 2024Multistep Distillation of Diffusion Models via Moment Matchingcited by 82
  10. 2025Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesiscited by 41
  11. 2025SenseFlow: Scaling Distribution Matching for Flow-based Text-to-Image Distillationcited by 32
  12. 2025Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Samplingcited by 20
  13. 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flowscited by 17
  14. 2025Transition Matching: Scalable and Flexible Generative Modelingcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Consistent Distribution Matching for Data-Free Diffusion Distillation
  2. 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervals
  3. 2026Continuous-Time Distribution Matching for Few-Step Diffusion Distillation
  4. 2026Diversity-Preserved Distribution Matching Distillation for Fast Visual Synthesis
  5. 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shield
  6. 2026Reinforcing Few-step Generators via Reward-Tilted Distribution Matching
  7. 2026SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion Distillation
  8. 20261.x-Distill: Breaking the Diversity, Quality, and Efficiency Barrier in Distribution Matching Distillation