mlsanityData to 7 Oct 2026

Multi-Bandwidth Distribution Matching Distillation: On the Equivalence of Distribution Matching Distillation and Drifting Models

arXiv 2610.10989 ↗First posted 7 Oct 2026cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Researchers are exploring effective one-step generative model continuously, and, Drifting Models (Deng et al., 2026), demonstrate great potential in one-step generation recently. There are works that reveal the connection between Diffusion & Flow Style Generative Models (DFSGMs) (Ho et al., 2020; Song et al., 2020a;b; Lipman et al., 2022; Liu et al., 2022) and Drifting Models (Li & Zhu, 2026; Lai et al., 2026; Turan et al., 2026). But no one has yet established a precise correspondence between the Drifting Model and the widely used distillation method- Distribution Matching Distillation (DMD/DMD2) (Yin et al., 2024b;a) to the best of our knowledge, even though their optimization objective formulas are virtually identical. In this paper, we prove that by converting the velocity-field / noise-field from the pre-trained DFSGMs into the attraction force field in Drifting Models and estimating the repulsion force field from the generative distribution, training the Drifting Model is naturally equivalent to the Distribution Matching Distillation. With this equivalent concept, we propose an improved method based on DMD from the Drifting Model's perspective- Multi-Bandwidth Distribution Matching Distillation (MBDMD).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

16 of 27 references.

References · 16

  1. 2020Denoising Diffusion Implicit Modelscited by 9,655
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  5. 2024Flow Matching Guide and Codecited by 291
  6. 2026Generative Modeling via Driftingcited by 98
  7. 2025SenseFlow: Scaling Distribution Matching for Flow-based Text-to-Image Distillationcited by 29
  8. 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervalscited by 21
  9. 2026Diversity-Preserved Distribution Matching Distillation for Fast Visual Synthesiscited by 20
  10. 2026One-Step Generative Modeling via Wasserstein Gradient Flowscited by 18
  11. 2025Flash-DMD: Towards High-Fidelity Few-Step Image Generation with Efficient Distillation and Joint Reinforcement Learningcited by 17
  12. 2026Generative Drifting is Secretly Score Matching: a Spectral and Variational Perspectivecited by 17
4 more
  1. 2026A Long-Short Flow-Map Perspective for Drifting Modelscited by 10
  2. 2026Reinforcing Few-step Generators via Reward-Tilted Distribution Matchingcited by 6
  3. 20261.x-Distill: Breaking the Diversity, Quality, and Efficiency Barrier in Distribution Matching Distillationcited by 4
  4. 2026Teacher-Feature Drifting: One-Step Diffusion Distillation with Pretrained Diffusion Representationscited by 2

Built on by

Not cited yet.