mlsanityData to 7 Oct 2026

Generative Drifting is Secretly Score Matching: a Spectral and Variational Perspective

arXiv 2603.09936 ↗First posted 10 Mar 2026cs.LGcited by 17

Not on the map. Why?

Abstract (arXiv)

Generative Modeling via Drifting~citepdeng2026drifting has recently achieved state-of-the-art one-step image generation through a kernel-based drift operator, yet its success is largely empirical and its theoretical foundations remain poorly understood. We observe that under a Gaussian kernel, the drift operator is exactly a score difference on smoothed distributions. This answers three questions left open in the original work: (1) whether a vanishing drift guarantees equality of distributions (Vp,q=0Rightarrow p=q), (2) how to choose between kernels, and (3) why the stop-gradient operator is indispensable for stable training. Our observations position drifting within the score-matching family. By linearizing the McKean-Vlasov dynamics and probing them in Fourier space, we reveal frequency-dependent convergence timescales comparable to Landau damping in plasma kinetic theory: the Gaussian kernel suffers an exponential high-frequency bottleneck, potentially explaining the empirical preference for the Laplacian kernel. This suggests a fix: an exponential bandwidth annealing schedule σ(t)=σ0 e-rt that reduces convergence time from exp(O(Kmax2)) to O(log Kmax). Finally, by formalizing drifting as a Wasserstein gradient flow of the smoothed KL divergence, we prove that the stop-gradient operator is not a heuristic but is derived from the frozen-field discretization mandated by the Jordan-Kinderlehrer-Otto (JKO) scheme, and removing it severs training from any gradient-flow guarantee. This variational perspective further provides a general template for constructing novel drift operators, which we demonstrate with a Sinkhorn divergence drift. We validate our analysis on toy datasets and scale it up to ImageNet.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

22 of 37 references.

References · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2022Generative Adversarial Networkscited by 5,603
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  7. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  8. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  9. 2023Consistency Modelscited by 1,778
  10. 2018On the Spectral Bias of Neural Networkscited by 1,321
  11. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  12. 2018Computational Optimal Transportcited by 765
10 more
  1. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
  2. 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
  3. 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
  4. 2021How to Train Your Energy-Based Modelscited by 271
  5. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
  6. 2017Stein Variational Gradient Descent as Gradient Flowcited by 149
  7. 2018Improving GANs Using Optimal Transportcited by 122
  8. 2026Generative Modeling via Driftingcited by 98
  9. 2026A Long-Short Flow-Map Perspective for Drifting Modelscited by 10
  10. 2023The Score-Difference Flow for Implicit Generative Modelingcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 17.

17 papers.

Sort:

By area: