Generative Drifting is Secretly Score Matching: a Spectral and Variational Perspective
Not on the map. Why?
Abstract (arXiv)
Generative Modeling via Drifting~citepdeng2026drifting has recently achieved state-of-the-art one-step image generation through a kernel-based drift operator, yet its success is largely empirical and its theoretical foundations remain poorly understood. We observe that under a Gaussian kernel, the drift operator is exactly a score difference on smoothed distributions. This answers three questions left open in the original work: (1) whether a vanishing drift guarantees equality of distributions (Vp,q=0Rightarrow p=q), (2) how to choose between kernels, and (3) why the stop-gradient operator is indispensable for stable training. Our observations position drifting within the score-matching family. By linearizing the McKean-Vlasov dynamics and probing them in Fourier space, we reveal frequency-dependent convergence timescales comparable to Landau damping in plasma kinetic theory: the Gaussian kernel suffers an exponential high-frequency bottleneck, potentially explaining the empirical preference for the Laplacian kernel. This suggests a fix: an exponential bandwidth annealing schedule σ(t)=σ0 e-rt that reduces convergence time from exp(O(Kmax2)) to O(log Kmax). Finally, by formalizing drifting as a Wasserstein gradient flow of the smoothed KL divergence, we prove that the stop-gradient operator is not a heuristic but is derived from the frozen-field discretization mandated by the Jordan-Kinderlehrer-Otto (JKO) scheme, and removing it severs training from any gradient-flow guarantee. This variational perspective further provides a general template for constructing novel drift operators, which we demonstrate with a Sinkhorn divergence drift. We validate our analysis on toy datasets and scale it up to ImageNet.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
22 of 37 references.
References · 22
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Generative Adversarial Networkscited by 5,603
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2023Consistency Modelscited by 1,778
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2018Computational Optimal Transportcited by 765
10 more
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
- 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
- 2021How to Train Your Energy-Based Modelscited by 271
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
- 2017Stein Variational Gradient Descent as Gradient Flowcited by 149
- 2018Improving GANs Using Optimal Transportcited by 122
- 2026Generative Modeling via Driftingcited by 98
- 2026A Long-Short Flow-Map Perspective for Drifting Modelscited by 10
- 2023The Score-Difference Flow for Implicit Generative Modelingcited by 9
Built on by
Citing papers per year: 2026: 17.
17 papers.
Sort:
By area:
- 2026One-Step Generative Modeling via Wasserstein Gradient Flowscited by 18
- 2026Drifting Fields are not Conservativecited by 11
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Modelscited by 6
- 2026Kernel-Gradient Drifting Modelscited by 6
- 2026Teacher-Feature Drifting: One-Step Diffusion Distillation with Pretrained Diffusion Representationscited by 2
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fieldscited by 2
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Modelscited by 2
- 2026Drifting Field Policy: A One-Step Generative Policy via Wasserstein Gradient Flowcited by 1
- 2026Second Order Drifting Modelscited by 1
- 2026Unifying Distributional Training for One-Step Visual Generationcited by 1
- 2026Identifiability and Stability of Generative Drifting in the Companion-Elliptic Kernel Familycited by 0
- 2026Difference of Convex Programming in the Wasserstein Space with Applications to MMD Optimizationcited by 0
5 more
- 2026DriftST: One-Step Generative Inference of Spatial Transcriptomics from H&E Histologycited by 0
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Modelscited by 0
- 2026DriftSE: Speech Enhancement with Generative Driftingcited by 0
- 2026Refresh or Realize? Compute Allocation in Drifting Modelscited by 0
- 2026Multi-Bandwidth Distribution Matching Distillation: On the Equivalence of Distribution Matching Distillation and Drifting Modelscited by 0
- 2026Multi-Bandwidth Distribution Matching Distillation: On the Equivalence of Distribution Matching Distillation and Drifting Models7 Oct 2026
- 2026Unifying Distributional Training for One-Step Visual Generation28 Sep 2026
- 2026Refresh or Realize? Compute Allocation in Drifting Models26 Sep 2026
- 2026DriftSE: Speech Enhancement with Generative Drifting10 Sep 2026
- 2026Second Order Drifting Models8 Aug 2026
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Models3 Aug 2026
- 2026DriftST: One-Step Generative Inference of Spatial Transcriptomics from H&E Histology6 Jul 2026
- 2026Difference of Convex Programming in the Wasserstein Space with Applications to MMD Optimization26 Jun 2026
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Models21 May 2026
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fields12 May 2026
- 2026One-Step Generative Modeling via Wasserstein Gradient Flows12 May 2026
- 2026Kernel-Gradient Drifting Models11 May 2026
5 more
- 2026Drifting Field Policy: A One-Step Generative Policy via Wasserstein Gradient Flow8 May 2026
- 2026Teacher-Feature Drifting: One-Step Diffusion Distillation with Pretrained Diffusion Representations8 May 2026
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Models6 May 2026
- 2026Identifiability and Stability of Generative Drifting in the Companion-Elliptic Kernel Family27 Apr 2026
- 2026Drifting Fields are not Conservative7 Apr 2026
- 2026Drifting Fields are not Conservativecited by 11
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Modelscited by 6
- 2026Kernel-Gradient Drifting Modelscited by 6
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fieldscited by 2
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Modelscited by 2
- 2026Drifting Field Policy: A One-Step Generative Policy via Wasserstein Gradient Flowcited by 1
- 2026Second Order Drifting Modelscited by 1
- 2026Unifying Distributional Training for One-Step Visual Generationcited by 1
- 2026Identifiability and Stability of Generative Drifting in the Companion-Elliptic Kernel Familycited by 0
- 2026Difference of Convex Programming in the Wasserstein Space with Applications to MMD Optimizationcited by 0
- 2026DriftST: One-Step Generative Inference of Spatial Transcriptomics from H&E Histologycited by 0
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Modelscited by 0
12 most cited of 15 All 15 (JSON)
- 2026Multi-Bandwidth Distribution Matching Distillation: On the Equivalence of Distribution Matching Distillation and Drifting Models7 Oct 2026
- 2026Unifying Distributional Training for One-Step Visual Generation28 Sep 2026
- 2026Refresh or Realize? Compute Allocation in Drifting Models26 Sep 2026
- 2026DriftSE: Speech Enhancement with Generative Drifting10 Sep 2026
- 2026Second Order Drifting Models8 Aug 2026
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Models3 Aug 2026
- 2026DriftST: One-Step Generative Inference of Spatial Transcriptomics from H&E Histology6 Jul 2026
- 2026Difference of Convex Programming in the Wasserstein Space with Applications to MMD Optimization26 Jun 2026
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Models21 May 2026
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fields12 May 2026
- 2026Kernel-Gradient Drifting Models11 May 2026
- 2026Drifting Field Policy: A One-Step Generative Policy via Wasserstein Gradient Flow8 May 2026
12 newest of 15 All 15 (JSON)