Drifting Fields are not Conservative
Not on the map. Why?
Abstract (arXiv)
Drifting models have recently gained attention for generating high-quality samples in a single forward pass. During training, they learn a push-forward map by following a vector-valued field, the drift field. We ask whether this procedure is equivalent to optimizing a scalar loss and find that, in general, it is not: drift fields are not conservative and cannot be written as the gradient of any scalar potential. We identify the position-dependent normalization as the source of non-conservatism, with the Gaussian kernel as the unique radial exception. Guided by this, we introduce the sharp kernel k^# and a sharp-normalized drift field that is conservative for general radial kernels. The resulting vector field is the gradient of a scalar potential that can be optimized directly using stochastic gradient descent. Moreover, the field has the form of a score difference of kernel density estimates, and gives exact equilibrium identifiability. Thus, sharp normalization closes the gap to related literature, such as Wasserstein gradient-flows and denoising score matching, also for non-Gaussian kernels. Empirically, sharp normalization preserves the performance of the original drifting objective, suggesting that the non-conservative flexibility is not required for high-quality generation.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
14 of 25 references.
References · 14
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2019Maximum Mean Discrepancy Gradient Flowcited by 127
- 2026Generative Modeling via Driftingcited by 116
- 2016Kernel Distribution Embeddings: Universal Kernels, Characteristic Kernels and Kernel Metrics on Distributionscited by 40
- 2026Sinkhorn-Drifting Generative Modelscited by 24
- 2026Generative Drifting is Secretly Score Matching: a Spectral and Variational Perspectivecited by 20
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Modelscited by 11
- 2026Kernel-Gradient Drifting Modelscited by 7
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Modelscited by 4
- 2026Three-Body Scattering for Generative Modelingcited by 4
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fieldscited by 3
- 2026Uniform-in-time Propagation-of-Chaos for Stein Variational Gradient Descentcited by 2
- 2026Analytical Correction for Subsampling Bias in Drifting Modelscited by 1
- 2026Unifying Distributional Training for One-Step Visual Generationcited by 1
- 2026Identifiability and Stability of Generative Drifting in the Companion-Elliptic Kernel Familycited by 0
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Modelscited by 0
- 2026One-Step Generative Modeling via Unbalanced Optimal Transportcited by 0
- 2026One-Step Generative Modeling via Training Dynamics Actioncited by 0
1 more
- 2026One-Step Generation via Riemannian Wasserstein Gradient Flows3 Oct 2026
- 2026One-Step Generative Modeling via Training Dynamics Action30 Sep 2026
- 2026Unifying Distributional Training for One-Step Visual Generation28 Sep 2026
- 2026One-Step Generative Modeling via Unbalanced Optimal Transport26 Sep 2026
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Models3 Aug 2026
- 2026Three-Body Scattering for Generative Modeling20 Jul 2026
- 2026Uniform-in-time Propagation-of-Chaos for Stein Variational Gradient Descent30 Jun 2026
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Models21 May 2026
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fields12 May 2026
- 2026Kernel-Gradient Drifting Models11 May 2026
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Models6 May 2026
- 2026Analytical Correction for Subsampling Bias in Drifting Models29 Apr 2026
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Modelscited by 11
- 2026Kernel-Gradient Drifting Modelscited by 7
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Modelscited by 4
- 2026Three-Body Scattering for Generative Modelingcited by 4
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fieldscited by 3
- 2026Uniform-in-time Propagation-of-Chaos for Stein Variational Gradient Descentcited by 2
- 2026Analytical Correction for Subsampling Bias in Drifting Modelscited by 1
- 2026Unifying Distributional Training for One-Step Visual Generationcited by 1
- 2026Identifiability and Stability of Generative Drifting in the Companion-Elliptic Kernel Familycited by 0
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Modelscited by 0
- 2026One-Step Generative Modeling via Unbalanced Optimal Transportcited by 0
- 2026One-Step Generative Modeling via Training Dynamics Actioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026One-Step Generation via Riemannian Wasserstein Gradient Flows3 Oct 2026
- 2026One-Step Generative Modeling via Training Dynamics Action30 Sep 2026
- 2026Unifying Distributional Training for One-Step Visual Generation28 Sep 2026
- 2026One-Step Generative Modeling via Unbalanced Optimal Transport26 Sep 2026
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Models3 Aug 2026
- 2026Three-Body Scattering for Generative Modeling20 Jul 2026
- 2026Uniform-in-time Propagation-of-Chaos for Stein Variational Gradient Descent30 Jun 2026
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Models21 May 2026
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fields12 May 2026
- 2026Kernel-Gradient Drifting Models11 May 2026
- 2026On the Wasserstein Gradient Flow Interpretation of Drifting Models6 May 2026
- 2026Analytical Correction for Subsampling Bias in Drifting Models29 Apr 2026
12 newest of 13 All 13 (JSON)