Kernel-Gradient Drifting Models
Not on the map. Why?
Abstract (arXiv)
We propose kernel-gradient drifting, a one-step generative modeling framework that replaces the fixed Euclidean displacement direction in drifting models with directions induced by the kernel itself. Standard drifting is attractive because it enables fast, high-quality generation without distilling a large pretrained diffusion model, but its theory is currently understood mainly for Gaussian kernels, where the drift coincides with smoothed score matching and is identifiable. Our gradient-based reformulation exposes this score-based structure for general kernels: the resulting drift is the score difference between kernel-smoothed data and model distributions, yielding identifiability for characteristic kernels and a smoothed-KL descent interpretation of the drifting dynamics. Since kernel gradients are intrinsic tangent vectors, the same construction extends naturally to Riemannian manifolds and to discrete data via the Fisher-Rao geometry of the probability simplex. Across spherical geospatial data, promoter DNA and molecule generation, kernel-gradient drifting enables state-of-the-art one-step generation beyond the Euclidean setting without distillation.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 43 of its 55 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
43 of 55 references.
References · 43
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024Simple and Effective Masked Diffusion Language Modelscited by 848
- 2018Which Training Methods for GANs do actually Converge?cited by 679
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
- 2023Flow Matching on General Geometriescited by 265
31 more
- 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
- 2022Continuous diffusion for categorical datacited by 214
- 2022Score-based Continuous-time Discrete Diffusion Modelscited by 169
- 2020Riemannian Continuous Normalizing Flowscited by 145
- 2026Generative Modeling via Driftingcited by 116
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
- 2025How to build a consistency model: Learning flow maps via self-distillationcited by 103
- 2015Measuring Sample Quality with Stein's Methodcited by 94
- 2024Variational Flow Matching for Graph Generationcited by 83
- 2020Mat'ern Gaussian processes on Riemannian manifoldscited by 82
- 2023Dirichlet Diffusion Score Model for Biological Sequence Generationcited by 75
- 2024Fisher Flow Matching for Generative Modeling over Discrete Datacited by 72
- 2016Amortised MAP Inference for Image Super-resolutioncited by 68
- 2014Geodesic Exponential Kernels: When Curvature and Linearity Conflictcited by 47
- 2024Categorical Flow Matching on Statistical Manifoldscited by 47
- 2026Categorical Flow Mapscited by 44
- 2014Kernel Methods on Riemannian Manifolds with Gaussian RBF Kernelscited by 30
- 2025Terminal Velocity Matchingcited by 20
- 2026Generative Drifting is Secretly Score Matching: a Spectral and Variational Perspectivecited by 20
- 2026Gradient Flow Drifting: Generative Modeling via Wasserstein Gradient Flows of KDE-Approximated Divergencescited by 17
- 2026Drifting Fields are not Conservativecited by 13
- 2025Generalised Flow Maps for Few-Step Generative Modelling on Riemannian Manifoldscited by 12
- 2024The GeometricKernels Package: Heat and Mat'ern Kernels for Geometric Learning on Manifolds, Meshes, and Graphscited by 11
- 2025Riemannian Variational Flow Matching for Material and Protein Designcited by 11
- 2023The Score-Difference Flow for Implicit Generative Modelingcited by 9
- 2026Riemannian MeanFlowcited by 8
- 2020Strong Uniform Consistency with Rates for Kernel Density Estimators with General Kernels on Manifoldscited by 6
- 2025PairFlow: Closed-Form Source-Target Coupling for Few-Step Generation in Discrete Flow Modelscited by 5
- 2025Universal kernels via harmonic analysis on Riemannian symmetric spacescited by 2
- 2026Kernel smoothing on manifoldscited by 1
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Modelscited by 4
- 2026Three-Body Scattering for Generative Modelingcited by 4
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Modelscited by 0
- 2026Refresh or Realize? Compute Allocation in Drifting Modelscited by 0
- 2026One-Step Generative Modeling via Unbalanced Optimal Transportcited by 0
- 2026RW-Flow: One-Step Generation on Compact Manifolds via Wasserstein Gradient Flowscited by 0
- 2026One-Step Generation via Riemannian Wasserstein Gradient Flowscited by 0
- 2026One-Step Generation via Riemannian Wasserstein Gradient Flows3 Oct 2026
- 2026RW-Flow: One-Step Generation on Compact Manifolds via Wasserstein Gradient Flows30 Sep 2026
- 2026One-Step Generative Modeling via Unbalanced Optimal Transport26 Sep 2026
- 2026Refresh or Realize? Compute Allocation in Drifting Models26 Sep 2026
- 2026Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Models3 Aug 2026
- 2026Three-Body Scattering for Generative Modeling20 Jul 2026
- 2026Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Models21 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026A Unified View of Score-Based and Drifting Models
- 2026DriftXpress: Faster Drifting Models via Projected RKHS Fields
- 2025Kernel-Smoothed Scores for Denoising Diffusion: A Bias-Variance Study
- 2023Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes
- 2026Diffusion Model's Generalization Can Be Characterized by Inductive Biases toward a Data-Dependent Ridge Manifold
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models
- 2025Data-Dependent Smoothing for Protein Discovery with Walk-Jump Sampling
- 2025Improving the Euclidean Diffusion Generation of Manifold Data by Mitigating Score Function Singularity