mlsanityData to 14 Oct 2026

Kernel-Gradient Drifting Models

arXiv 2605.10727 ↗First posted 11 May 2026cs.LG math.DGcited by 7

Not on the map. Why?

Abstract (arXiv)

We propose kernel-gradient drifting, a one-step generative modeling framework that replaces the fixed Euclidean displacement direction in drifting models with directions induced by the kernel itself. Standard drifting is attractive because it enables fast, high-quality generation without distilling a large pretrained diffusion model, but its theory is currently understood mainly for Gaussian kernels, where the drift coincides with smoothed score matching and is identifiable. Our gradient-based reformulation exposes this score-based structure for general kernels: the resulting drift is the score difference between kernel-smoothed data and model distributions, yielding identifiability for characteristic kernels and a smoothed-KL descent interpretation of the drifting dynamics. Since kernel gradients are intrinsic tangent vectors, the same construction extends naturally to Riemannian manifolds and to discrete data via the Fisher-Rao geometry of the probability simplex. Across spherical geospatial data, promoter DNA and molecule generation, kernel-gradient drifting enables state-of-the-art one-step generation beyond the Euclidean setting without distillation.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 43 of its 55 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

43 of 55 references.

References · 43

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  5. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  6. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  7. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  8. 2018Which Training Methods for GANs do actually Converge?cited by 679
  9. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
  10. 2025Mean Flows for One-step Generative Modelingcited by 561
  11. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
  12. 2023Flow Matching on General Geometriescited by 265
31 more
  1. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
  2. 2022Continuous diffusion for categorical datacited by 214
  3. 2022Score-based Continuous-time Discrete Diffusion Modelscited by 169
  4. 2020Riemannian Continuous Normalizing Flowscited by 145
  5. 2026Generative Modeling via Driftingcited by 116
  6. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
  7. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
  8. 2025How to build a consistency model: Learning flow maps via self-distillationcited by 103
  9. 2015Measuring Sample Quality with Stein's Methodcited by 94
  10. 2024Variational Flow Matching for Graph Generationcited by 83
  11. 2020Mat'ern Gaussian processes on Riemannian manifoldscited by 82
  12. 2023Dirichlet Diffusion Score Model for Biological Sequence Generationcited by 75
  13. 2024Fisher Flow Matching for Generative Modeling over Discrete Datacited by 72
  14. 2016Amortised MAP Inference for Image Super-resolutioncited by 68
  15. 2014Geodesic Exponential Kernels: When Curvature and Linearity Conflictcited by 47
  16. 2024Categorical Flow Matching on Statistical Manifoldscited by 47
  17. 2026Categorical Flow Mapscited by 44
  18. 2014Kernel Methods on Riemannian Manifolds with Gaussian RBF Kernelscited by 30
  19. 2025Terminal Velocity Matchingcited by 20
  20. 2026Generative Drifting is Secretly Score Matching: a Spectral and Variational Perspectivecited by 20
  21. 2026Gradient Flow Drifting: Generative Modeling via Wasserstein Gradient Flows of KDE-Approximated Divergencescited by 17
  22. 2026Drifting Fields are not Conservativecited by 13
  23. 2025Generalised Flow Maps for Few-Step Generative Modelling on Riemannian Manifoldscited by 12
  24. 2024The GeometricKernels Package: Heat and Mat'ern Kernels for Geometric Learning on Manifolds, Meshes, and Graphscited by 11
  25. 2025Riemannian Variational Flow Matching for Material and Protein Designcited by 11
  26. 2023The Score-Difference Flow for Implicit Generative Modelingcited by 9
  27. 2026Riemannian MeanFlowcited by 8
  28. 2020Strong Uniform Consistency with Rates for Kernel Density Estimators with General Kernels on Manifoldscited by 6
  29. 2025PairFlow: Closed-Form Source-Target Coupling for Few-Step Generation in Discrete Flow Modelscited by 5
  30. 2025Universal kernels via harmonic analysis on Riemannian symmetric spacescited by 2
  31. 2026Kernel smoothing on manifoldscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Unified View of Score-Based and Drifting Models
  2. 2026DriftXpress: Faster Drifting Models via Projected RKHS Fields
  3. 2025Kernel-Smoothed Scores for Denoising Diffusion: A Bias-Variance Study
  4. 2023Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes
  5. 2026Diffusion Model's Generalization Can Be Characterized by Inductive Biases toward a Data-Dependent Ridge Manifold
  6. 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models
  7. 2025Data-Dependent Smoothing for Protein Discovery with Walk-Jump Sampling
  8. 2025Improving the Euclidean Diffusion Generation of Manifold Data by Mitigating Score Function Singularity