mlsanityData to 14 Oct 2026

A Malliavin calculus approach to score functions in diffusion generative models

arXiv 2507.05550 ↗First posted 8 Jul 2025stat.ML cs.LG math.PRcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Score-based diffusion generative models have recently emerged as a powerful tool for modelling complex data distributions. These models aim at learning the score function, which defines a map from a known probability distribution to the target data distribution via deterministic or stochastic differential equations (SDEs). The score function is typically estimated from data using a variety of approximation techniques, such as denoising or sliced score matching, Hyv"arien's method, or Schr"odinger bridges. In this paper, we derive an exact, closed-form, expression for the score function for a broad class of nonlinear diffusion generative models. Our approach combines modern stochastic analysis tools such as Malliavin derivatives and their adjoint operators (Skorokhod integrals or Malliavin Divergence) with a new Bismut-type formula. The resulting expression for the score function can be written entirely in terms of the first and second variation processes, with all Malliavin derivatives systematically eliminated, thereby enhancing its practical applicability. The theoretical framework presented in this work offers a principled foundation for advancing score estimation methods in generative modelling, enabling the design of new sampling algorithms for complex probability distributions. Our results can be extended to broader classes of stochastic differential equations, opening new directions for the development of score-based diffusion generative models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 10 of its 28 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

10 of 28 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025A Malliavin-Gamma calculus approach to Score Based Diffusion Generative models for random fields19 May
  2. 2025Malliavin Calculus for Score-based Diffusion Models21 Mar
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  4. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  6. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 4

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  2. 2023FinDiff: Diffusion Models for Financial Tabular Data Generationcited by 41
  3. 2025Conditioning Diffusions Using Malliavin Calculuscited by 15
  4. 2025Divergence-Kernel method for scores of random systemscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions
  2. 2026A Stochastic Analysis Perspective on Diffusion Models
  3. 2024Discrete vs. Continuous Trade-offs for Generative Models
  4. 2023Score-based Generative Modeling Through Backward Stochastic Differential Equations: Inversion and Generation
  5. 2021A Variational Perspective on Diffusion-Based Generative Models and Score Matching
  6. 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion
  7. 2023Improved Convergence of Score-Based Diffusion Models via Prediction-Correction
  8. 2023Score-based Diffusion Models in Function Space