mlsanityData to 7 Oct 2026

Distributional Shrinkage II: Higher-Order Scores Encode Brenier Map

arXiv 2512.09295 ↗First posted 10 Dec 2025math.ST cs.LG math.PRcited by 0

Not on the map. Why?

Abstract (arXiv)

Consider the additive Gaussian model Y = X + σ Z, where X ~ P is an unknown signal, Z ~ N(0,1) is independent of X, and σ > 0 is known. Let Q denote the law of Y. We construct a hierarchy of denoisers T0, T1, ldots, T_∞ colon ℝ → ℝ that depend only on higher-order score functions q(m)/q, m ≥ 1, of Q and require no knowledge of the law P. The K-th order denoiser TK involves scores up to order 2K-1 and satisfies Wr(TK sharp Q, P) = O(σ2(K+1)) for every r ≥ 1; in the limit, T_∞ recovers the monotone optimal transport map (Brenier map) pushing Q onto P. We provide a complete characterization of the combinatorial structure governing this hierarchy through partial Bell polynomial recursions, making precise how higher-order score functions encode the Brenier map. We further establish rates of convergence for estimating these scores from n i.i.d. draws from Q under two complementary strategies: (i) plug-in kernel density estimation, and (ii) higher-order score matching. The construction reveals a precise interplay among higher-order Fisher-type information, optimal transport, and the combinatorics of integer partitions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 40 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

15 of 40 references.

References · 15

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  3. 2018How Well Generative Adversarial Networks Learn Distributionscited by 78
  4. 2019Neural Empirical Bayescited by 46
  5. 2013Density Estimation in Infinite Dimensional Exponential Familiescited by 41
  6. 2018Deep Energy Estimator Networkscited by 34
  7. 2014Two Modeling Strategies for Empirical Bayes Estimationcited by 16
  8. 2024Optimal convex M-estimation via score matchingcited by 9
  9. 2020Bounding the expectation of the supremum of empirical processes indexed by H"older classescited by 8
  10. 2025Stein's unbiased risk estimate and Hyv"arinen's score matchingcited by 6
  11. 2024Denoising Diffusions with Optimal Transport: Localization, Curvature, and Multi-Scale Complexitycited by 5
  12. 2025Optimal Denoising in Score-Based Generative Models: The Role of Data Regularitycited by 4
3 more
  1. 2025No-Regret Generative Modeling via Parabolic Monge-Amp`ere PDEcited by 4
  2. 2023A New Perspective On Denoising Based On Optimal Transportcited by 2
  3. 2025Constrained Denoising, Empirical Bayes, and Optimal Transportcited by 2

Built on by

Not cited yet.