mlsanityData to 7 Oct 2026

Amortized Bandwidth Learning for Kernel Density Estimation under Logarithmic Score

arXiv 2608.20445 ↗First posted 20 Aug 2026cs.LG stat.MEcited by 0

Not on the map. Why?

Abstract (arXiv)

Kernel density estimation converts finite samples into probability densities, but its performance depends critically on bandwidth selection. Classical selectors prescribe the sample-to-bandwidth rule analytically or asymptotically, or solve a new optimization for each sample. An amortized framework is proposed that instead learns this mapping across a distribution of density-estimation tasks by optimizing the logarithmic score. A truncated-and-renormalized bounded-support formulation enables stable learning across heterogeneous tasks, while affine standardization allows a selector trained on a single reference interval to transfer across bounded intervals. Experiments under Gaussian sampling, a multi-family benchmark, and randomized Gaussian-mixture training show that the amortized selector consistently and substantially outperforms Silverman's rule, the Sheather--Jones selector, and least-squares cross-validation, with especially large gains in small and heterogeneous samples. Finite Gaussian mixtures provide a generic training mechanism supported by their L1 approximation property. Selectors trained in this way generalize strongly across different density structures, allowing the same trained selector to be applied directly to finite samples from unknown densities without specifying or fitting a distributional family. This combination of broad applicability and strong empirical performance makes the framework attractive for a wide range of applications in which finite samples or ensembles must be converted into continuous probability densities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 3 of its 25 references that are in the map. First posted on arXiv 20 Aug 2026.

Builds on

3 of 25 references.

References · 3

  1. 2021General Bayesian Loss Function Selection and the use of Improper Modelscited by 14
  2. 2016Model-based clustering based on sparse finite Gaussian mixturescited by 11
  3. 2020Beyond Strictly Proper Scoring Rules: The Importance of Being Localcited by 9

Built on by

Not cited yet.