mlsanityData to 7 Oct 2026

Memory Efficient And Minimax Distribution Estimation Under Wasserstein Distance Using Bayesian Histograms

arXiv 2307.10099 ↗First posted 19 Jul 2023math.ST stat.CO stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

We study Bayesian histograms for distribution estimation on [0,1]d under the Wasserstein Wv, 1 ≤ v < ∞ distance in the i.i.d sampling regime. We newly show that when d < 2v, histograms possess a special textitmemory efficiency property, whereby in reference to the sample size n, order nd/2v bins are needed to obtain minimax rate optimality. This result holds for the posterior mean histogram and with respect to posterior contraction: under the class of Borel probability measures and some classes of smooth densities. The attained memory footprint overcomes existing minimax optimal procedures by a polynomial factor in n; for example an n1 - d/2v factor reduction in the footprint when compared to the empirical measure, a minimax estimator in the Borel probability measure class. Additionally constructing both the posterior mean histogram and the posterior itself can be done super--linearly in n. Due to the popularity of the W1,W2 metrics and the coverage provided by the d < 2v case, our results are of most practical interest in the (d=1,v =1,2), (d=2,v=2), (d=3,v=2) settings and we provide simulations demonstrating the theory in several of these instances.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 40 references that are in the map. First posted on arXiv 19 Jul 2023.

Builds on

12 of 40 references.

References · 12

  1. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  2. 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 219
  3. 2020Faster Wasserstein Distance Estimation with the Sinkhorn Divergencecited by 73
  4. 2018Differential Properties of Sinkhorn Approximation for Learning with Wasserstein Distancecited by 56
  5. 2017Visual Feature Attribution using Wasserstein GANscited by 47
  6. 2019Approximate Bayesian computation with the Wasserstein distancecited by 34
  7. 2017Frequentist coverage and sup-norm convergence rate in Gaussian process regressioncited by 15
  8. 2017On parameter estimation with the Wasserstein distancecited by 7
  9. 2019Quantile Propagation for Wasserstein-Approximate Gaussian Processescited by 3
  10. 2021ERA: Entity Relationship Aware Video Summarization with Wasserstein GANcited by 3
  11. 2022Concentration of discrepancy-based approximate Bayesian computation via Rademacher complexitycited by 3
  12. 2014The Shortlist Method for Fast Computation of the Earth Mover's Distance and Finding Optimal Solutions to Transportation Problemscited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.