mlsanityData to 7 Oct 2026

Breaking the curse of dimensionality in structured density estimation

arXiv 2410.07685 ↗First posted 10 Oct 2024stat.ML cs.CV cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We consider the problem of estimating a structured multivariate density, subject to Markov conditions implied by an undirected graph. In the worst case, without Markovian assumptions, this problem suffers from the curse of dimensionality. Our main result shows how the curse of dimensionality can be avoided or greatly alleviated under the Markov property, and applies to arbitrary graphs. While existing results along these lines focus on sparsity or manifold assumptions, we introduce a new graphical quantity called "graph resilience" and show how it controls the sample complexity. Surprisingly, although one might expect the sample complexity of this problem to scale with local graph parameters such as the degree, this turns out not to be the case. Through explicit examples, we compute uniform deviation bounds and illustrate how the curse of dimensionality in density estimation can thus be circumvented. Notable examples where the rate improves substantially include sequential, hierarchical, and spatial data.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 21 of its 70 references that are in the map. First posted on arXiv 10 Oct 2024.

Builds on

21 of 70 references.

References · 21

  1. 2017Nonparametric regression using deep neural networks with ReLU activation functioncited by 431
  2. 2014Breaking the Curse of Dimensionality with Convex Neural Networkscited by 329
  3. 2015MADE: Masked Autoencoder for Distribution Estimationcited by 306
  4. 2023Diffusion Models are Minimax Optimal Distribution Estimatorscited by 159
  5. 2016Composing graphical models with neural networks for structured representations and fast inferencecited by 113
  6. 2020Causal Autoregressive Flowscited by 97
  7. 2019Deep ReLU network approximation of functions on a manifoldcited by 73
  8. 2024Minimax Optimality of Score-based Diffusion Models: Beyond the Density Lower Bound Assumptionscited by 45
  9. 2020Graphical Normalizing Flowscited by 37
  10. 2018Nonparametric Density Estimation under Adversarial Lossescited by 26
  11. 2019Nonparametric Density Estimation & Convergence Rates for GANs under Besov IPM Lossescited by 22
  12. 2015Sample-Optimal Density Estimation in Nearly-Linear Timecited by 16
9 more
  1. 2020Low-rank Characteristic Tensor Density Estimation Part I: Foundationscited by 15
  2. 2017How Well Can Generative Adversarial Networks Learn Densities: A Nonparametric Viewcited by 14
  3. 2023Structured Neural Networks for Density Estimation and Causal Inferencecited by 13
  4. 2024Score-based generative models break the curse of dimensionality in learning a family of sub-Gaussian probability distributionscited by 12
  5. 2014Near-Optimal Density Estimation in Near-Linear Time Using Variable-Width Histogramscited by 9
  6. 2021Optimal Rates for Nonparametric Density Estimation under Communication Constraintscited by 9
  7. 2021Low-rank Characteristic Tensor Density Estimation Part II: Compression and Latent Density Estimationcited by 8
  8. 2022Beyond Smoothness: Incorporating Low-Rank Analysis into Nonparametric Density Estimationcited by 8
  9. 2023Sample Complexity Using Infinite Multiview Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.