Optimality of Maximum Likelihood for Log-Concave Density Estimation and Bounded Convex Regression
Not on the map. Why?
Abstract (arXiv)
In this paper, we study two problems: (1) estimation of a d-dimensional log-concave distribution and (2) bounded multivariate convex regression with random design with an underlying log-concave density or a compactly supported distribution with a continuous density. First, we show that for all d ≥ 4 the maximum likelihood estimators of both problems achieve an optimal risk of Thetad(n-2/(d+1)) (up to a logarithmic factor) in terms of squared Hellinger distance and L2 squared distance, respectively. Previously, the optimality of both these estimators was known only for d≤ 3. We also prove that the ε-entropy numbers of the two aforementioned families are equal up to logarithmic factors. We complement these results by proving a sharp bound Thetad(n-2/(d+4)) on the minimax rate (up to logarithmic factors) with respect to the total variation distance. Finally, we prove that estimating a log-concave density - even a uniform distribution on a convex set - up to a fixed accuracy requires the number of samples at least exponential in the dimension. We do that by improving the dimensional constant in the best known lower bound for the minimax rate from 2-d· n-2/(d+1) to c· n-2/(d+1) (when d≥ 2).
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 2; 2024: 1; 2025: 1; 2026: 2.
10 papers.
- 2021Handling Hard Affine SDP Shape Constraints in RKHSscited by 4
- 2021On the Minimal Error of Empirical Risk Minimizationcited by 3
- 2021Universal Inference Meets Random Projections: A Scalable Test for Log-concavitycited by 3
- 2023On the Variance, Admissibility, and Stability of Empirical Risk Minimizationcited by 3
- 2023Max-affine regression via first-order methodscited by 3
- 2024Trade-off Between Dependence and Complexity for Nonparametric Learning -- an Empirical Process Approachcited by 3
- 2025Nonparametric inference under shape constraints: past, present and futurecited by 3
- 2022An Efficient Minimax Optimal Estimator For Multivariate Convex Regressioncited by 0
- 2026Density estimation for Hellinger via minimum-distance estimators: mixtures of Gaussians, log-concave, and morecited by 0
- 2026Instance-Optimal Adaptive Location Estimation via Multiscale Mid-Summariescited by 0
- 2026Instance-Optimal Adaptive Location Estimation via Multiscale Mid-Summaries17 Sep 2026
- 2026Density estimation for Hellinger via minimum-distance estimators: mixtures of Gaussians, log-concave, and more9 Jun 2026
- 2025Nonparametric inference under shape constraints: past, present and future30 Sep 2025
- 2024Trade-off Between Dependence and Complexity for Nonparametric Learning -- an Empirical Process Approach17 Jan 2024
- 2023Max-affine regression via first-order methods15 Aug 2023
- 2023On the Variance, Admissibility, and Stability of Empirical Risk Minimization29 May 2023
- 2022An Efficient Minimax Optimal Estimator For Multivariate Convex Regression6 May 2022
- 2021Universal Inference Meets Random Projections: A Scalable Test for Log-concavity17 Nov 2021
- 2021On the Minimal Error of Empirical Risk Minimization24 Feb 2021
- 2021Handling Hard Affine SDP Shape Constraints in RKHSs5 Jan 2021