mlsanityData to 7 Oct 2026

Minimax and Adaptive Covariance Matrix Estimation under Differential Privacy

arXiv 2603.19703 ↗First posted 20 Mar 2026math.ST cs.LG stat.THcited by 1

Not on the map. Why?

Abstract (arXiv)

Estimating covariance matrices is fundamental to a wide range of statistical applications. This paper studies minimax and adaptive estimation of high-dimensional covariance matrices under ρ-zero-concentrated differential privacy (ρ-zCDP) over three nested classes: the pointwise-decay class Hα, the row-tail class Gα, and the separated-block class Fα. We consider both squared operator norm loss and normalized squared Frobenius norm loss. For Hα and Gα, we develop center--outer dyadic estimators tailored to the refined geometry of the two classes, while for Fα, we develop a blockwise tridiagonal estimator. The resulting minimax-optimal rates reveal a nontrivial interplay among the smoothness α, the loss, the geometry of the covariance class, and the privacy constraint. In contrast to the non-private setting, privacy distinguishes covariance classes that share the same leading non-private rate and induces a polynomial dependence on the ambient dimension. We further develop procedures that adapt to the unknown decay parameter over all three covariance classes under both losses, at the cost of at most polylogarithmic factors. To establish minimax lower bounds, we develop a novel differentially private van Trees inequality that connects Fisher information with the ρ-zCDP constraint and may be useful for other private estimation problems. We also construct carefully designed prior distributions to obtain matching minimax lower bounds.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 45 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

20 of 45 references.

References · 20

  1. 2016Concentrated Differential Privacy: Simplifications, Extensions, and Lower Boundscited by 339
  2. 2016Concentrated Differential Privacycited by 139
  3. 2014Differentially Private Empirical Risk Minimization: Efficient Algorithms and Tight Error Boundscited by 104
  4. 2016Minimax Optimal Procedures for Locally Private Estimationcited by 103
  5. 2018Privately Learning High-Dimensional Distributionscited by 103
  6. 2020CoinPress: Practical Private Mean and Covariance Estimationcited by 74
  7. 2021Differential privacy and robust statistics in high dimensionscited by 64
  8. 2020Differentially Private Assouad, Fano, and Le Camcited by 54
  9. 2021Private and polynomial time algorithms for learning Gaussians and beyondcited by 39
  10. 2021A Private and Computationally-Efficient Estimator for Unbounded Gaussianscited by 34
  11. 2022New Lower Bounds for Private Estimation and a Generalized Fingerprinting Lemmacited by 32
  12. 2013Local Privacy, Data Processing Inequalities, and Statistical Minimax Ratescited by 26
8 more
  1. 2023Score Attack: A Lower Bound Technique for Optimal Differentially Private Learningcited by 21
  2. 2023Better and Simpler Lower Bounds for Differentially Private Statistical Estimationcited by 16
  3. 2022Differentially Private Covariance Revisitedcited by 15
  4. 2024Optimal Differentially Private PCA and Estimation for Spiked Covariance Matricescited by 10
  5. 2024Lower Bounds for Private Estimation of Gaussian Covariance Matrices under All Reasonable Parameter Regimescited by 9
  6. 2023Smooth Lower Bounds for Differentially Private Algorithms via Padding-and-Permuting Fingerprinting Codescited by 8
  7. 2024Optimal Federated Learning for Nonparametric Regression with Heterogeneous Distributed Differential Privacy Constraintscited by 7
  8. 2024Optimal estimation in private distributed functional data analysiscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.