Differentially Private Covariance Revisited
Not on the map. Why?
Abstract (arXiv)
In this paper, we present two new algorithms for covariance estimation under concentrated differential privacy (zCDP). The first algorithm achieves a Frobenius error of tildeO(d1/4√tr/√n + √d/n), where tr is the trace of the covariance matrix. By taking tr=1, this also implies a worst-case error bound of tildeO(d1/4/√n), which improves the standard Gaussian mechanism's tildeO(d/n) for the regime d>widetildeOmega(n2/3). Our second algorithm offers a tail-sensitive bound that could be much better on skewed data. The corresponding algorithms are also simple and efficient. Experimental results show that they offer significant improvements over prior work.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 16 of its 40 references that are in the map. First posted on arXiv 28 May 2022.
Builds on
16 of 40 references.
References · 16
- 2016Concentrated Differential Privacy: Simplifications, Extensions, and Lower Boundscited by 346
- 2019Differentially Private Learning with Adaptive Clippingcited by 220
- 2018Privately Learning High-Dimensional Distributionscited by 104
- 2019AdaCliP: Adaptive Clipping for Private SGDcited by 77
- 2020CoinPress: Practical Private Mean and Covariance Estimationcited by 74
- 2021Differential privacy and robust statistics in high dimensionscited by 64
- 2019Private Hypothesis Selectioncited by 60
- 2020On the Sample Complexity of Privately Learning Unbounded High-Dimensional Gaussianscited by 41
- 2021Private and polynomial time algorithms for learning Gaussians and beyondcited by 39
- 2021Private Robust Estimation by Stabilizing Convex Relaxationscited by 38
- 2021Instance-optimal Mean Estimation Under Differential Privacycited by 37
- 2021A Private and Computationally-Efficient Estimator for Unbounded Gaussianscited by 34
4 more
- 2022New Lower Bounds for Private Estimation and a Generalized Fingerprinting Lemmacited by 33
- 2013Efficient Algorithms for Privately Releasing Marginals via Convex Relaxationscited by 17
- 2021Privately Learning Subspacescited by 16
- 2021Universal Private Estimatorscited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 3; 2025: 5; 2026: 3.
15 papers.
Sort:
- 2023Better and Simpler Lower Bounds for Differentially Private Statistical Estimationcited by 17
- 2024Optimal Differentially Private PCA and Estimation for Spiked Covariance Matricescited by 11
- 2024Lower Bounds for Private Estimation of Gaussian Covariance Matrices under All Reasonable Parameter Regimescited by 9
- 2022Private Query Release via the Johnson-Lindenstrauss Transformcited by 8
- 2023Differentially Private Low-dimensional Synthetic Data from High-dimensional Datasetscited by 4
- 2023General Gaussian Noise Mechanisms and Their Optimality for Unbiased Mean Estimationcited by 3
- 2024Perturb-and-Project: Differentially Private Similarities and Marginalscited by 1
- 2025High-Dimensional Differentially Private Quantile Regression: Distributed Estimation and Statistical Inferencecited by 1
- 2025Optimal Variance and Covariance Estimation under Differential Privacy in the Add-Remove Model and Beyondcited by 1
- 2025On Purely Private Covariance Estimationcited by 1
- 2025Differentially Private Nonparametric Confidence Intervals Under Minimal Distributional Assumptionscited by 1
- 2026Minimax and Adaptive Covariance Matrix Estimation under Differential Privacycited by 1
- 2026Improved Private Sparse Covariance Estimation with Multiscale Threshold Tests19 Sep 2026
- 2026Private Adaptive Covariance Estimation via Gaussian Graphical Models22 May 2026
- 2026Minimax and Adaptive Covariance Matrix Estimation under Differential Privacy20 Mar 2026
- 2025Differentially Private Nonparametric Confidence Intervals Under Minimal Distributional Assumptions3 Nov 2025
- 2025On Purely Private Covariance Estimation30 Oct 2025
- 2025Optimal Variance and Covariance Estimation under Differential Privacy in the Add-Remove Model and Beyond5 Sep 2025
- 2025High-Dimensional Differentially Private Quantile Regression: Distributed Estimation and Statistical Inference7 Aug 2025
- 2025A Private Approximation of the 2nd-Moment Matrix of Any Subsamplable Input20 May 2025
- 2024Perturb-and-Project: Differentially Private Similarities and Marginals7 Jun 2024
- 2024Lower Bounds for Private Estimation of Gaussian Covariance Matrices under All Reasonable Parameter Regimes26 Apr 2024
- 2024Optimal Differentially Private PCA and Estimation for Spiked Covariance Matrices8 Jan 2024
- 2023Better and Simpler Lower Bounds for Differentially Private Statistical Estimation10 Oct 2023
- 2023Better and Simpler Lower Bounds for Differentially Private Statistical Estimationcited by 17
- 2024Optimal Differentially Private PCA and Estimation for Spiked Covariance Matricescited by 11
- 2024Lower Bounds for Private Estimation of Gaussian Covariance Matrices under All Reasonable Parameter Regimescited by 9
- 2022Private Query Release via the Johnson-Lindenstrauss Transformcited by 8
- 2023Differentially Private Low-dimensional Synthetic Data from High-dimensional Datasetscited by 4
- 2023General Gaussian Noise Mechanisms and Their Optimality for Unbiased Mean Estimationcited by 3
- 2024Perturb-and-Project: Differentially Private Similarities and Marginalscited by 1
- 2025High-Dimensional Differentially Private Quantile Regression: Distributed Estimation and Statistical Inferencecited by 1
- 2025Optimal Variance and Covariance Estimation under Differential Privacy in the Add-Remove Model and Beyondcited by 1
- 2025On Purely Private Covariance Estimationcited by 1
- 2025Differentially Private Nonparametric Confidence Intervals Under Minimal Distributional Assumptionscited by 1
- 2026Minimax and Adaptive Covariance Matrix Estimation under Differential Privacycited by 1
12 most cited of 15 All 15 (JSON)
- 2026Improved Private Sparse Covariance Estimation with Multiscale Threshold Tests19 Sep 2026
- 2026Private Adaptive Covariance Estimation via Gaussian Graphical Models22 May 2026
- 2026Minimax and Adaptive Covariance Matrix Estimation under Differential Privacy20 Mar 2026
- 2025Differentially Private Nonparametric Confidence Intervals Under Minimal Distributional Assumptions3 Nov 2025
- 2025On Purely Private Covariance Estimation30 Oct 2025
- 2025Optimal Variance and Covariance Estimation under Differential Privacy in the Add-Remove Model and Beyond5 Sep 2025
- 2025High-Dimensional Differentially Private Quantile Regression: Distributed Estimation and Statistical Inference7 Aug 2025
- 2025A Private Approximation of the 2nd-Moment Matrix of Any Subsamplable Input20 May 2025
- 2024Perturb-and-Project: Differentially Private Similarities and Marginals7 Jun 2024
- 2024Lower Bounds for Private Estimation of Gaussian Covariance Matrices under All Reasonable Parameter Regimes26 Apr 2024
- 2024Optimal Differentially Private PCA and Estimation for Spiked Covariance Matrices8 Jan 2024
- 2023Better and Simpler Lower Bounds for Differentially Private Statistical Estimation10 Oct 2023
12 newest of 15 All 15 (JSON)