On the Sample Complexity of Privately Learning Unbounded High-Dimensional Gaussians
Not on the map. Why?
Abstract (arXiv)
We provide sample complexity upper bounds for agnostically learning multivariate Gaussians under the constraint of approximate differential privacy. These are the first finite sample upper bounds for general Gaussians which do not impose restrictions on the parameters of the distribution. Our bounds are near-optimal in the case when the covariance is known to be the identity, and conjectured to be near-optimal in the general case. From a technical standpoint, we provide analytic tools for arguing the existence of global "locally small" covers from local covers of the space. These are exploited using modifications of recent techniques for differentially private hypothesis selection. Our techniques may prove useful for privately learning other distribution classes which do not possess a finite cover.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 6; 2023: 11; 2024: 8; 2025: 7; 2026: 1.
41 papers.
Sort:
- 2021Robust and Differentially Private Mean Estimationcited by 66
- 2021Differential privacy and robust statistics in high dimensionscited by 64
- 2021Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanismcited by 50
- 2022Robustness Implies Privacy in Statistical Estimationcited by 47
- 2021Covariance-Aware Private Mean Estimation Without Private Covariance Estimationcited by 46
- 2021Private and polynomial time algorithms for learning Gaussians and beyondcited by 39
- 2021Private Robust Estimation by Stabilizing Convex Relaxationscited by 38
- 2021A Private and Computationally-Efficient Estimator for Unbounded Gaussianscited by 34
- 2022New Lower Bounds for Private Estimation and a Generalized Fingerprinting Lemmacited by 32
- 2022Private Estimation with Public Datacited by 31
- 2023From Robustness to Privacy and Backcited by 27
- 2023Fast, Sample-Efficient, Affine-Invariant Private Mean and Covariance Estimation for Subgaussian Distributionscited by 22
29 more
- 2023Polynomial Time and Private Learning of Unbounded Gaussian Mixture Modelscited by 19
- 2023Better and Simpler Lower Bounds for Differentially Private Statistical Estimationcited by 16
- 2022Differentially Private Covariance Revisitedcited by 15
- 2023Private Distribution Learning with Public Data: The View from Sample Compressioncited by 14
- 2021Privately Learning Mixtures of Axis-Aligned Gaussianscited by 13
- 2023A Bias-Accuracy-Privacy Trilemma for Statistical Estimationcited by 12
- 2022Differentially Private Regression with Unbounded Covariatescited by 10
- 2024Lower Bounds for Private Estimation of Gaussian Covariance Matrices under All Reasonable Parameter Regimescited by 9
- 2024Insufficient Statistics Perturbation: Stable Estimators for Private Least Squarescited by 7
- 2024Dimension-free Private Mean Estimation for Anisotropic Distributionscited by 6
- 2023A Polynomial Time, Pure Differentially Private Estimator for Binary Product Distributionscited by 5
- 2023Mixtures of Gaussians are Privately Learnable with a Polynomial Number of Samplescited by 5
- 2024Differentially Private Post-Processing for Fair Regressioncited by 5
- 2024Distribution Learnability and Robustnesscited by 4
- 2023Sample-Optimal Locally Private Hypothesis Selection and the Provable Benefits of Interactivitycited by 3
- 2023Differentially private projection-depth-based medianscited by 3
- 2024Not All Learnable Distribution Classes are Privately Learnablecited by 3
- 2024Agnostic Private Density Estimation for GMMs via List Global Stabilitycited by 2
- 2025Learning with Differentially Private (Sliced) Wasserstein Gradientscited by 2
- 2026On the Price of Privacy for Language Identification and Generationcited by 2
- 2025Optimal Differentially Private Sampling of Unbounded Gaussianscited by 1
- 2025Private Statistical Estimation via Truncationcited by 1
- 2022Privately Estimating a Gaussian: Efficient, Robust and Optimalcited by 0
- 2023Instance-Specific Asymmetric Sensitivity in Differential Privacycited by 0
- 2024Sample-Efficient Private Learning of Mixtures of Gaussianscited by 0
- 2025A Private Approximation of the 2nd-Moment Matrix of Any Subsamplable Inputcited by 0
- 2025Nearly-Linear Time Private Hypothesis Selection with the Optimal Approximation Factorcited by 0
- 2025Private Training & Data Generation by Clustering Embeddingscited by 0
- 2025Query-Efficient Locally Private Hypothesis Selection via the Scheffe Graphcited by 0
- 2026On the Price of Privacy for Language Identification and Generation8 Apr 2026
- 2025Query-Efficient Locally Private Hypothesis Selection via the Scheffe Graph19 Sep 2025
- 2025Private Training & Data Generation by Clustering Embeddings20 Jun 2025
- 2025Nearly-Linear Time Private Hypothesis Selection with the Optimal Approximation Factor1 Jun 2025
- 2025A Private Approximation of the 2nd-Moment Matrix of Any Subsamplable Input20 May 2025
- 2025Private Statistical Estimation via Truncation18 May 2025
- 2025Optimal Differentially Private Sampling of Unbounded Gaussians3 Mar 2025
- 2025Learning with Differentially Private (Sliced) Wasserstein Gradients3 Feb 2025
- 2024Sample-Efficient Private Learning of Mixtures of Gaussians4 Nov 2024
- 2024Dimension-free Private Mean Estimation for Anisotropic Distributions1 Nov 2024
- 2024Agnostic Private Density Estimation for GMMs via List Global Stability5 Jul 2024
- 2024Distribution Learnability and Robustness25 Jun 2024
29 more
- 2024Differentially Private Post-Processing for Fair Regression7 May 2024
- 2024Lower Bounds for Private Estimation of Gaussian Covariance Matrices under All Reasonable Parameter Regimes26 Apr 2024
- 2024Insufficient Statistics Perturbation: Stable Estimators for Private Least Squares23 Apr 2024
- 2024Not All Learnable Distribution Classes are Privately Learnable1 Feb 2024
- 2023Differentially private projection-depth-based medians12 Dec 2023
- 2023Sample-Optimal Locally Private Hypothesis Selection and the Provable Benefits of Interactivity9 Dec 2023
- 2023Instance-Specific Asymmetric Sensitivity in Differential Privacy2 Nov 2023
- 2023Better and Simpler Lower Bounds for Differentially Private Statistical Estimation10 Oct 2023
- 2023Mixtures of Gaussians are Privately Learnable with a Polynomial Number of Samples7 Sep 2023
- 2023Private Distribution Learning with Public Data: The View from Sample Compression11 Aug 2023
- 2023A Polynomial Time, Pure Differentially Private Estimator for Binary Product Distributions13 Apr 2023
- 2023Polynomial Time and Private Learning of Unbounded Gaussian Mixture Models7 Mar 2023
- 2023From Robustness to Privacy and Back3 Feb 2023
- 2023A Bias-Accuracy-Privacy Trilemma for Statistical Estimation30 Jan 2023
- 2023Fast, Sample-Efficient, Affine-Invariant Private Mean and Covariance Estimation for Subgaussian Distributions28 Jan 2023
- 2022Privately Estimating a Gaussian: Efficient, Robust and Optimal15 Dec 2022
- 2022Robustness Implies Privacy in Statistical Estimation9 Dec 2022
- 2022Private Estimation with Public Data16 Aug 2022
- 2022Differentially Private Covariance Revisited28 May 2022
- 2022New Lower Bounds for Private Estimation and a Generalized Fingerprinting Lemma17 May 2022
- 2022Differentially Private Regression with Unbounded Covariates19 Feb 2022
- 2021Private Robust Estimation by Stabilizing Convex Relaxations7 Dec 2021
- 2021Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanism25 Nov 2021
- 2021Private and polynomial time algorithms for learning Gaussians and beyond22 Nov 2021
- 2021Differential privacy and robust statistics in high dimensions12 Nov 2021
- 2021A Private and Computationally-Efficient Estimator for Unbounded Gaussians8 Nov 2021
- 2021Covariance-Aware Private Mean Estimation Without Private Covariance Estimation24 Jun 2021
- 2021Privately Learning Mixtures of Axis-Aligned Gaussians3 Jun 2021
- 2021Robust and Differentially Private Mean Estimation18 Feb 2021
- 2021Robust and Differentially Private Mean Estimationcited by 66
- 2021Differential privacy and robust statistics in high dimensionscited by 64
- 2021Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanismcited by 50
- 2022Robustness Implies Privacy in Statistical Estimationcited by 47
- 2021Covariance-Aware Private Mean Estimation Without Private Covariance Estimationcited by 46
- 2021Private and polynomial time algorithms for learning Gaussians and beyondcited by 39
- 2021Private Robust Estimation by Stabilizing Convex Relaxationscited by 38
- 2021A Private and Computationally-Efficient Estimator for Unbounded Gaussianscited by 34
- 2022New Lower Bounds for Private Estimation and a Generalized Fingerprinting Lemmacited by 32
- 2022Private Estimation with Public Datacited by 31
- 2023From Robustness to Privacy and Backcited by 27
- 2023Fast, Sample-Efficient, Affine-Invariant Private Mean and Covariance Estimation for Subgaussian Distributionscited by 22
12 most cited of 41 All 41 (JSON)
- 2026On the Price of Privacy for Language Identification and Generation8 Apr 2026
- 2025Query-Efficient Locally Private Hypothesis Selection via the Scheffe Graph19 Sep 2025
- 2025Private Training & Data Generation by Clustering Embeddings20 Jun 2025
- 2025Nearly-Linear Time Private Hypothesis Selection with the Optimal Approximation Factor1 Jun 2025
- 2025A Private Approximation of the 2nd-Moment Matrix of Any Subsamplable Input20 May 2025
- 2025Private Statistical Estimation via Truncation18 May 2025
- 2025Optimal Differentially Private Sampling of Unbounded Gaussians3 Mar 2025
- 2025Learning with Differentially Private (Sliced) Wasserstein Gradients3 Feb 2025
- 2024Sample-Efficient Private Learning of Mixtures of Gaussians4 Nov 2024
- 2024Dimension-free Private Mean Estimation for Anisotropic Distributions1 Nov 2024
- 2024Agnostic Private Density Estimation for GMMs via List Global Stability5 Jul 2024
- 2024Distribution Learnability and Robustness25 Jun 2024
12 newest of 41 All 41 (JSON)