Robustly Learning a Gaussian: Getting Optimal Error, Efficiently
Not on the map. Why?
Abstract (arXiv)
We study the fundamental problem of learning the parameters of a high-dimensional Gaussian in the presence of noise -- where an varepsilon-fraction of our samples were chosen by an adversary. We give robust estimators that achieve estimation error O(varepsilon) in the total variation distance, which is optimal up to a universal constant that is independent of the dimension. In the case where just the mean is unknown, our robustness guarantee is optimal up to a factor of √2 and the running time is polynomial in d and 1/ε. When both the mean and covariance are unknown, the running time is polynomial in d and quasipolynomial in 1/varepsilon. Moreover all of our algorithms require only a polynomial number of samples. Our work shows that the same sorts of error guarantees that were established over fifty years ago in the one-dimensional setting can also be achieved by efficient algorithms in high-dimensional settings.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 7; 2023: 4; 2024: 9; 2025: 5; 2026: 3.
39 papers.
Sort:
By area:
- 2021Robust and Differentially Private Mean Estimationcited by 66
- 2021Covariance-Aware Private Mean Estimation Without Private Covariance Estimationcited by 46
- 2021Private Robust Estimation by Stabilizing Convex Relaxationscited by 38
- 2021Efficient Algorithms for Learning from Coarse Labelscited by 21
- 2021Learning GMMs with Nearly Optimal Robustness Guaranteescited by 12
- 2022Estimation Contracts for Outlier-Robust Geometric Perceptioncited by 11
- 2021Robust Estimation for Random Graphscited by 8
- 2024A Subspace-Constrained Tyler's Estimator and its Applications to Structure from Motioncited by 8
- 2021SoS Degree Reduction with Applications to Clustering and Robust Moment Estimationcited by 7
- 2023Spectral clustering in the Gaussian mixture block modelcited by 7
- 2023Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear Regressioncited by 7
- 2024Efficient Statistics With Unknown Truncation, Polynomial Time Algorithms, Beyond Gaussianscited by 7
27 more
- 2021Kalman Filtering with Adversarial Corruptionscited by 6
- 2022Robust and Sparse Estimation of Linear Regression Coefficients with Heavy-tailed Noises and Covariatescited by 6
- 2025Efficient Multivariate Robust Mean Estimation Under Mean-Shift Contaminationcited by 6
- 2022Efficient List-Decodable Regression using Batchescited by 5
- 2024Robust Distribution Learning with Local and Global Adversarial Corruptionscited by 5
- 2021Robust Online Convex Optimization in the Presence of Outlierscited by 4
- 2022Robust estimation algorithms don't need to know the corruption levelcited by 4
- 2022Outlier Robust and Sparse Estimation of Linear Regression Coefficientscited by 4
- 2024Distribution Learnability and Robustnesscited by 4
- 2021Exponential Weights Algorithms for Selective Learningcited by 2
- 2023Learning Mixtures of Gaussians with Censored Datacited by 2
- 2023CRIMED: Lower and Upper Bounds on Regret for Bandits with Unbounded Stochastic Corruptioncited by 2
- 2024Robust Sparse Estimation for Gaussians with Optimal Error under Huber Contaminationcited by 2
- 2024Multigroup Robustnesscited by 2
- 2024The Broader Landscape of Robustness in Algorithmic Statisticscited by 2
- 2025Learning High-dimensional Gaussians from Censored Datacited by 2
- 2021Faster Algorithms and Constant Lower Bounds for the Worst-Case Expected Errorcited by 1
- 2022Nearly minimax robust estimator of the mean vector by iterative spectral dimension reductioncited by 1
- 2024Distribution Learning Meets Graph Structure Samplingcited by 1
- 2024Robust Mixture Learning when Outliers Overwhelm Small Groupscited by 1
- 2025On the Learnability of Distribution Classes with Adaptive Adversariescited by 1
- 2025Linear Regression under Missing or Corrupted Coordinatescited by 1
- 2026High-Dimensional Gaussian Mean Estimation under Realizable Contaminationcited by 1
- 2026Robust Learning with Optimal Errorcited by 1
- 2022Privately Estimating a Gaussian: Efficient, Robust and Optimalcited by 0
- 2025Improved Robust Estimation for ErdHos-R'enyi Graphs: The Sparse Regime and Optimal Breakdown Pointcited by 0
- 2026Beyond Heuristic Prompting: A Concept-Guided Bayesian Framework for Zero-Shot Image Recognitioncited by 0
- 2026Robust Learning with Optimal Error2 Apr 2026
- 2026High-Dimensional Gaussian Mean Estimation under Realizable Contamination17 Mar 2026
- 2026Beyond Heuristic Prompting: A Concept-Guided Bayesian Framework for Zero-Shot Image Recognition9 Mar 2026
- 2025Linear Regression under Missing or Corrupted Coordinates23 Sep 2025
- 2025On the Learnability of Distribution Classes with Adaptive Adversaries5 Sep 2025
- 2025Learning High-dimensional Gaussians from Censored Data28 Apr 2025
- 2025Improved Robust Estimation for ErdHos-R'enyi Graphs: The Sparse Regime and Optimal Breakdown Point5 Mar 2025
- 2025Efficient Multivariate Robust Mean Estimation Under Mean-Shift Contamination20 Feb 2025
- 2024The Broader Landscape of Robustness in Algorithmic Statistics3 Dec 2024
- 2024Efficient Statistics With Unknown Truncation, Polynomial Time Algorithms, Beyond Gaussians2 Oct 2024
- 2024Robust Mixture Learning when Outliers Overwhelm Small Groups22 Jul 2024
- 2024Distribution Learnability and Robustness25 Jun 2024
27 more
- 2024Robust Distribution Learning with Local and Global Adversarial Corruptions10 Jun 2024
- 2024Distribution Learning Meets Graph Structure Sampling13 May 2024
- 2024Multigroup Robustness1 May 2024
- 2024A Subspace-Constrained Tyler's Estimator and its Applications to Structure from Motion17 Apr 2024
- 2024Robust Sparse Estimation for Gaussians with Optimal Error under Huber Contamination15 Mar 2024
- 2023Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear Regression4 Dec 2023
- 2023CRIMED: Lower and Upper Bounds on Regret for Bandits with Unbounded Stochastic Corruption28 Sep 2023
- 2023Learning Mixtures of Gaussians with Censored Data6 May 2023
- 2023Spectral clustering in the Gaussian mixture block model29 Apr 2023
- 2022Privately Estimating a Gaussian: Efficient, Robust and Optimal15 Dec 2022
- 2022Efficient List-Decodable Regression using Batches23 Nov 2022
- 2022Outlier Robust and Sparse Estimation of Linear Regression Coefficients24 Aug 2022
- 2022Estimation Contracts for Outlier-Robust Geometric Perception22 Aug 2022
- 2022Robust and Sparse Estimation of Linear Regression Coefficients with Heavy-tailed Noises and Covariates15 Jun 2022
- 2022Nearly minimax robust estimator of the mean vector by iterative spectral dimension reduction5 Apr 2022
- 2022Robust estimation algorithms don't need to know the corruption level11 Feb 2022
- 2021Faster Algorithms and Constant Lower Bounds for the Worst-Case Expected Error27 Dec 2021
- 2021Private Robust Estimation by Stabilizing Convex Relaxations7 Dec 2021
- 2021Kalman Filtering with Adversarial Corruptions11 Nov 2021
- 2021Robust Estimation for Random Graphs9 Nov 2021
- 2021Efficient Algorithms for Learning from Coarse Labels22 Aug 2021
- 2021Robust Online Convex Optimization in the Presence of Outliers5 Jul 2021
- 2021Exponential Weights Algorithms for Selective Learning29 Jun 2021
- 2021Covariance-Aware Private Mean Estimation Without Private Covariance Estimation24 Jun 2021
- 2021Learning GMMs with Nearly Optimal Robustness Guarantees19 Apr 2021
- 2021Robust and Differentially Private Mean Estimation18 Feb 2021
- 2021SoS Degree Reduction with Applications to Clustering and Robust Moment Estimation5 Jan 2021
- 2021Robust and Differentially Private Mean Estimationcited by 66
- 2021Covariance-Aware Private Mean Estimation Without Private Covariance Estimationcited by 46
- 2021Private Robust Estimation by Stabilizing Convex Relaxationscited by 38
- 2021Efficient Algorithms for Learning from Coarse Labelscited by 21
- 2021Learning GMMs with Nearly Optimal Robustness Guaranteescited by 12
- 2022Estimation Contracts for Outlier-Robust Geometric Perceptioncited by 11
- 2021Robust Estimation for Random Graphscited by 8
- 2024A Subspace-Constrained Tyler's Estimator and its Applications to Structure from Motioncited by 8
- 2021SoS Degree Reduction with Applications to Clustering and Robust Moment Estimationcited by 7
- 2023Spectral clustering in the Gaussian mixture block modelcited by 7
- 2023Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear Regressioncited by 7
- 2024Efficient Statistics With Unknown Truncation, Polynomial Time Algorithms, Beyond Gaussianscited by 7
12 most cited of 38 All 38 (JSON)
- 2026Robust Learning with Optimal Error2 Apr 2026
- 2026High-Dimensional Gaussian Mean Estimation under Realizable Contamination17 Mar 2026
- 2025Linear Regression under Missing or Corrupted Coordinates23 Sep 2025
- 2025On the Learnability of Distribution Classes with Adaptive Adversaries5 Sep 2025
- 2025Learning High-dimensional Gaussians from Censored Data28 Apr 2025
- 2025Improved Robust Estimation for ErdHos-R'enyi Graphs: The Sparse Regime and Optimal Breakdown Point5 Mar 2025
- 2025Efficient Multivariate Robust Mean Estimation Under Mean-Shift Contamination20 Feb 2025
- 2024The Broader Landscape of Robustness in Algorithmic Statistics3 Dec 2024
- 2024Efficient Statistics With Unknown Truncation, Polynomial Time Algorithms, Beyond Gaussians2 Oct 2024
- 2024Robust Mixture Learning when Outliers Overwhelm Small Groups22 Jul 2024
- 2024Distribution Learnability and Robustness25 Jun 2024
- 2024Robust Distribution Learning with Local and Global Adversarial Corruptions10 Jun 2024
12 newest of 38 All 38 (JSON)