Settling the Robust Learnability of Mixtures of Gaussians
Not on the map. Why?
Abstract (arXiv)
This work represents a natural coalescence of two important lines of work: learning mixtures of Gaussians and algorithmic robust statistics. In particular we give the first provably robust algorithm for learning mixtures of any constant number of Gaussians. We require only mild assumptions on the mixing weights (bounded fractionality) and that the total variation distance between components is bounded away from zero. At the heart of our algorithm is a new method for proving dimension-independent polynomial identifiability through applying a carefully chosen sequence of differential operations to certain generating functions that not only encode the parameters we would like to learn but also the system of polynomial equations we would like to solve. We show how the symbolic identities we derive can be directly used to analyze a natural sum-of-squares relaxation.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 11; 2024: 6; 2025: 2; 2026: 1.
32 papers.
Sort:
- 2022Robust Sparse Mean Estimation via Sum of Squarescited by 23
- 2021Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimationcited by 21
- 2022Streaming Algorithms for High-Dimensional Robust Statisticscited by 21
- 2023Learning quantum Hamiltonians at any temperature in polynomial timecited by 20
- 2023Polynomial Time and Private Learning of Unbounded Gaussian Mixture Modelscited by 19
- 2021Outlier-Robust Learning of Ising Models Under Dobrushin's Conditioncited by 14
- 2021Learning GMMs with Nearly Optimal Robustness Guaranteescited by 12
- 2022Minimax Rates for Robust Community Detectioncited by 12
- 2023Nearly-Linear Time and Streaming Algorithms for Outlier-Robust PCAcited by 10
- 2022List-Decodable Covariance Estimationcited by 8
- 2021Kalman Filtering with Adversarial Corruptionscited by 6
- 2021Beyond Parallel Pancakes: Quasi-Polynomial Time Guarantees for Non-Spherical Gaussian Mixturescited by 5
20 more
- 2023Mixtures of Gaussians are Privately Learnable with a Polynomial Number of Samplescited by 5
- 2023Beyond Moments: Robustly Learning Affine Transformations with Asymptotically Optimal Errorcited by 4
- 2023SQ Lower Bounds for Learning Mixtures of Linear Classifierscited by 4
- 2024Efficient Certificates of Anti-Concentration Beyond Gaussianscited by 4
- 2024Distribution Learnability and Robustnesscited by 4
- 2021Robust Model Selection and Nearly-Proper Learning for GMMscited by 3
- 2022Efficient Algorithms for Sparse Moment Problems without Separationcited by 3
- 2023Online Robust Mean Estimationcited by 3
- 2023Clustering Mixtures of Bounded Covariance Distributions Under Optimal Separationcited by 3
- 2021Robust Voting Rules from Algorithmic Robust Statisticscited by 1
- 2023A Spectral Algorithm for List-Decodable Covariance Estimation in Relative Frobenius Normcited by 1
- 2024Robust Mixture Learning when Outliers Overwhelm Small Groupscited by 1
- 2024Factor Adjusted Spectral Clustering for Mixture Modelscited by 1
- 2025On the Learnability of Distribution Classes with Adaptive Adversariescited by 1
- 2026Learning Mixture Models via Efficient High-dimensional Sparse Fourier Transformscited by 1
- 2023The Parametric Stability of Well-separated Spherical Gaussian Mixturescited by 0
- 2023SQ Lower Bounds for Learning Bounded Covariance GMMscited by 0
- 2024Untangling Gaussian Mixturescited by 0
- 2024Sample-Efficient Private Learning of Mixtures of Gaussianscited by 0
- 2025On Learning Parallel Pancakes with Mostly Uniform Weightscited by 0
- 2026Learning Mixture Models via Efficient High-dimensional Sparse Fourier Transforms8 Jan 2026
- 2025On the Learnability of Distribution Classes with Adaptive Adversaries5 Sep 2025
- 2025On Learning Parallel Pancakes with Mostly Uniform Weights21 Apr 2025
- 2024Sample-Efficient Private Learning of Mixtures of Gaussians4 Nov 2024
- 2024Factor Adjusted Spectral Clustering for Mixture Models22 Aug 2024
- 2024Robust Mixture Learning when Outliers Overwhelm Small Groups22 Jul 2024
- 2024Distribution Learnability and Robustness25 Jun 2024
- 2024Efficient Certificates of Anti-Concentration Beyond Gaussians23 May 2024
- 2024Untangling Gaussian Mixtures11 Mar 2024
- 2023Clustering Mixtures of Bounded Covariance Distributions Under Optimal Separation19 Dec 2023
- 2023Online Robust Mean Estimation24 Oct 2023
- 2023SQ Lower Bounds for Learning Mixtures of Linear Classifiers18 Oct 2023
20 more
- 2023Learning quantum Hamiltonians at any temperature in polynomial time3 Oct 2023
- 2023Mixtures of Gaussians are Privately Learnable with a Polynomial Number of Samples7 Sep 2023
- 2023SQ Lower Bounds for Learning Bounded Covariance GMMs22 Jun 2023
- 2023Nearly-Linear Time and Streaming Algorithms for Outlier-Robust PCA4 May 2023
- 2023A Spectral Algorithm for List-Decodable Covariance Estimation in Relative Frobenius Norm1 May 2023
- 2023Polynomial Time and Private Learning of Unbounded Gaussian Mixture Models7 Mar 2023
- 2023Beyond Moments: Robustly Learning Affine Transformations with Asymptotically Optimal Error23 Feb 2023
- 2023The Parametric Stability of Well-separated Spherical Gaussian Mixtures1 Feb 2023
- 2022Efficient Algorithms for Sparse Moment Problems without Separation26 Jul 2022
- 2022Minimax Rates for Robust Community Detection25 Jul 2022
- 2022List-Decodable Covariance Estimation22 Jun 2022
- 2022Robust Sparse Mean Estimation via Sum of Squares7 Jun 2022
- 2022Streaming Algorithms for High-Dimensional Robust Statistics26 Apr 2022
- 2021Robust Voting Rules from Algorithmic Robust Statistics13 Dec 2021
- 2021Beyond Parallel Pancakes: Quasi-Polynomial Time Guarantees for Non-Spherical Gaussian Mixtures10 Dec 2021
- 2021Kalman Filtering with Adversarial Corruptions11 Nov 2021
- 2021Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimation16 Jun 2021
- 2021Robust Model Selection and Nearly-Proper Learning for GMMs5 Jun 2021
- 2021Learning GMMs with Nearly Optimal Robustness Guarantees19 Apr 2021
- 2021Outlier-Robust Learning of Ising Models Under Dobrushin's Condition3 Feb 2021
- 2022Robust Sparse Mean Estimation via Sum of Squarescited by 23
- 2021Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimationcited by 21
- 2022Streaming Algorithms for High-Dimensional Robust Statisticscited by 21
- 2023Learning quantum Hamiltonians at any temperature in polynomial timecited by 20
- 2023Polynomial Time and Private Learning of Unbounded Gaussian Mixture Modelscited by 19
- 2021Outlier-Robust Learning of Ising Models Under Dobrushin's Conditioncited by 14
- 2021Learning GMMs with Nearly Optimal Robustness Guaranteescited by 12
- 2022Minimax Rates for Robust Community Detectioncited by 12
- 2023Nearly-Linear Time and Streaming Algorithms for Outlier-Robust PCAcited by 10
- 2022List-Decodable Covariance Estimationcited by 8
- 2021Kalman Filtering with Adversarial Corruptionscited by 6
- 2021Beyond Parallel Pancakes: Quasi-Polynomial Time Guarantees for Non-Spherical Gaussian Mixturescited by 5
12 most cited of 32 All 32 (JSON)
- 2026Learning Mixture Models via Efficient High-dimensional Sparse Fourier Transforms8 Jan 2026
- 2025On the Learnability of Distribution Classes with Adaptive Adversaries5 Sep 2025
- 2025On Learning Parallel Pancakes with Mostly Uniform Weights21 Apr 2025
- 2024Sample-Efficient Private Learning of Mixtures of Gaussians4 Nov 2024
- 2024Factor Adjusted Spectral Clustering for Mixture Models22 Aug 2024
- 2024Robust Mixture Learning when Outliers Overwhelm Small Groups22 Jul 2024
- 2024Distribution Learnability and Robustness25 Jun 2024
- 2024Efficient Certificates of Anti-Concentration Beyond Gaussians23 May 2024
- 2024Untangling Gaussian Mixtures11 Mar 2024
- 2023Clustering Mixtures of Bounded Covariance Distributions Under Optimal Separation19 Dec 2023
- 2023Online Robust Mean Estimation24 Oct 2023
- 2023SQ Lower Bounds for Learning Mixtures of Linear Classifiers18 Oct 2023
12 newest of 32 All 32 (JSON)