Robust subgaussian estimation of a mean vector in nearly linear time
Not on the map. Why?
Abstract (arXiv)
We construct an algorithm, running in time tildemathcal O(N d + uK d), which is robust to outliers and heavy-tailed data and which achieves the subgaussian rate from [Lugosi, Mendelson] beginequationlabeleq:introsubgausrate √fracrm Tr(Sigma)N+√frac||Sigma||opKN endequationwith probability at least 1-exp(-c0K)-exp(-c1 u) where Sigma is the covariance matrix of the informative data, K∈1, ldots, K is some parameter (number of block means) and u>0 is another parameter of the algorithm. This rate is achieved when K≥ c1 |mathcal O| where |mathcal O| is the number of outliers in the database and under the only assumption that the informative data have a second moment. The algorithm is fully data-dependent and does not use in its construction the proportion of outliers nor the rate above. Its construction combines recently developed tools for Median-of-Means estimators and covering-Semi-definite Programming [Chen, Diakonikolas, Ge] and [Peng, Tangwongsan, Zhang].
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 14; 2023: 8; 2024: 7; 2025: 1; 2026: 2.
37 papers.
Sort:
- 2021Robust and Differentially Private Mean Estimationcited by 66
- 2021Differential privacy and robust statistics in high dimensionscited by 64
- 2021Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanismcited by 50
- 2022On the Impossible Safety of Large AI Modelscited by 27
- 2022Robust Sparse Mean Estimation via Sum of Squarescited by 23
- 2022Outlier-Robust Sparse Mean Estimation for Heavy-Tailed Distributionscited by 13
- 2024High-probability minimax lower boundscited by 11
- 2021Heavy-tailed Streaming Statistical Estimationcited by 10
- 2023Nearly-Linear Time and Streaming Algorithms for Outlier-Robust PCAcited by 10
- 2024On Goodhart's law, with an application to value alignmentcited by 9
- 2023Huber-Robust Confidence Sequencescited by 7
- 2023Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear Regressioncited by 7
25 more
- 2022Bandits Corrupted by Nature: Lower Bounds on Regret and Robust Optimistic Algorithmcited by 6
- 2022Robust and Sparse Estimation of Linear Regression Coefficients with Heavy-tailed Noises and Covariatescited by 6
- 2022Robust Methods for High-Dimensional Linear Learningcited by 5
- 2022Coordinated Attacks against Contextual Bandits: Fundamental Limits and Defense Mechanismscited by 4
- 2022Outlier Robust and Sparse Estimation of Linear Regression Coefficientscited by 4
- 2023Computationally Efficient and Statistically Optimal Robust High-Dimensional Linear Regressioncited by 4
- 2026Robust Mean Estimation under Quantizationcited by 4
- 2022Robust supervised learning with coordinate gradient descentcited by 3
- 2022Robust Estimation for Nonparametric Families via Generative Adversarial Networkscited by 3
- 2023Robust Stochastic Optimization via Gradient Quantile Clippingcited by 3
- 2024A provable initialization and robust clustering method for general mixture modelscited by 2
- 2024Optimal Robust Estimation under Local and Global Corruptions: Stronger Adversary and Smaller Errorcited by 2
- 2024The Broader Landscape of Robustness in Algorithmic Statisticscited by 2
- 2021Robust Learning of Fixed-Structure Bayesian Networks in Nearly-Linear Timecited by 1
- 2022Nearly minimax robust estimator of the mean vector by iterative spectral dimension reductioncited by 1
- 2023Tight Non-asymptotic Inference via Sub-Gaussian Intrinsic Moment Normcited by 1
- 2024Differential Private Stochastic Optimization with Heavy-tailed Data: Towards Optimal Ratescited by 1
- 2022An Efficient Minimax Optimal Estimator For Multivariate Convex Regressioncited by 0
- 2022A spectral least-squares-type method for heavy-tailed corrupted regression with unknown covariance & heterogeneous noisecited by 0
- 2022Robustifying Markowitzcited by 0
- 2023Online Heavy-tailed Change-point detectioncited by 0
- 2023Statistical Barriers to Affine-equivariant Estimationcited by 0
- 2024Heavy-tailed Contamination is Easier than Adversarial Contaminationcited by 0
- 2025Robust Estimation Under Heterogeneous Corruption Ratescited by 0
- 2026Mean Testing under Truncation beyond Gaussiancited by 0
- 2026Mean Testing under Truncation beyond Gaussian2 May 2026
- 2026Robust Mean Estimation under Quantization11 Jan 2026
- 2025Robust Estimation Under Heterogeneous Corruption Rates20 Aug 2025
- 2024The Broader Landscape of Robustness in Algorithmic Statistics3 Dec 2024
- 2024Heavy-tailed Contamination is Easier than Adversarial Contamination22 Nov 2024
- 2024Optimal Robust Estimation under Local and Global Corruptions: Stronger Adversary and Smaller Error22 Oct 2024
- 2024On Goodhart's law, with an application to value alignment12 Oct 2024
- 2024Differential Private Stochastic Optimization with Heavy-tailed Data: Towards Optimal Rates19 Aug 2024
- 2024High-probability minimax lower bounds19 Jun 2024
- 2024A provable initialization and robust clustering method for general mixture models10 Jan 2024
- 2023Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear Regression4 Dec 2023
- 2023Statistical Barriers to Affine-equivariant Estimation16 Oct 2023
25 more
- 2023Robust Stochastic Optimization via Gradient Quantile Clipping29 Sep 2023
- 2023Online Heavy-tailed Change-point detection15 Jun 2023
- 2023Computationally Efficient and Statistically Optimal Robust High-Dimensional Linear Regression10 May 2023
- 2023Nearly-Linear Time and Streaming Algorithms for Outlier-Robust PCA4 May 2023
- 2023Tight Non-asymptotic Inference via Sub-Gaussian Intrinsic Moment Norm13 Mar 2023
- 2023Huber-Robust Confidence Sequences23 Jan 2023
- 2022Robustifying Markowitz28 Dec 2022
- 2022Outlier-Robust Sparse Mean Estimation for Heavy-Tailed Distributions29 Nov 2022
- 2022On the Impossible Safety of Large AI Models30 Sep 2022
- 2022A spectral least-squares-type method for heavy-tailed corrupted regression with unknown covariance & heterogeneous noise6 Sep 2022
- 2022Outlier Robust and Sparse Estimation of Linear Regression Coefficients24 Aug 2022
- 2022Robust Methods for High-Dimensional Linear Learning10 Aug 2022
- 2022Robust and Sparse Estimation of Linear Regression Coefficients with Heavy-tailed Noises and Covariates15 Jun 2022
- 2022Robust Sparse Mean Estimation via Sum of Squares7 Jun 2022
- 2022An Efficient Minimax Optimal Estimator For Multivariate Convex Regression6 May 2022
- 2022Nearly minimax robust estimator of the mean vector by iterative spectral dimension reduction5 Apr 2022
- 2022Bandits Corrupted by Nature: Lower Bounds on Regret and Robust Optimistic Algorithm7 Mar 2022
- 2022Robust Estimation for Nonparametric Families via Generative Adversarial Networks2 Feb 2022
- 2022Robust supervised learning with coordinate gradient descent31 Jan 2022
- 2022Coordinated Attacks against Contextual Bandits: Fundamental Limits and Defense Mechanisms30 Jan 2022
- 2021Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanism25 Nov 2021
- 2021Differential privacy and robust statistics in high dimensions12 Nov 2021
- 2021Heavy-tailed Streaming Statistical Estimation25 Aug 2021
- 2021Robust Learning of Fixed-Structure Bayesian Networks in Nearly-Linear Time12 May 2021
- 2021Robust and Differentially Private Mean Estimation18 Feb 2021
- 2021Robust and Differentially Private Mean Estimationcited by 66
- 2021Differential privacy and robust statistics in high dimensionscited by 64
- 2021Efficient Mean Estimation with Pure Differential Privacy via a Sum-of-Squares Exponential Mechanismcited by 50
- 2022On the Impossible Safety of Large AI Modelscited by 27
- 2022Robust Sparse Mean Estimation via Sum of Squarescited by 23
- 2022Outlier-Robust Sparse Mean Estimation for Heavy-Tailed Distributionscited by 13
- 2024High-probability minimax lower boundscited by 11
- 2021Heavy-tailed Streaming Statistical Estimationcited by 10
- 2023Nearly-Linear Time and Streaming Algorithms for Outlier-Robust PCAcited by 10
- 2024On Goodhart's law, with an application to value alignmentcited by 9
- 2023Huber-Robust Confidence Sequencescited by 7
- 2023Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear Regressioncited by 7
12 most cited of 37 All 37 (JSON)
- 2026Mean Testing under Truncation beyond Gaussian2 May 2026
- 2026Robust Mean Estimation under Quantization11 Jan 2026
- 2025Robust Estimation Under Heterogeneous Corruption Rates20 Aug 2025
- 2024The Broader Landscape of Robustness in Algorithmic Statistics3 Dec 2024
- 2024Heavy-tailed Contamination is Easier than Adversarial Contamination22 Nov 2024
- 2024Optimal Robust Estimation under Local and Global Corruptions: Stronger Adversary and Smaller Error22 Oct 2024
- 2024On Goodhart's law, with an application to value alignment12 Oct 2024
- 2024Differential Private Stochastic Optimization with Heavy-tailed Data: Towards Optimal Rates19 Aug 2024
- 2024High-probability minimax lower bounds19 Jun 2024
- 2024A provable initialization and robust clustering method for general mixture models10 Jan 2024
- 2023Near-Optimal Algorithms for Gaussians with Huber Contamination: Mean Estimation and Linear Regression4 Dec 2023
- 2023Statistical Barriers to Affine-equivariant Estimation16 Oct 2023
12 newest of 37 All 37 (JSON)