mlsanityData to 7 Oct 2026

Robust High-dimensional Tuning Free Multiple Testing

arXiv 2211.11959 ↗First posted 22 Nov 2022math.ST cs.LG stat.MEcited by 0

Not on the map. Why?

Abstract (arXiv)

A stylized feature of high-dimensional data is that many variables have heavy tails, and robust statistical inference is critical for valid large-scale statistical inference. Yet, the existing developments such as Winsorization, Huberization and median of means require the bounded second moments and involve variable-dependent tuning parameters, which hamper their fidelity in applications to large-scale problems. To liberate these constraints, this paper revisits the celebrated Hodges-Lehmann (HL) estimator for estimating location parameters in both the one- and two-sample problems, from a non-asymptotic perspective. Our study develops Berry-Esseen inequality and Cram'er type moderate deviation for the HL estimator based on newly developed non-asymptotic Bahadur representation, and builds data-driven confidence intervals via a weighted bootstrap approach. These results allow us to extend the HL estimator to large-scale studies and propose tuning-free and moment-free high-dimensional inference procedures for testing global null and for large-scale multiple testing with false discovery proportion control. It is convincingly shown that the resulting tuning-free and moment-free methods control false discovery proportion at a prescribed level. The simulation studies lend further support to our developed theory.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 93 references that are in the map. First posted on arXiv 22 Nov 2022.

Builds on

18 of 93 references.

References · 18

  1. 2020Spectral Methods for Data Science: A Statistical Perspectivecited by 111
  2. 2017Adaptive Huber Regressioncited by 59
  3. 2013Loss minimization and parameter estimation with heavy tailscited by 50
  4. 2014Empirical risk minimization for heavy-tailed lossescited by 37
  5. 2015Statistical consistency and asymptotic normality for high-dimensional robust M-estimatorscited by 27
  6. 2022How do noise tails impact on deep ReLU networks?cited by 25
  7. 2016A Shrinkage Principle for Heavy-Tailed Data: High-Dimensional Robust Low-Rank Matrix Recoverycited by 23
  8. 2015Can parametric statistical methods be trusted for fMRI based group studies?cited by 22
  9. 2016Sub-Gaussian estimators of the mean of a random matrix with heavy-tailed entriescited by 18
  10. 2020Understanding Implicit Regularization in Over-Parameterized Single Index Modelcited by 12
  11. 2019Robust Inference via Multiplier Bootstrapcited by 8
  12. 2017FarmTest: Factor-Adjusted Robust Multiple Testing with Approximate False Discovery Controlcited by 6
6 more
  1. 2015Globally adaptive quantile regression with ultra-high dimensional datacited by 5
  2. 2017A New Perspective on Robust M-Estimation: Finite Sample Theory and Applications to Dependence-Adjusted Multiple Testingcited by 5
  3. 2022Are Latent Factor Regression and Sparse Regression Adequate?cited by 5
  4. 2022Robust Matrix Completion with Heavy-tailed Noisecited by 4
  5. 2013Phase Transition and Regularized Bootstrap in Large Scale t-tests with False Discovery Rate Controlcited by 3
  6. 2014Simulation-Based Hypothesis Testing of High Dimensional Means Under Covariance Heterogeneitycited by 2

Built on by

Not cited yet.