Sharp Concentration Results for Heavy-Tailed Distributions
Not on the map. Why?
Abstract (arXiv)
We obtain concentration and large deviation for the sums of independent and identically distributed random variables with heavy-tailed distributions. Our concentration results are concerned with random variables whose distributions satisfy mathbbP(X>t) ≤ rm e- I(t), where I: ℝ rightarrow ℝ is an increasing function and I(t)/t rightarrow α ∈ [0, ∞) as t rightarrow ∞. Our main theorem can not only recover some of the existing results, such as the concentration of the sum of subWeibull random variables, but it can also produce new results for the sum of random variables with heavier tails. We show that the concentration inequalities we obtain are sharp enough to offer large deviation results for the sums of independent random variables as well. Our analyses which are based on standard truncation arguments simplify, unify and generalize the existing results on the concentration and large deviation of heavy-tailed random variables.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 2; 2024: 4; 2025: 3; 2026: 1.
15 papers.
Sort:
By area:
- 2021A unifying tutorial on Approximate Message Passingcited by 49
- 2021On Empirical Risk Minimization with Dependent and Heavy-Tailed Datacited by 16
- 2022Asymptotic consistency of the WSINDy algorithm in the limit of continuum datacited by 14
- 2022Trace norm regularization for multi-task learning with scarce datacited by 10
- 2023General Tail Bounds for Non-Smooth Stochastic Mirror Descentcited by 7
- 2024Clip Body and Tail Separately: High Probability Guarantees for DPSGD with Heavy Tailscited by 4
- 2021Compressing Heavy-Tailed Weight Matrices for Non-Vacuous Generalization Boundscited by 3
- 2024Learning with User-Level Local Differential Privacycited by 3
- 2024A General Reduction for High-Probability Analysis with General Light-Tailed Distributionscited by 1
- 2025Weighted Random Dot Product Graphscited by 1
- 2023Exponential tail bounds and Large Deviation Principle for Heavy-Tailed U-Statisticscited by 0
- 2024Testing Credibility of Public and Private Surveys through the Lens of Regressioncited by 0
3 more
- 2025Sublinear Algorithms for Wasserstein and Total Variation Distances: Applications to Fairness and Privacy Auditingcited by 0
- 2025Stochastic Weakly Convex Optimization Under Heavy-Tailed Noisescited by 0
- 2026Tail-Aware Information-Theoretic Bounds for LLM Alignment under Heavy-Tailed Rewardscited by 0
- 2026Tail-Aware Information-Theoretic Bounds for LLM Alignment under Heavy-Tailed Rewards12 Apr 2026
- 2025Stochastic Weakly Convex Optimization Under Heavy-Tailed Noises17 Jul 2025
- 2025Weighted Random Dot Product Graphs6 May 2025
- 2025Sublinear Algorithms for Wasserstein and Total Variation Distances: Applications to Fairness and Privacy Auditing10 Mar 2025
- 2024Testing Credibility of Public and Private Surveys through the Lens of Regression7 Oct 2024
- 2024Clip Body and Tail Separately: High Probability Guarantees for DPSGD with Heavy Tails27 May 2024
- 2024Learning with User-Level Local Differential Privacy27 May 2024
- 2024A General Reduction for High-Probability Analysis with General Light-Tailed Distributions5 Mar 2024
- 2023General Tail Bounds for Non-Smooth Stochastic Mirror Descent12 Dec 2023
- 2023Exponential tail bounds and Large Deviation Principle for Heavy-Tailed U-Statistics27 Jan 2023
- 2022Asymptotic consistency of the WSINDy algorithm in the limit of continuum data29 Nov 2022
- 2022Trace norm regularization for multi-task learning with scarce data14 Feb 2022
3 more
- 2021A unifying tutorial on Approximate Message Passingcited by 49
- 2021On Empirical Risk Minimization with Dependent and Heavy-Tailed Datacited by 16
- 2022Asymptotic consistency of the WSINDy algorithm in the limit of continuum datacited by 14
- 2022Trace norm regularization for multi-task learning with scarce datacited by 10
- 2023General Tail Bounds for Non-Smooth Stochastic Mirror Descentcited by 7
- 2024Clip Body and Tail Separately: High Probability Guarantees for DPSGD with Heavy Tailscited by 4
- 2021Compressing Heavy-Tailed Weight Matrices for Non-Vacuous Generalization Boundscited by 3
- 2024Learning with User-Level Local Differential Privacycited by 3
- 2024A General Reduction for High-Probability Analysis with General Light-Tailed Distributionscited by 1
- 2025Weighted Random Dot Product Graphscited by 1
- 2023Exponential tail bounds and Large Deviation Principle for Heavy-Tailed U-Statisticscited by 0
- 2024Testing Credibility of Public and Private Surveys through the Lens of Regressioncited by 0
12 most cited of 14 All 14 (JSON)
- 2025Stochastic Weakly Convex Optimization Under Heavy-Tailed Noises17 Jul 2025
- 2025Weighted Random Dot Product Graphs6 May 2025
- 2025Sublinear Algorithms for Wasserstein and Total Variation Distances: Applications to Fairness and Privacy Auditing10 Mar 2025
- 2024Testing Credibility of Public and Private Surveys through the Lens of Regression7 Oct 2024
- 2024Clip Body and Tail Separately: High Probability Guarantees for DPSGD with Heavy Tails27 May 2024
- 2024Learning with User-Level Local Differential Privacy27 May 2024
- 2024A General Reduction for High-Probability Analysis with General Light-Tailed Distributions5 Mar 2024
- 2023General Tail Bounds for Non-Smooth Stochastic Mirror Descent12 Dec 2023
- 2023Exponential tail bounds and Large Deviation Principle for Heavy-Tailed U-Statistics27 Jan 2023
- 2022Asymptotic consistency of the WSINDy algorithm in the limit of continuum data29 Nov 2022
- 2022Trace norm regularization for multi-task learning with scarce data14 Feb 2022
- 2021On Empirical Risk Minimization with Dependent and Heavy-Tailed Data6 Sep 2021
12 newest of 14 All 14 (JSON)