Simple, unified analysis of Johnson-Lindenstrauss with applications
Not on the map. Why?
Abstract (arXiv)
We present a simplified and unified analysis of the Johnson-Lindenstrauss (JL) lemma, a cornerstone of dimensionality reduction for managing high-dimensional data. Our approach simplifies understanding and unifies various constructions under the JL framework, including spherical, binary-coin, sparse JL, Gaussian, and sub-Gaussian models. This unification preserves the intrinsic geometry of data, essential for applications from streaming algorithms to reinforcement learning. We provide the first rigorous proof of the spherical construction's effectiveness and introduce a general class of sub-Gaussian constructions within this simplified framework. Central to our contribution is an innovative extension of the Hanson-Wright inequality to high dimensions, complete with explicit constants. By using simple yet powerful probabilistic tools and analytical techniques, such as an enhanced diagonalization process, our analysis solidifies the theoretical foundation of the JL lemma by removing an independence assumption and extends its practical applicability to contemporary algorithms.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 5 of its 32 references that are in the map. First posted on arXiv 10 Feb 2024.
Builds on
5 of 32 references.
References · 5
- 2014Sketching as a Tool for Numerical Linear Algebracited by 285
- 2021Epistemic Neural Networkscited by 120
- 2020Hypermodels for Explorationcited by 37
- 2023Approximate Thompson Sampling via Epistemic Neural Networkscited by 31
- 2024Q-Star Meets Scalable Posterior Sampling: Bridging Theory and Practice via HyperAgentcited by 6
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Probability Tools for Sequential Random Projectioncited by 1
- 2024Probability Tools for Sequential Random Projection16 Feb 2024