Phase Retrieval via Randomized Kaczmarz: Theoretical Guarantees
Not on the map. Why?
Abstract (arXiv)
We consider the problem of phase retrieval, i.e. that of solving systems of quadratic equations. A simple variant of the randomized Kaczmarz method was recently proposed for phase retrieval, and it was shown numerically to have a computational edge over state-of-the-art Wirtinger flow methods. In this paper, we provide the first theoretical guarantee for the convergence of the randomized Kaczmarz method for phase retrieval. We show that it is sufficient to have as many Gaussian measurements as the dimension, up to a constant factor. Along the way, we introduce a sufficient condition on measurement sets for which the randomized Kaczmarz method is guaranteed to work. We show that Gaussian sampling vectors satisfy this property with high probability; this is proved using a chaining argument coupled with bounds on VC dimension and metric entropy.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 3; 2024: 1; 2025: 5; 2026: 2.
15 papers.
Sort:
- 2022High-dimensional limit theorems for SGD: Effective dynamics and critical scalingcited by 69
- 2022Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networkscited by 50
- 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGDcited by 14
- 2026Spectral Gradient Descent Mitigates Anisotropy-Driven Misalignment: A Case Study in Phase Retrievalcited by 5
- 2023Max-affine regression via first-order methodscited by 3
- 2025Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Datacited by 3
- 2021Max-Linear Regression by Convex Programmingcited by 2
- 2022An optimal scheduled learning rate for a randomized Kaczmarz algorithmcited by 1
- 2023A Note on Randomized Kaczmarz Algorithm for Solving Doubly-Noisy Linear Systemscited by 1
- 2024Computationally efficient reductions between some statistical modelscited by 0
- 2025Phase transition of descending phase retrieval algorithmscited by 0
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT viewcited by 0
3 more
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitionscited by 0
- 2025Universality of high-dimensional scaling limits of stochastic gradient descentcited by 0
- 2026Locally Near Optimal Piecewise Linear Regression in High Dimensions via Difference of Max-Affine Functionscited by 0
- 2026Locally Near Optimal Piecewise Linear Regression in High Dimensions via Difference of Max-Affine Functions7 May 2026
- 2026Spectral Gradient Descent Mitigates Anisotropy-Driven Misalignment: A Case Study in Phase Retrieval30 Jan 2026
- 2025Universality of high-dimensional scaling limits of stochastic gradient descent15 Dec 2025
- 2025Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Data24 Nov 2025
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitions23 Jun 2025
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT view23 Jun 2025
- 2025Phase transition of descending phase retrieval algorithms23 Jun 2025
- 2024Computationally efficient reductions between some statistical models12 Feb 2024
- 2023A Note on Randomized Kaczmarz Algorithm for Solving Doubly-Noisy Linear Systems31 Aug 2023
- 2023Max-affine regression via first-order methods15 Aug 2023
- 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD29 May 2023
- 2022High-dimensional limit theorems for SGD: Effective dynamics and critical scaling8 Jun 2022
- 2022High-dimensional limit theorems for SGD: Effective dynamics and critical scalingcited by 69
- 2022Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networkscited by 50
- 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGDcited by 14
- 2026Spectral Gradient Descent Mitigates Anisotropy-Driven Misalignment: A Case Study in Phase Retrievalcited by 5
- 2023Max-affine regression via first-order methodscited by 3
- 2025Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Datacited by 3
- 2021Max-Linear Regression by Convex Programmingcited by 2
- 2022An optimal scheduled learning rate for a randomized Kaczmarz algorithmcited by 1
- 2023A Note on Randomized Kaczmarz Algorithm for Solving Doubly-Noisy Linear Systemscited by 1
- 2024Computationally efficient reductions between some statistical modelscited by 0
- 2025Phase transition of descending phase retrieval algorithmscited by 0
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT viewcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Locally Near Optimal Piecewise Linear Regression in High Dimensions via Difference of Max-Affine Functions7 May 2026
- 2026Spectral Gradient Descent Mitigates Anisotropy-Driven Misalignment: A Case Study in Phase Retrieval30 Jan 2026
- 2025Universality of high-dimensional scaling limits of stochastic gradient descent15 Dec 2025
- 2025Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Data24 Nov 2025
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitions23 Jun 2025
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT view23 Jun 2025
- 2025Phase transition of descending phase retrieval algorithms23 Jun 2025
- 2024Computationally efficient reductions between some statistical models12 Feb 2024
- 2023A Note on Randomized Kaczmarz Algorithm for Solving Doubly-Noisy Linear Systems31 Aug 2023
- 2023Max-affine regression via first-order methods15 Aug 2023
- 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD29 May 2023
- 2022High-dimensional limit theorems for SGD: Effective dynamics and critical scaling8 Jun 2022
12 newest of 15 All 15 (JSON)