Phase Retrieval using Alternating Minimization
Not on the map. Why?
Abstract (arXiv)
Phase retrieval problems involve solving linear equations, but with missing sign (or phase, for complex numbers) information. More than four decades after it was first proposed, the seminal error reduction algorithm of (Gerchberg and Saxton 1972) and (Fienup 1982) is still the popular choice for solving many variants of this problem. The algorithm is based on alternating minimization; i.e. it alternates between estimating the missing phase information, and the candidate solution. Despite its wide usage in practice, no global convergence guarantees for this algorithm are known. In this paper, we show that a (resampling) variant of this approach converges geometrically to the solution of one such problem -- finding a vector x from y,A, where y = left|Atopxright| and |z| denotes a vector of element-wise magnitudes of z -- under the assumption that A is Gaussian. Empirically, we demonstrate that alternating minimization performs similar to recently proposed convex techniques for this problem (which are based on "lifting" to a convex matrix problem) in sample complexity and robustness to noise. However, it is much more efficient and can scale to large problems. Analytically, for a resampling version of alternating minimization, we show geometric convergence to the solution, and sample complexity that is off by log factors from obvious lower bounds. We also establish close to optimal scaling for the case when the unknown vector is sparse. Our work represents the first theoretical guarantee for alternating minimization (albeit with resampling) for any variant of phase retrieval problems in the non-convex setting.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Jun 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 13; 2023: 8; 2024: 8; 2025: 9; 2026: 5.
58 papers.
Sort:
By area:
- 2021Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstructioncited by 77
- 2021Hessian Eigenspectra of More Realistic Nonlinear Modelscited by 33
- 2021Sample Efficient Linear Meta-Learning by Alternating Minimizationcited by 25
- 2021Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passingcited by 18
- 2021Towards Sample-Optimal Compressive Phase Retrieval with Sparse and Generative Priorscited by 14
- 2022Generative Principal Component Analysiscited by 12
- 2022Randomly Initialized Alternating Least Squares: Fast Convergence for Matrix Sensingcited by 11
- 2021Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenescited by 10
- 2021Sharp global convergence guarantees for iterative nonconvex optimization: A Gaussian process perspectivecited by 10
- 2022On Learning Mixture of Linear Regressions in the Non-Realizable Settingcited by 10
- 2022Misspecified Phase Retrieval with Generative Priorscited by 7
- 2021Nearly Minimax-Optimal Rates for Noisy Sparse Phase Retrieval via Early-Stopped Mirror Descentcited by 5
38 more
- 2021Towards Statistical and Computational Complexities of Polyak Step Size Gradient Descentcited by 5
- 2022Matrix Completion with Hierarchical Graph Side Informationcited by 5
- 2023Fast and Accurate Estimation of Low-Rank Matrices from Noisy Measurements via Preconditioned Non-Convex Gradient Descentcited by 5
- 2023Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passingcited by 5
- 2021Householder Dice: A Matrix-Free Algorithm for Simulating Dynamics on Gaussian and Random Orthogonal Ensemblescited by 4
- 2021Phase Retrieval using Expectation Consistent Signal Recovery Algorithm based on Hypernetworkcited by 3
- 2021Nonconvex Factorization and Manifold Formulations are Almost Equivalent in Low-rank Matrix Optimizationcited by 3
- 2022Hierarchical fuzzy neural networks with privacy preservation for heterogeneous big datacited by 3
- 2023Mixed Regression via Approximate Message Passingcited by 3
- 2023Attribute-Efficient PAC Learning of Low-Degree Polynomial Threshold Functions with Nasty Noisecited by 3
- 2023Near Optimal Heteroscedastic Regression with Symbiotic Learningcited by 3
- 2024Asymptotic Dynamics of Alternating Minimization for Bilinear Regressioncited by 3
- 2024Stable Phase Retrieval with Mirror Descentcited by 3
- 2025Optimal sparse phase retrieval via a quasi-Bayesian approachcited by 3
- 2021Total Least Squares Phase Retrievalcited by 2
- 2022Provable Phase Retrieval with Mirror Descentcited by 2
- 2025DDRM-PR: Fourier Phase Retrieval using Denoising Diffusion Restoration Modelscited by 2
- 2025Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networkscited by 2
- 2021On Stochastic Variance Reduced Gradient Method for Semidefinite Optimizationcited by 1
- 2021Provably Convergent Algorithms for Solving Inverse Problems Using Generative Modelscited by 1
- 2022Randomized Policy Optimization for Optimal Stoppingcited by 1
- 2022An Exponentially Increasing Step-size for Parameter Estimation in Statistical Modelscited by 1
- 2022Alternating Phase Langevin Sampling with Implicit Denoiser Priors for Phase Retrievalcited by 1
- 2023Poisson-Gaussian Holographic Phase Retrieval with Score-based Image Priorcited by 1
- 2023The Local Landscape of Phase Retrieval Under Limited Samplescited by 1
- 2023Global Convergence of Online Identification for Mixed Linear Regressioncited by 1
- 2024Agnostic Learning of Mixed Linear Regressions with EM and AM Algorithmscited by 1
- 2024A Sample Efficient Alternating Minimization-based Algorithm For Robust Phase Retrievalcited by 1
- 2026Tractable Gaussian Phase Retrieval with Heavy Tails and Adversarial Corruption with Near-Linear Sample Complexitycited by 1
- 2026Finite-Sample Performance of Gradient Descent in Logistic Regression with Gaussian Designcited by 1
- 2022Improving Computational Complexity in Statistical Models with Second-Order Informationcited by 0
- 2022Low-Rank Phase Retrieval with Structured Tensor Modelscited by 0
- 2022A note on Linear Bottleneck networks and their Transition to Multilinearitycited by 0
- 2024Low Complexity Regularized Phase Retrievalcited by 0
- 2024Global convergence of gradient descent for phase retrievalcited by 0
- 2024A Learned Proximal Alternating Minimization Algorithm and Its Induced Network for a Class of Two-block Nonconvex and Nonsmooth Optimizationcited by 0
- 2024Stability properties of gradient flow dynamics for the symmetric low-rank matrix factorization problemcited by 0
- 2025AltGDmin: Alternating GD and Minimization for Partly-Decoupled (Federated) Optimizationcited by 0
50 most cited of 58 All 58 (JSON)
- 2026Finite-Sample Performance of Gradient Descent in Logistic Regression with Gaussian Design19 Jun 2026
- 2026Convex Basins in Single-Index Model Loss Landscapes: Applications to Robust Recovery under Strong Adversarial Corruption28 May 2026
- 2026Expectation Maximization (EM) Converges for General Agnostic Mixtures7 Apr 2026
- 2026Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks3 Apr 2026
- 2026Tractable Gaussian Phase Retrieval with Heavy Tails and Adversarial Corruption with Near-Linear Sample Complexity26 Jan 2026
- 2025Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks21 Oct 2025
- 2025Provable Non-Convex Euclidean Distance Matrix Completion: Geometry, Reconstruction, and Robustness31 Jul 2025
- 2025prNet: Data-Driven Phase Retrieval via Stochastic Refinement13 Jul 2025
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitions23 Jun 2025
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT view23 Jun 2025
- 2025Phase transition of descending phase retrieval algorithms23 Jun 2025
- 2025AltGDmin: Alternating GD and Minimization for Partly-Decoupled (Federated) Optimization20 Apr 2025
38 more
- 2025Optimal sparse phase retrieval via a quasi-Bayesian approach13 Apr 2025
- 2025DDRM-PR: Fourier Phase Retrieval using Denoising Diffusion Restoration Models6 Jan 2025
- 2024Stability properties of gradient flow dynamics for the symmetric low-rank matrix factorization problem24 Nov 2024
- 2024A Learned Proximal Alternating Minimization Algorithm and Its Induced Network for a Class of Two-block Nonconvex and Nonsmooth Optimization10 Nov 2024
- 2024Global convergence of gradient descent for phase retrieval13 Oct 2024
- 2024A Sample Efficient Alternating Minimization-based Algorithm For Robust Phase Retrieval7 Sep 2024
- 2024Low Complexity Regularized Phase Retrieval23 Jul 2024
- 2024Agnostic Learning of Mixed Linear Regressions with EM and AM Algorithms3 Jun 2024
- 2024Stable Phase Retrieval with Mirror Descent17 May 2024
- 2024Asymptotic Dynamics of Alternating Minimization for Bilinear Regression7 Feb 2024
- 2023Global Convergence of Online Identification for Mixed Linear Regression30 Nov 2023
- 2023The Local Landscape of Phase Retrieval Under Limited Samples26 Nov 2023
- 2023Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passing28 Aug 2023
- 2023Near Optimal Heteroscedastic Regression with Symbiotic Learning25 Jun 2023
- 2023Attribute-Efficient PAC Learning of Low-Degree Polynomial Threshold Functions with Nasty Noise1 Jun 2023
- 2023Fast and Accurate Estimation of Low-Rank Matrices from Noisy Measurements via Preconditioned Non-Convex Gradient Descent26 May 2023
- 2023Poisson-Gaussian Holographic Phase Retrieval with Score-based Image Prior12 May 2023
- 2023Mixed Regression via Approximate Message Passing5 Apr 2023
- 2022Alternating Phase Langevin Sampling with Implicit Denoiser Priors for Phase Retrieval2 Nov 2022
- 2022Provable Phase Retrieval with Mirror Descent17 Oct 2022
- 2022Misspecified Phase Retrieval with Generative Priors11 Oct 2022
- 2022Hierarchical fuzzy neural networks with privacy preservation for heterogeneous big data18 Sep 2022
- 2022A note on Linear Bottleneck networks and their Transition to Multilinearity30 Jun 2022
- 2022On Learning Mixture of Linear Regressions in the Non-Realizable Setting26 May 2022
- 2022An Exponentially Increasing Step-size for Parameter Estimation in Statistical Models16 May 2022
- 2022Randomly Initialized Alternating Least Squares: Fast Convergence for Matrix Sensing25 Apr 2022
- 2022Randomized Policy Optimization for Optimal Stopping25 Mar 2022
- 2022Generative Principal Component Analysis18 Mar 2022
- 2022Low-Rank Phase Retrieval with Structured Tensor Models15 Feb 2022
- 2022Improving Computational Complexity in Statistical Models with Second-Order Information9 Feb 2022
- 2022Matrix Completion with Hierarchical Graph Side Information2 Jan 2022
- 2021Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passing8 Dec 2021
- 2021Towards Statistical and Computational Complexities of Polyak Step Size Gradient Descent15 Oct 2021
- 2021Sharp global convergence guarantees for iterative nonconvex optimization: A Gaussian process perspective20 Sep 2021
- 2021Nonconvex Factorization and Manifold Formulations are Almost Equivalent in Low-rank Matrix Optimization3 Aug 2021
- 2021Towards Sample-Optimal Compressive Phase Retrieval with Sparse and Generative Priors29 Jun 2021
- 2021Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction28 Jun 2021
- 2021Sample Efficient Linear Meta-Learning by Alternating Minimization18 May 2021
50 newest of 58 All 58 (JSON)
- 2023Mixed Regression via Approximate Message Passingcited by 3
- 2023Mixed Regression via Approximate Message Passing5 Apr 2023
- 2021Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstructioncited by 77
- 2021Hessian Eigenspectra of More Realistic Nonlinear Modelscited by 33
- 2021Sample Efficient Linear Meta-Learning by Alternating Minimizationcited by 25
- 2021Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passingcited by 18
- 2021Towards Sample-Optimal Compressive Phase Retrieval with Sparse and Generative Priorscited by 14
- 2022Generative Principal Component Analysiscited by 12
- 2022Randomly Initialized Alternating Least Squares: Fast Convergence for Matrix Sensingcited by 11
- 2021Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenescited by 10
- 2021Sharp global convergence guarantees for iterative nonconvex optimization: A Gaussian process perspectivecited by 10
- 2022On Learning Mixture of Linear Regressions in the Non-Realizable Settingcited by 10
- 2022Misspecified Phase Retrieval with Generative Priorscited by 7
- 2021Nearly Minimax-Optimal Rates for Noisy Sparse Phase Retrieval via Early-Stopped Mirror Descentcited by 5
12 most cited of 55 All 55 (JSON)
- 2026Finite-Sample Performance of Gradient Descent in Logistic Regression with Gaussian Design19 Jun 2026
- 2026Convex Basins in Single-Index Model Loss Landscapes: Applications to Robust Recovery under Strong Adversarial Corruption28 May 2026
- 2026Expectation Maximization (EM) Converges for General Agnostic Mixtures7 Apr 2026
- 2026Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks3 Apr 2026
- 2026Tractable Gaussian Phase Retrieval with Heavy Tails and Adversarial Corruption with Near-Linear Sample Complexity26 Jan 2026
- 2025Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks21 Oct 2025
- 2025Provable Non-Convex Euclidean Distance Matrix Completion: Geometry, Reconstruction, and Robustness31 Jul 2025
- 2025prNet: Data-Driven Phase Retrieval via Stochastic Refinement13 Jul 2025
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitions23 Jun 2025
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT view23 Jun 2025
- 2025Phase transition of descending phase retrieval algorithms23 Jun 2025
- 2025AltGDmin: Alternating GD and Minimization for Partly-Decoupled (Federated) Optimization20 Apr 2025
12 newest of 55 All 55 (JSON)