A Geometric Analysis of Phase Retrieval
Not on the map. Why?
Abstract (arXiv)
Can we recover a complex signal from its Fourier magnitudes? More generally, given a set of m measurements, yk = |mathbf ak^* mathbf x| for k = 1, dots, m, is it possible to recover mathbf x ∈ mathbbCn (i.e., length-n complex vector)? This **generalized phase retrieval** (GPR) problem is a fundamental task in various disciplines, and has been the subject of much recent investigation. Natural nonconvex heuristics often work remarkably well for GPR in practice, but lack clear theoretical explanations. In this paper, we take a step towards bridging this gap. We prove that when the measurement vectors mathbf ak's are generic (i.i.d. complex Gaussian) and the number of measurements is large enough (m ≥ C n log3 n), with high probability, a natural least-squares formulation for GPR has the following benign geometric structure: (1) there are no spurious local minimizers, and all global minimizers are equal to the target signal mathbf x, up to a global phase; and (2) the objective function has a negative curvature around each saddle point. This structure allows a number of iterative optimization methods to efficiently find a global minimizer, without special initialization. To corroborate the claim, we describe and analyze a second-order trust-region algorithm.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 25; 2022: 20; 2023: 14; 2024: 12; 2025: 14; 2026: 6.
92 papers.
Sort:
By area:
- 2021A Geometric Analysis of Neural Collapse with Unconstrained Featurescited by 226
- 2022On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Featurescited by 97
- 2022Learning Single-Index Models with Shallow Neural Networkscited by 92
- 2021An Unconstrained Layer-Peeled Perspective on Neural Collapsecited by 87
- 2021Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstructioncited by 77
- 2023Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Modelscited by 60
- 2021Large Learning Rate Tames Homogeneity: Convergence and Balancing Effectcited by 48
- 2021Near-Optimal Linear Regression under Distribution Shiftcited by 40
- 2022Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimizationcited by 40
- 2022Faster Rates of Convergence to Stationary Points in Differentially Private Optimizationcited by 32
- 2024Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptationcited by 26
- 2021The loss landscape of deep linear neural networks: a second-order analysiscited by 24
38 more
- 2022Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certificationcited by 21
- 2019On the Global Convergence of Imitation Learning: A Case for Linear Quadratic Regulatorcited by 20
- 2021Local convexity of the TAP free energy and AMP convergence for Z2-synchronizationcited by 15
- 2021Towards Sample-Optimal Compressive Phase Retrieval with Sparse and Generative Priorscited by 14
- 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGDcited by 14
- 2022Learning a Single Neuron for Non-monotonic Activation Functionscited by 13
- 2024A Global Geometric Analysis of Maximal Coding Rate Reductioncited by 13
- 2021Bandit Phase Retrievalcited by 12
- 2021Finding Second-Order Stationary Points in Nonconvex-Strongly-Concave Minimax Optimizationcited by 12
- 2021Tractability from overparametrization: The example of the negative perceptroncited by 12
- 2025Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorizationcited by 12
- 2021Active manifolds, stratifications, and convergence to local minima in nonsmooth optimizationcited by 11
- 2021Escape saddle points by a simple gradient-descent based algorithmcited by 11
- 2022Randomly Initialized Alternating Least Squares: Fast Convergence for Matrix Sensingcited by 11
- 2021Sharp global convergence guarantees for iterative nonconvex optimization: A Gaussian process perspectivecited by 10
- 2024How to Make the Gradients Small Privately: Improved Rates for Differentially Private Non-Convex Optimizationcited by 10
- 2021Escaping Saddle Points Faster with Stochastic Momentumcited by 8
- 2023Catapult Dynamics and Phase Transitions in Quadratic Netscited by 8
- 2021Escaping strict saddle points of the Moreau envelope in nonsmooth optimizationcited by 7
- 2021A first-order primal-dual method with adaptivity to local smoothnesscited by 7
- 2022Misspecified Phase Retrieval with Generative Priorscited by 7
- 2023Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learningcited by 7
- 2024The Role of the Time-Dependent Hessian in High-Dimensional Optimizationcited by 7
- 2022Accelerating SGD for Highly Ill-Conditioned Huge-Scale Online Matrix Completioncited by 6
- 2022Zeroth-Order Negative Curvature Finding: Escaping Saddle Points without Gradientscited by 6
- 2023Provably Accelerating Ill-Conditioned Low-rank Estimation via Scaled Gradient Descent, Even with Overparameterizationcited by 6
- 2025Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Modelscited by 6
- 2021Nearly Minimax-Optimal Rates for Noisy Sparse Phase Retrieval via Early-Stopped Mirror Descentcited by 5
- 2022Gradient descent provably escapes saddle points in the training of shallow ReLU networkscited by 5
- 2023A Generalized Alternating Method for Bilevel Learning under the Polyak-Lojasiewicz Conditioncited by 5
- 2021Escaping Saddle Points for Nonsmooth Weakly Convex Functions via Perturbed Proximal Algorithmscited by 4
- 2023Faster Stochastic Algorithms for Minimax Optimization under Polyak--Lojasiewicz Conditionscited by 4
- 2024Sample and Computationally Efficient Robust Learning of Gaussian Single-Index Modelscited by 4
- 2021Escaping Saddle Points in Distributed Newton's Method with Communication Efficiency and Byzantine Resiliencecited by 3
- 2021Nonconvex Factorization and Manifold Formulations are Almost Equivalent in Low-rank Matrix Optimizationcited by 3
- 2021On Geometric Connections of Embedded and Quotient Geometries in Riemannian Fixed-rank Matrix Optimizationcited by 3
- 2022Sharper Utility Bounds for Differentially Private Modelscited by 3
- 2022Nonconvex Matrix Factorization is Geodesically Convex: Global Landscape Analysis for Fixed-rank Matrix Optimization From a Riemannian Perspectivecited by 3
50 most cited of 92 All 92 (JSON)
- 2026To Solve Bilevel Optimization with Nonconvex Lower Levels, We Need Second-Order Stationarity24 Sep 2026
- 2026Stochastic Saddle Avoidance Beyond Unit Excitation and Smoothness: A Pathwise Lyapunov-Perron Framework4 Aug 2026
- 2026When Both Layers Learn: Training Dynamics of Representing Linear Models via ReLU Networks3 Jun 2026
- 2026Soft-to-Hard Routing in Sparse Mixture-of-Experts Models4 May 2026
- 2026Tractable Gaussian Phase Retrieval with Heavy Tails and Adversarial Corruption with Near-Linear Sample Complexity26 Jan 2026
- 2026Progressive Power Homotopy for Non-convex Optimization22 Jan 2026
- 2025Balancing Multi-modal Sensor Learning via Multi-objective Optimization10 Nov 2025
- 2025Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks21 Oct 2025
- 2025Smooth Quasar-Convex Optimization with Constraints2 Oct 2025
- 2025Convergence Analysis of the ProbAbilistic Gradient Estimator Algorithm for Weakly Convex Finite-Sum Optimization31 Aug 2025
- 2025A Complete Loss Landscape Analysis of Regularized Deep Matrix Factorization25 Jun 2025
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitions23 Jun 2025
38 more
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT view23 Jun 2025
- 2025Phase transition of descending phase retrieval algorithms23 Jun 2025
- 2025Sharper Convergence Rates for Nonconvex Optimisation via Reduction Mappings10 Jun 2025
- 2025Second-Order Convergence in Private Stochastic Non-Convex Optimization21 May 2025
- 2025Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization13 Apr 2025
- 2025Optimal sparse phase retrieval via a quasi-Bayesian approach13 Apr 2025
- 2025Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models24 Feb 2025
- 2025Quaternionic Reweighted Amplitude Flow for Phase Retrieval in Image Reconstruction4 Jan 2025
- 2024Sample and Computationally Efficient Robust Learning of Gaussian Single-Index Models8 Nov 2024
- 2024Global convergence of gradient descent for phase retrieval13 Oct 2024
- 2024A Sample Efficient Alternating Minimization-based Algorithm For Robust Phase Retrieval7 Sep 2024
- 2024Smoothed Robust Phase Retrieval3 Sep 2024
- 2024Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation6 Jun 2024
- 2024A Global Geometric Analysis of Maximal Coding Rate Reduction4 Jun 2024
- 2024Stable Phase Retrieval with Mirror Descent17 May 2024
- 2024On the Uniform Convergence of Subdifferentials in Stochastic Optimization and Learning16 May 2024
- 2024Robust Second-Order Nonconvex Optimization and Its Application to Low Rank Matrix Sensing12 Mar 2024
- 2024The Role of the Time-Dependent Hessian in High-Dimensional Optimization4 Mar 2024
- 2024How to Make the Gradients Small Privately: Improved Rates for Differentially Private Non-Convex Optimization17 Feb 2024
- 2024Avoiding strict saddle points of nonconvex regularized problems17 Jan 2024
- 2023The Local Landscape of Phase Retrieval Under Limited Samples26 Nov 2023
- 2023Acceleration and Implicit Regularization in Gaussian Phase Retrieval21 Nov 2023
- 2023A randomized algorithm for nonconvex minimization with inexact evaluations and complexity guarantees28 Oct 2023
- 2023Provably Accelerating Ill-Conditioned Low-rank Estimation via Scaled Gradient Descent, Even with Overparameterization9 Oct 2023
- 2023Faster Stochastic Algorithms for Minimax Optimization under Polyak--Lojasiewicz Conditions29 Jul 2023
- 2023Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning26 Jun 2023
- 2023A Generalized Alternating Method for Bilevel Learning under the Polyak-Lojasiewicz Condition4 Jun 2023
- 2023Gradient descent in matrix factorization: Understanding large initialization30 May 2023
- 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD29 May 2023
- 2023Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models18 May 2023
- 2023Poisson-Gaussian Holographic Phase Retrieval with Score-based Image Prior12 May 2023
- 2023Can Decentralized Stochastic Minimax Optimization Algorithms Converge Linearly for Finite-Sum Nonconvex-Nonconcave Problems?24 Apr 2023
- 2023Can Learning Be Explained By Local Optimality In Robust Low-rank Matrix Recovery?21 Feb 2023
- 2023Catapult Dynamics and Phase Transitions in Quadratic Nets18 Jan 2023
- 2022A Riemannian ADMM3 Nov 2022
- 2022Learning Single-Index Models with Shallow Neural Networks27 Oct 2022
- 2022Provable Phase Retrieval with Mirror Descent17 Oct 2022
- 2022A Momentum Accelerated Adaptive Cubic Regularization Method for Nonconvex Optimization12 Oct 2022
50 newest of 92 All 92 (JSON)
- 2026Soft-to-Hard Routing in Sparse Mixture-of-Experts Modelscited by 1
- 2026Soft-to-Hard Routing in Sparse Mixture-of-Experts Models4 May 2026
- 2021A Geometric Analysis of Neural Collapse with Unconstrained Featurescited by 226
- 2022On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Featurescited by 97
- 2022Learning Single-Index Models with Shallow Neural Networkscited by 92
- 2021An Unconstrained Layer-Peeled Perspective on Neural Collapsecited by 87
- 2021Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstructioncited by 77
- 2023Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Modelscited by 60
- 2021Large Learning Rate Tames Homogeneity: Convergence and Balancing Effectcited by 48
- 2021Near-Optimal Linear Regression under Distribution Shiftcited by 40
- 2022Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimizationcited by 40
- 2022Faster Rates of Convergence to Stationary Points in Differentially Private Optimizationcited by 32
- 2024Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptationcited by 26
- 2021The loss landscape of deep linear neural networks: a second-order analysiscited by 24
12 most cited of 89 All 89 (JSON)
- 2026To Solve Bilevel Optimization with Nonconvex Lower Levels, We Need Second-Order Stationarity24 Sep 2026
- 2026Stochastic Saddle Avoidance Beyond Unit Excitation and Smoothness: A Pathwise Lyapunov-Perron Framework4 Aug 2026
- 2026When Both Layers Learn: Training Dynamics of Representing Linear Models via ReLU Networks3 Jun 2026
- 2026Tractable Gaussian Phase Retrieval with Heavy Tails and Adversarial Corruption with Near-Linear Sample Complexity26 Jan 2026
- 2026Progressive Power Homotopy for Non-convex Optimization22 Jan 2026
- 2025Balancing Multi-modal Sensor Learning via Multi-objective Optimization10 Nov 2025
- 2025Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks21 Oct 2025
- 2025Smooth Quasar-Convex Optimization with Constraints2 Oct 2025
- 2025Convergence Analysis of the ProbAbilistic Gradient Estimator Algorithm for Weakly Convex Finite-Sum Optimization31 Aug 2025
- 2025A Complete Loss Landscape Analysis of Regularized Deep Matrix Factorization25 Jun 2025
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitions23 Jun 2025
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT view23 Jun 2025
12 newest of 89 All 89 (JSON)