Fundamental Limits of Weak Recovery with Applications to Phase Retrieval
Not on the map. Why?
Abstract (arXiv)
In phase retrieval we want to recover an unknown signal boldsymbol x∈mathbb Cd from n quadratic measurements of the form yi = |langleboldsymbol ai,boldsymbol xrangle|2+wi where boldsymbol ai∈ mathbb Cd are known sensing vectors and wi is measurement noise. We ask the following weak recovery question: what is the minimum number of measurements n needed to produce an estimator hatboldsymbol x(boldsymbol y) that is positively correlated with the signal boldsymbol x? We consider the case of Gaussian vectors boldsymbol ai. We prove that - in the high-dimensional limit - a sharp phase transition takes place, and we locate the threshold in the regime of vanishingly small noise. For n≤ d-o(d) no estimator can do significantly better than random and achieve a strictly positive correlation. For n≥ d+o(d) a simple spectral estimator achieves a positive correlation. Surprisingly, numerical simulations with the same spectral estimator demonstrate promising performance with realistic sensing matrices. Spectral methods are used to initialize non-convex optimization algorithms in phase retrieval, and our approach can boost the performance in this setting as well. Our impossibility result is based on classical information-theory arguments. The spectral algorithm computes the leading eigenvector of a weighted empirical covariance matrix. We obtain a sharp characterization of the spectral properties of this random matrix using tools from free probability and generalizing a recent result by Lu and Li. Both the upper and lower bound generalize beyond phase retrieval to measurements yi produced according to a generalized linear model. As a byproduct of our analysis, we compare the threshold of the proposed spectral method with that of a message passing algorithm.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 3; 2024: 9; 2025: 11; 2026: 7.
39 papers.
Sort:
- 2024Neural network learns low-dimensional polynomials with SGD near the information-theoretic limitcited by 45
- 2024Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functionscited by 35
- 2021Hessian Eigenspectra of More Realistic Nonlinear Modelscited by 33
- 2024Pretrained transformer efficiently learns low-dimensional target functions in-contextcited by 29
- 2021Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problemcited by 23
- 2024Bayes-optimal learning of an extensive-width neural network from quadratically many samplescited by 23
- 2021Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passingcited by 18
- 2024Fundamental computational limits of weak learnability in high-dimensional multi-index modelscited by 17
- 2025Survey on Algorithms for multi-index modelscited by 15
- 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGDcited by 14
- 2024Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamicscited by 14
- 2022Fundamental limits to learning closed-form mathematical models from datacited by 12
27 more
- 2025Asymptotics of Non-Convex Generalized Linear Models in High-Dimensions: A proof of the replica formulacited by 11
- 2025The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networkscited by 11
- 2022Bayesian Inversion for Nonlinear Imaging Models using Deep Generative Priorscited by 9
- 2023Optimal Algorithms for the Inhomogeneous Spiked Wigner Modelcited by 8
- 2022Misspecified Phase Retrieval with Generative Priorscited by 7
- 2024The Role of the Time-Dependent Hessian in High-Dimensional Optimizationcited by 7
- 2025Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recoverycited by 6
- 2025Optimal Spectral Transitions in High-Dimensional Multi-Index Modelscited by 6
- 2026Optimal scaling laws in learning hierarchical multi-index modelscited by 6
- 2023Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passingcited by 5
- 2021Householder Dice: A Matrix-Free Algorithm for Simulating Dynamics on Gaussian and Random Orthogonal Ensemblescited by 4
- 2024Spectral Phase Transition and Optimal PCA in Block-Structured Spiked modelscited by 4
- 2022Compressing Sign Information in DCT-based Image Coding via Deep Sign Retrievalcited by 2
- 2024Fast and Robust Phase Retrieval via Deep Expectation-Consistent Approximationcited by 2
- 2025Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networkscited by 2
- 2026Deep Learning of Compositional Targets with Hierarchical Spectral Methodscited by 2
- 2025Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Modelscited by 1
- 2026A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Modelscited by 1
- 2026Kernel Renormalization in Bayesian Deep Neural Networks: the Equivalent Wishart Ansatz in the Proportional Regimecited by 1
- 2021Towards Designing Optimal Sensing Matrices for Generalized Linear Inverse Problemscited by 0
- 2025Phase transition of descending phase retrieval algorithmscited by 0
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT viewcited by 0
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitionscited by 0
- 2025Breaking the Weak Recovery Limit in Random Phase Retrieval with Learned Regularizerscited by 0
- 2026Progressive Power Homotopy for Non-convex Optimizationcited by 0
- 2026Improved high-dimensional estimation with Langevin dynamics and stochastic weight averagingcited by 0
- 2026Convex Basins in Single-Index Model Loss Landscapes: Applications to Robust Recovery under Strong Adversarial Corruptioncited by 0
- 2026Kernel Renormalization in Bayesian Deep Neural Networks: the Equivalent Wishart Ansatz in the Proportional Regime28 May 2026
- 2026Convex Basins in Single-Index Model Loss Landscapes: Applications to Robust Recovery under Strong Adversarial Corruption28 May 2026
- 2026A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Models18 Mar 2026
- 2026Improved high-dimensional estimation with Langevin dynamics and stochastic weight averaging6 Mar 2026
- 2026Deep Learning of Compositional Targets with Hierarchical Spectral Methods11 Feb 2026
- 2026Optimal scaling laws in learning hierarchical multi-index models5 Feb 2026
- 2026Progressive Power Homotopy for Non-convex Optimization22 Jan 2026
- 2025Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Models22 Dec 2025
- 2025Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks21 Oct 2025
- 2025Breaking the Weak Recovery Limit in Random Phase Retrieval with Learned Regularizers18 Sep 2025
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitions23 Jun 2025
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT view23 Jun 2025
27 more
- 2025Phase transition of descending phase retrieval algorithms23 Jun 2025
- 2025The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks23 May 2025
- 2025Survey on Algorithms for multi-index models7 Apr 2025
- 2025Asymptotics of Non-Convex Generalized Linear Models in High-Dimensions: A proof of the replica formula27 Feb 2025
- 2025Optimal Spectral Transitions in High-Dimensional Multi-Index Models4 Feb 2025
- 2025Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recovery3 Feb 2025
- 2024Pretrained transformer efficiently learns low-dimensional target functions in-context4 Nov 2024
- 2024Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamics14 Aug 2024
- 2024Bayes-optimal learning of an extensive-width neural network from quadratically many samples7 Aug 2024
- 2024Fast and Robust Phase Retrieval via Deep Expectation-Consistent Approximation12 Jul 2024
- 2024Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit3 Jun 2024
- 2024Fundamental computational limits of weak learnability in high-dimensional multi-index models24 May 2024
- 2024Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functions24 May 2024
- 2024Spectral Phase Transition and Optimal PCA in Block-Structured Spiked models6 Mar 2024
- 2024The Role of the Time-Dependent Hessian in High-Dimensional Optimization4 Mar 2024
- 2023Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passing28 Aug 2023
- 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD29 May 2023
- 2023Optimal Algorithms for the Inhomogeneous Spiked Wigner Model13 Feb 2023
- 2022Misspecified Phase Retrieval with Generative Priors11 Oct 2022
- 2022Compressing Sign Information in DCT-based Image Coding via Deep Sign Retrieval21 Sep 2022
- 2022Fundamental limits to learning closed-form mathematical models from data6 Apr 2022
- 2022Bayesian Inversion for Nonlinear Imaging Models using Deep Generative Priors18 Mar 2022
- 2021Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passing8 Dec 2021
- 2021Towards Designing Optimal Sensing Matrices for Generalized Linear Inverse Problems5 Nov 2021
- 2021Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problem8 Mar 2021
- 2021Hessian Eigenspectra of More Realistic Nonlinear Models2 Mar 2021
- 2021Householder Dice: A Matrix-Free Algorithm for Simulating Dynamics on Gaussian and Random Orthogonal Ensembles19 Jan 2021
- 2024Neural network learns low-dimensional polynomials with SGD near the information-theoretic limitcited by 45
- 2024Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functionscited by 35
- 2021Hessian Eigenspectra of More Realistic Nonlinear Modelscited by 33
- 2024Pretrained transformer efficiently learns low-dimensional target functions in-contextcited by 29
- 2021Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problemcited by 23
- 2024Bayes-optimal learning of an extensive-width neural network from quadratically many samplescited by 23
- 2021Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passingcited by 18
- 2024Fundamental computational limits of weak learnability in high-dimensional multi-index modelscited by 17
- 2025Survey on Algorithms for multi-index modelscited by 15
- 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGDcited by 14
- 2024Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamicscited by 14
- 2022Fundamental limits to learning closed-form mathematical models from datacited by 12
12 most cited of 39 All 39 (JSON)
- 2026Kernel Renormalization in Bayesian Deep Neural Networks: the Equivalent Wishart Ansatz in the Proportional Regime28 May 2026
- 2026Convex Basins in Single-Index Model Loss Landscapes: Applications to Robust Recovery under Strong Adversarial Corruption28 May 2026
- 2026A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Models18 Mar 2026
- 2026Improved high-dimensional estimation with Langevin dynamics and stochastic weight averaging6 Mar 2026
- 2026Deep Learning of Compositional Targets with Hierarchical Spectral Methods11 Feb 2026
- 2026Optimal scaling laws in learning hierarchical multi-index models5 Feb 2026
- 2026Progressive Power Homotopy for Non-convex Optimization22 Jan 2026
- 2025Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Models22 Dec 2025
- 2025Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks21 Oct 2025
- 2025Breaking the Weak Recovery Limit in Random Phase Retrieval with Learned Regularizers18 Sep 2025
- 2025Phase retrieval with rank d measurements -- descending algorithms phase transitions23 Jun 2025
- 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT view23 Jun 2025
12 newest of 39 All 39 (JSON)