mlsanityData to 7 Oct 2026

Fundamental Limits of Weak Recovery with Applications to Phase Retrieval

arXiv 1708.05932 ↗First posted 20 Aug 2017stat.ML cs.IT math.ITcited by 39

Not on the map. Why?

Abstract (arXiv)

In phase retrieval we want to recover an unknown signal boldsymbol x∈mathbb Cd from n quadratic measurements of the form yi = |langleboldsymbol ai,boldsymbol xrangle|2+wi where boldsymbol ai∈ mathbb Cd are known sensing vectors and wi is measurement noise. We ask the following weak recovery question: what is the minimum number of measurements n needed to produce an estimator hatboldsymbol x(boldsymbol y) that is positively correlated with the signal boldsymbol x? We consider the case of Gaussian vectors boldsymbol ai. We prove that - in the high-dimensional limit - a sharp phase transition takes place, and we locate the threshold in the regime of vanishingly small noise. For n≤ d-o(d) no estimator can do significantly better than random and achieve a strictly positive correlation. For n≥ d+o(d) a simple spectral estimator achieves a positive correlation. Surprisingly, numerical simulations with the same spectral estimator demonstrate promising performance with realistic sensing matrices. Spectral methods are used to initialize non-convex optimization algorithms in phase retrieval, and our approach can boost the performance in this setting as well. Our impossibility result is based on classical information-theory arguments. The spectral algorithm computes the leading eigenvector of a weighted empirical covariance matrix. We obtain a sharp characterization of the spectral properties of this random matrix using tools from free probability and generalizing a recent result by Lu and Li. Both the upper and lower bound generalize beyond phase retrieval to measurements yi produced according to a generalized linear model. As a byproduct of our analysis, we compare the threshold of the proposed spectral method with that of a message passing algorithm.

Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Aug 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 4; 2023: 3; 2024: 9; 2025: 11; 2026: 7.

39 papers.

Sort:

  1. 2024Neural network learns low-dimensional polynomials with SGD near the information-theoretic limitcited by 45
  2. 2024Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functionscited by 35
  3. 2021Hessian Eigenspectra of More Realistic Nonlinear Modelscited by 33
  4. 2024Pretrained transformer efficiently learns low-dimensional target functions in-contextcited by 29
  5. 2021Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problemcited by 23
  6. 2024Bayes-optimal learning of an extensive-width neural network from quadratically many samplescited by 23
  7. 2021Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passingcited by 18
  8. 2024Fundamental computational limits of weak learnability in high-dimensional multi-index modelscited by 17
  9. 2025Survey on Algorithms for multi-index modelscited by 15
  10. 2023Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGDcited by 14
  11. 2024Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamicscited by 14
  12. 2022Fundamental limits to learning closed-form mathematical models from datacited by 12
27 more
  1. 2025Asymptotics of Non-Convex Generalized Linear Models in High-Dimensions: A proof of the replica formulacited by 11
  2. 2025The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networkscited by 11
  3. 2022Bayesian Inversion for Nonlinear Imaging Models using Deep Generative Priorscited by 9
  4. 2023Optimal Algorithms for the Inhomogeneous Spiked Wigner Modelcited by 8
  5. 2022Misspecified Phase Retrieval with Generative Priorscited by 7
  6. 2024The Role of the Time-Dependent Hessian in High-Dimensional Optimizationcited by 7
  7. 2025Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recoverycited by 6
  8. 2025Optimal Spectral Transitions in High-Dimensional Multi-Index Modelscited by 6
  9. 2026Optimal scaling laws in learning hierarchical multi-index modelscited by 6
  10. 2023Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passingcited by 5
  11. 2021Householder Dice: A Matrix-Free Algorithm for Simulating Dynamics on Gaussian and Random Orthogonal Ensemblescited by 4
  12. 2024Spectral Phase Transition and Optimal PCA in Block-Structured Spiked modelscited by 4
  13. 2022Compressing Sign Information in DCT-based Image Coding via Deep Sign Retrievalcited by 2
  14. 2024Fast and Robust Phase Retrieval via Deep Expectation-Consistent Approximationcited by 2
  15. 2025Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networkscited by 2
  16. 2026Deep Learning of Compositional Targets with Hierarchical Spectral Methodscited by 2
  17. 2025Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Modelscited by 1
  18. 2026A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Modelscited by 1
  19. 2026Kernel Renormalization in Bayesian Deep Neural Networks: the Equivalent Wishart Ansatz in the Proportional Regimecited by 1
  20. 2021Towards Designing Optimal Sensing Matrices for Generalized Linear Inverse Problemscited by 0
  21. 2025Phase transition of descending phase retrieval algorithmscited by 0
  22. 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT viewcited by 0
  23. 2025Phase retrieval with rank d measurements -- descending algorithms phase transitionscited by 0
  24. 2025Breaking the Weak Recovery Limit in Random Phase Retrieval with Learned Regularizerscited by 0
  25. 2026Progressive Power Homotopy for Non-convex Optimizationcited by 0
  26. 2026Improved high-dimensional estimation with Langevin dynamics and stochastic weight averagingcited by 0
  27. 2026Convex Basins in Single-Index Model Loss Landscapes: Applications to Robust Recovery under Strong Adversarial Corruptioncited by 0