mlsanityData to 13 Oct 2026

Phase Retrieval using Expectation Consistent Signal Recovery Algorithm based on Hypernetwork

arXiv 2101.04348 ↗First posted 12 Jan 2021cs.LG cs.IT math.ITcited by 3

Not on the map. Why?

Abstract (arXiv)

Phase retrieval (PR) is an important component in modern computational imaging systems. Many algorithms have been developed over the past half-century. Recent advances in deep learning have introduced new possibilities for a robust and fast PR. An emerging technique called deep unfolding provides a systematic connection between conventional model-based iterative algorithms and modern data-based deep learning. Unfolded algorithms, which are powered by data learning, have shown remarkable performance and convergence speed improvement over original algorithms. Despite their potential, most existing unfolded algorithms are strictly confined to a fixed number of iterations when layer-dependent parameters are used. In this study, we develop a novel framework for deep unfolding to overcome existing limitations. Our development is based on an unfolded generalized expectation consistent signal recovery (GEC-SR) algorithm, wherein damping factors are left for data-driven learning. In particular, we introduce a hypernetwork to generate the damping factors for GEC-SR. Instead of learning a set of optimal damping factors directly, the hypernetwork learns how to generate the optimal damping factors according to the clinical settings, thereby ensuring its adaptivity to different scenarios. To enable the hypernetwork to adapt to varying layer numbers, we use a recurrent architecture to develop a dynamic hypernetwork that generates a damping factor that can vary online across layers. We also exploit a self-attention mechanism to enhance the robustness of the hypernetwork. Extensive experiments show that the proposed algorithm outperforms existing ones in terms of convergence speed and accuracy and still works well under very harsh settings, even under which many classical PR algorithms are unstable.

Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 30 of its 71 references that are in the map. First posted on arXiv 12 Jan 2021.

Builds on

30 of 71 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,106
  2. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,352
  3. 2016HyperNetworkscited by 1,010
  4. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 469
  5. 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 416
  6. 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 386
  7. 2017Learned Primal-dual Reconstructioncited by 251
  8. 2019Plug-and-Play Methods Provably Converge with Properly Trained Denoiserscited by 197
  9. 2015Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restorationcited by 195
  10. 2013Expectation Propagation for approximate Bayesian inferencecited by 174
  11. 2014Phase Retrieval via Wirtinger Flow: Theory and Algorithmscited by 125
  12. 2018Theoretical Linear Convergence of Unfolded ISTA and its Practical Weights and Thresholdscited by 84
18 more
  1. 2018Phase Retrieval Under a Generative Priorcited by 73
  2. 2017Learned D-AMP: Principled Neural Network based Compressive Image Recoverycited by 65
  3. 2013Phase Retrieval using Alternating Minimizationcited by 58
  4. 2017Phase recovery and holographic image reconstruction using deep learning in neural networkscited by 54
  5. 2018Model-Driven Deep Learning for Physical Layer Communicationscited by 51
  6. 2019Deep Unfolding for Communications Systems: A Survey and Some New Directionscited by 49
  7. 2018prDeep: Robust Phase Retrieval with a Flexible Deep Networkcited by 46
  8. 2018Neural Proximal Gradient Descent for Compressive Imagingcited by 46
  9. 2017Unrolled Optimization with Deep Priorscited by 40
  10. 2020Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problemscited by 38
  11. 2016Solving Systems of Random Quadratic Equations via Truncated Amplitude Flowcited by 29
  12. 2017Deep MIMO Detectioncited by 26
  13. 2016PhaseMax: Convex Phase Retrieval via Basis Pursuitcited by 25
  14. 2020Deep HyperNetwork-Based MIMO Detectioncited by 10
  15. 2020Inverse Problems, Deep Learning, and Symmetry Breakingcited by 8
  16. 2020Solving Phase Retrieval with a Learned Referencecited by 8
  17. 2016Expectation Consistent Approximate Inference: Generalizations and Convergencecited by 6
  18. 2020UPR: A Model-Driven Architecture for Deep Phase Retrievalcited by 5

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 0; 2024: 1.

3 papers.