Equilibrated Zeroth-Order Unrolled Deep Networks for Accelerated MRI
Not on the map. Why?
Abstract (arXiv)
Recently, model-driven deep learning unrolls a certain iterative algorithm of a regularization model into a cascade network by replacing the first-order information (i.e., (sub)gradient or proximal operator) of the regularizer with a network module, which appears more explainable and predictable compared to common data-driven networks. Conversely, in theory, there is not necessarily such a functional regularizer whose first-order information matches the replaced network module, which means the network output may not be covered by the original regularization model. Moreover, up to now, there is also no theory to guarantee the global convergence and robustness (regularity) of unrolled networks under realistic assumptions. To bridge this gap, this paper propose to present a safeguarded methodology on network unrolling. Specifically, focusing on accelerated MRI, we unroll a zeroth-order algorithm, of which the network module represents the regularizer itself, so that the network output can be still covered by the regularization model. Furthermore, inspired by the ideal of deep equilibrium models, before backpropagating, we carry out the unrolled iterative network to converge to a fixed point to ensure the convergence. In case the measurement data contains noise, we prove that the proposed network is robust against noisy interference. Finally, numerical experiments show that the proposed network consistently outperforms the state-of-the-art MRI reconstruction methods including traditional regularization methods and other deep learning methods.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 23 of its 50 references that are in the map. First posted on arXiv 18 Dec 2021.
Builds on
23 of 50 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018A Convergence Theory for Deep Learning via Over-Parameterizationcited by 787
- 2019Deep Equilibrium Modelscited by 615
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 387
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 342
- 2017Learned Primal-dual Reconstructioncited by 251
- 2017Image reconstruction by domain transform manifold learningcited by 232
- 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 212
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 208
- 2020Multiscale Deep Equilibrium Modelscited by 151
11 more
- 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 127
- 2020Monotone operator equilibrium networkscited by 100
- 2019A Bayesian Perspective on the Deep Image Priorcited by 52
- 2019Momentum-Net: Fast and convergent iterative neural network for inverse problemscited by 38
- 2020Deep Low-rank plus Sparse Network for Dynamic MR Imagingcited by 32
- 2019Deep Generalization of Structured Low-Rank Algorithms (Deep-SLR)cited by 30
- 2019LORAKI: Autocalibrated Recurrent Neural Networks for Autoregressive MRI Reconstruction in k-Spacecited by 28
- 2020Uncertainty Estimation in Medical Image Denoising with Bayesian Deep Image Priorcited by 18
- 2021Feasibility-based Fixed Point Networkscited by 17
- 2018On the Convergence of Learning-based Iterative Methods for Nonconvex Inverse Problemscited by 11
- 2021Deep Manifold Learning for Dynamic MR Imagingcited by 8
Built on by
Citing papers per year: 2022: 4; 2023: 0; 2024: 1.
5 papers.
- 2022High-Frequency Space Diffusion Models for Accelerated MRIcited by 42
- 2022Self-Score: Self-Supervised Learning on Score-Based Models for MRI Reconstructioncited by 23
- 2022NESTANets: Stable, accurate and efficient neural networks for analysis-sparse inverse problemscited by 5
- 2022Deep unfolding as iterative regularization for imaging inverse problemscited by 5
- 2024Self-Consistent Nested Diffusion Bridge for Accelerated MRI Reconstructioncited by 1
- 2024Self-Consistent Nested Diffusion Bridge for Accelerated MRI Reconstruction13 Dec 2024
- 2022Deep unfolding as iterative regularization for imaging inverse problems24 Nov 2022
- 2022Self-Score: Self-Supervised Learning on Score-Based Models for MRI Reconstruction2 Sep 2022
- 2022High-Frequency Space Diffusion Models for Accelerated MRI10 Aug 2022
- 2022NESTANets: Stable, accurate and efficient neural networks for analysis-sparse inverse problems2 Mar 2022