Stochastic Primal-Dual Deep Unrolling
Not on the map. Why?
Abstract (arXiv)
We propose a new type of efficient deep-unrolling networks for solving imaging inverse problems. Conventional deep-unrolling methods require full forward operator and its adjoint across each layer, and hence can be significantly more expensive computationally as compared with other end-to-end methods that are based on post-processing of model-based reconstructions, especially for 3D image reconstruction tasks. We develop a stochastic (ordered-subsets) variant of the classical learned primal-dual (LPD), which is a state-of-the-art unrolling network for tomographic image reconstruction. The proposed learned stochastic primal-dual (LSPD) network only uses subsets of the forward and adjoint operators and offers considerable computational efficiency. We provide theoretical analysis of a special case of our LSPD framework, suggesting that it has the potential to achieve image reconstruction quality competitive with the full-batch LPD while requiring only a fraction of the computation. The numerical results for two different X-ray computed tomography (CT) imaging tasks (namely, low-dose and sparse-view CT) corroborate this theoretical finding, demonstrating the promise of LSPD networks for large-scale imaging problems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 26 of its 56 references that are in the map. First posted on arXiv 19 Oct 2021.
Builds on
26 of 56 references.
References · 26
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2016Learning to learn by gradient descent by gradient descentcited by 616
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2014SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectivescited by 401
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2017Learned Primal-dual Reconstructioncited by 251
- 2019SGD: General Analysis and Improved Ratescited by 206
- 2016Katyusha: The First Direct Acceleration of Stochastic Gradient Methodscited by 134
- 2018Regularization by Denoising: Clarifications and New Interpretationscited by 102
- 2021Equivariant Imaging: Learning Beyond the Range Spacecited by 83
- 2014A Proximal Stochastic Gradient Method with Progressive Variance Reductioncited by 78
14 more
- 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
- 2017One Network to Solve Them All --- Solving Linear Inverse Problems using Deep Projection Modelscited by 67
- 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
- 2020Learned convex regularizers for inverse problemscited by 54
- 2016Tight Complexity Bounds for Optimizing Composite Objectivescited by 47
- 2015An optimal randomized incremental gradient methodcited by 32
- 2021End-to-end reconstruction meets data-driven regularization for inverse problemscited by 32
- 2017Stochastic Primal-Dual Hybrid Gradient Algorithm with Arbitrary Sampling and Imaging Applicationscited by 29
- 2021Equivariant neural networks for inverse problemscited by 29
- 2018Task adapted reconstruction for inverse problemscited by 16
- 2020A Fast Stochastic Plug-and-Play ADMM for Imaging Inverse Problemscited by 12
- 2019The Practicality of Stochastic Optimization in Imaging Inverse Problemscited by 9
- 2015Sharp Time--Data Tradeoffs for Linear Inverse Problemscited by 8
- 2018Rest-Katyusha: Exploiting the Solution's Structure via Scheduled Restart Schemescited by 3
Built on by
Citing papers per year: 2022: 3; 2023: 0; 2024: 1.
4 papers.
- 2022Learned reconstruction methods with convergence guaranteescited by 46
- 2022Equivariance Regularization for Image Reconstructioncited by 1
- 2022Operator Sketching for Deep Unrolling Networkscited by 0
- 2024Sparse View Tomographic Reconstruction of Elongated Objects using Learned Primal-Dual Networkscited by 0
- 2024Sparse View Tomographic Reconstruction of Elongated Objects using Learned Primal-Dual Networks5 Mar 2024
- 2022Learned reconstruction methods with convergence guarantees11 Jun 2022
- 2022Operator Sketching for Deep Unrolling Networks21 Mar 2022
- 2022Equivariance Regularization for Image Reconstruction10 Feb 2022