Regularization-Agnostic Compressed Sensing MRI Reconstruction with Hypernetworks
Not on the map. Why?
Abstract (arXiv)
Reconstructing under-sampled k-space measurements in Compressed Sensing MRI (CS-MRI) is classically solved with regularized least-squares. Recently, deep learning has been used to amortize this optimization by training reconstruction networks on a dataset of under-sampled measurements. Here, a crucial design choice is the regularization function(s) and corresponding weight(s). In this paper, we explore a novel strategy of using a hypernetwork to generate the parameters of a separate reconstruction network as a function of the regularization weight(s), resulting in a regularization-agnostic reconstruction model. At test time, for a given under-sampled image, our model can rapidly compute reconstructions with different amounts of regularization. We analyze the variability of these reconstructions, especially in situations when the overall quality is similar. Finally, we propose and empirically demonstrate an efficient and data-driven way of maximizing reconstruction performance given limited hypernetwork capacity. Our code is publicly available at https://github.com/alanqrwang/RegAgnosticCSMRI.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 6 Jan 2021.
Builds on
17 of 33 references.
References · 17
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2017SMASH: One-Shot Model Architecture Search through HyperNetworkscited by 200
- 2018Inference Suboptimality in Variational Autoencoderscited by 131
- 2018Graph HyperNetworks for Neural Architecture Searchcited by 131
- 2018Iterative Amortized Inferencecited by 93
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
- 2018Stochastic Hyperparameter Optimization through Hypernetworkscited by 72
- 2019Hypernetwork functional image representationcited by 65
- 2017Bayesian Hypernetworkscited by 64
- 2019Image Reconstruction: From Sparsity to Data-adaptive Methods and Machine Learningcited by 60
- 2019Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentationcited by 40
5 more
- 2018Amortized Inference Regularizationcited by 30
- 2020Neural Network-based Reconstruction in Compressed Sensing MRI Without Fully-sampled Training Datacited by 14
- 2018HyperST-Net: Hypernetworks for Spatio-Temporal Forecastingcited by 11
- 2017Optimization Methods for Inverse Problemscited by 6
- 2017Meta Networks for Neural Style Transfercited by 5
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 6.
9 papers.
- 2023Magnitude Invariant Parametrizations Improve Hypernetwork Learningcited by 14
- 2021A review and experimental evaluation of deep learning methods for MRI reconstructioncited by 13
- 2021Hyper-Convolution Networks for Biomedical Image Segmentationcited by 10
- 2023Combiner and HyperCombiner Networks: Rules to Combine Multimodality MR Images for Prostate Cancer Localisationcited by 10
- 2023HyperLips: Hyper Control Lips with High Resolution Decoder for Talking Face Generationcited by 6
- 2023Generalizing Supervised Deep Learning MRI Reconstruction to Multiple and Unseen Contrasts using Meta-Learning Hypernetworkscited by 2
- 2023HyperCoil-Recon: A Hypernetwork-based Adaptive Coil Configuration Task Switching Network for MRI Reconstructioncited by 2
- 2022Hyper-Convolutions via Implicit Kernels for Medical Imagingcited by 1
- 2023RBF Weighted Hyper-Involution for RGB-D Object Detectioncited by 0
- 2023HyperLips: Hyper Control Lips with High Resolution Decoder for Talking Face Generation9 Oct 2023
- 2023RBF Weighted Hyper-Involution for RGB-D Object Detection30 Sep 2023
- 2023HyperCoil-Recon: A Hypernetwork-based Adaptive Coil Configuration Task Switching Network for MRI Reconstruction9 Aug 2023
- 2023Combiner and HyperCombiner Networks: Rules to Combine Multimodality MR Images for Prostate Cancer Localisation17 Jul 2023
- 2023Generalizing Supervised Deep Learning MRI Reconstruction to Multiple and Unseen Contrasts using Meta-Learning Hypernetworks13 Jul 2023
- 2023Magnitude Invariant Parametrizations Improve Hypernetwork Learning15 Apr 2023
- 2022Hyper-Convolutions via Implicit Kernels for Medical Imaging6 Feb 2022
- 2021A review and experimental evaluation of deep learning methods for MRI reconstruction17 Sep 2021
- 2021Hyper-Convolution Networks for Biomedical Image Segmentation21 May 2021