Learning Task-Specific Strategies for Accelerated MRI
Not on the map. Why?
Abstract (arXiv)
Compressed sensing magnetic resonance imaging (CS-MRI) seeks to recover visual information from subsampled measurements for diagnostic tasks. Traditional CS-MRI methods often separately address measurement subsampling, image reconstruction, and task prediction, resulting in a suboptimal end-to-end performance. In this work, we propose TACKLE as a unified co-design framework for jointly optimizing subsampling, reconstruction, and prediction strategies for the performance on downstream tasks. The na"ive approach of simply appending a task prediction module and training with a task-specific loss leads to suboptimal downstream performance. Instead, we develop a training procedure where a backbone architecture is first trained for a generic pre-training task (image reconstruction in our case), and then fine-tuned for different downstream tasks with a prediction head. Experimental results on multiple public MRI datasets show that TACKLE achieves an improved performance on various tasks over traditional CS-MRI methods. We also demonstrate that TACKLE is robust to distribution shifts by showing that it generalizes to a new dataset we experimentally collected using different acquisition setups from the training data. Without additional fine-tuning, TACKLE leads to both numerical and visual improvements compared to existing baselines. We have further implemented a learned 4×-accelerated sequence on a Siemens 3T MRI Skyra scanner. Compared to the fully-sampling scan that takes 335 seconds, our optimized sequence only takes 84 seconds, achieving a four-fold time reduction as desired, while maintaining high performance.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 39 of its 90 references that are in the map. First posted on arXiv 25 Apr 2023.
Builds on
39 of 90 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 464
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
27 more
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2017Learned Primal-dual Reconstructioncited by 251
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
- 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
- 2021Deep Equilibrium Architectures for Inverse Problems in Imagingcited by 126
- 2022Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imagingcited by 94
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
- 2019Plug and play methods for magnetic resonance imaging (long version)cited by 75
- 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
- 2019Reducing Uncertainty in Undersampled MRI Reconstruction with Active Acquisitioncited by 55
- 2018Deep Residual Learning for Accelerated MRI using Magnitude and Phase Networkscited by 53
- 2020Active MR k-space Sampling with Reinforcement Learningcited by 45
- 2022SKM-TEA: A Dataset for Accelerated MRI Reconstruction with Dense Image Labels for Quantitative Clinical Evaluationcited by 42
- 2019Learning-based Optimization of the Under-sampling Pattern in MRIcited by 32
- 2021B-spline Parameterized Joint Optimization of Reconstruction and K-space Trajectories (BJORK) for Accelerated 2D MRIcited by 29
- 2019PILOT: Physics-Informed Learned Optimized Trajectories for Accelerated MRIcited by 24
- 2020Extending LOUPE for K-space Under-sampling Pattern Optimization in Multi-coil MRIcited by 22
- 2018Joint CS-MRI Reconstruction and Segmentation with a Unified Deep Networkcited by 21
- 2021SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guaranteescited by 18
- 2022Learning Optimal K-space Acquisition and Reconstruction using Physics-Informed Neural Networkscited by 11
- 2018A Segmentation-aware Deep Fusion Network for Compressed Sensing MRIcited by 7
- 2021Alternating Learning Approach for Variational Networks and Undersampling Pattern in Parallel MRI Applicationscited by 6
- 2021One Network to Solve Them All: A Sequential Multi-Task Joint Learning Network Framework for MR Imaging Pipelinecited by 5
- 2021Hybrid learning of Non-Cartesian k-space trajectory and MR image reconstruction networkscited by 5
- 2022CoRRECT: A Deep Unfolding Framework for Motion-Corrected Quantitative R2* Mappingcited by 5
- 2022Stochastic Optimization of 3D Non-Cartesian Sampling Trajectory (SNOPY)cited by 3
- 2022JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRIcited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.