JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRI
Not on the map. Why?
Abstract (arXiv)
Multi-contrast Magnetic Resonance Imaging (MRI) generates multiple medical images with rich and complementary information for routine clinical use; however, it suffers from a long acquisition time. Recent works for accelerating MRI, mainly designed for single contrast, may not be optimal for multi-contrast scenario since the inherent correlations among the multi-contrast images are not exploited. In addition, independent reconstruction of each contrast usually does not translate to optimal performance of downstream tasks. Motivated by these aspects, in this paper we design an end-to-end framework for accelerating multi-contrast MRI which simultaneously optimizes the entire MR imaging workflow including sampling, reconstruction and downstream tasks to achieve the best overall outcomes. The proposed framework consists of a sampling mask generator for each image contrast and a reconstructor exploiting the inter-contrast correlations with a recurrent structure which enables the information sharing in a holistic way. The sampling mask generator and the reconstructor are trained jointly across the multiple image contrasts. The acceleration ratio of each image contrast is also learnable and can be driven by a downstream task performance. We validate our approach on a multi-contrast brain dataset and a multi-contrast knee dataset. Experiments show that (1) our framework consistently outperforms the baselines designed for single contrast on both datasets; (2) our newly designed recurrent reconstruction network effectively improves the reconstruction quality for multi-contrast images; (3) the learnable acceleration ratio improves the downstream task performance significantly. Overall, this work has potentials to open up new avenues for optimizing the entire multi-contrast MR imaging workflow.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 31 of its 49 references that are in the map. First posted on arXiv 22 Oct 2022.
Builds on
31 of 49 references.
References · 31
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 464
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
- 2017Compressed Sensing using Generative Modelscited by 337
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
- 2017Image reconstruction by domain transform manifold learningcited by 231
- 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
- 2017Deep learning for undersampled MRI reconstructioncited by 91
- 2017Compressed Sensing MRI Reconstruction using a Generative Adversarial Network with a Cyclic Losscited by 82
19 more
- 2020DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction with Deep T1 Priorcited by 72
- 2019Reducing Uncertainty in Undersampled MRI Reconstruction with Active Acquisitioncited by 55
- 2019GrappaNet: Combining Parallel Imaging with Deep Learning for Multi-Coil MRI Reconstructioncited by 45
- 2020Active MR k-space Sampling with Reinforcement Learningcited by 45
- 2020Experimental design for MRI by greedy policy searchcited by 40
- 2019Learning-based Optimization of the Under-sampling Pattern in MRIcited by 32
- 2019Recurrent U-Net for Resource-Constrained Segmentationcited by 27
- 2019Self-Supervised Deep Active Accelerated MRIcited by 24
- 2019Learning the Sampling Pattern for MRIcited by 21
- 2018Coupled Dictionary Learning for Multi-contrast MRI Reconstructioncited by 16
- 2021Multi-Modal MRI Reconstruction Assisted with Spatial Alignment Networkcited by 16
- 2017Deep Generative Adversarial Networks for Compressed Sensing Automates MRIcited by 15
- 2019Joint learning of cartesian undersampling and reconstruction for accelerated MRIcited by 14
- 2019Wasserstein GANs for MR Imaging: from Paired to Unpaired Trainingcited by 14
- 2018Adversarial and Perceptual Refinement for Compressed Sensing MRI Reconstructioncited by 13
- 2021End-to-End Sequential Sampling and Reconstruction for MRIcited by 13
- 2015Multi-Contrast MRI Reconstruction with Structure-Guided Total Variationcited by 11
- 2019Scalable Learning-Based Sampling Optimization for Compressive Dynamic MRIcited by 9
- 2013Bayesian Nonparametric Dictionary Learning for Compressed Sensing MRIcited by 5
Built on by
Citing papers per year: 2023: 2; 2024: 1.
3 papers.