Self-Supervised Deep Active Accelerated MRI
Not on the map. Why?
Abstract (arXiv)
We propose to simultaneously learn to sample and reconstruct magnetic resonance images (MRI) to maximize the reconstruction quality given a limited sample budget, in a self-supervised setup. Unlike existing deep methods that focus only on reconstructing given data, thus being passive, we go beyond the current state of the art by considering both the data acquisition and the reconstruction process within a single deep-learning framework. As our network learns to acquire data, the network is active in nature. In order to do so, we simultaneously train two neural networks, one dedicated to reconstruction and the other to progressive sampling, each with an automatically generated supervision signal that links them together. The two supervision signals are created through Monte Carlo tree search (MCTS). MCTS returns a better sampling pattern than what the current sampling network can give and, thus, a better final reconstruction. The sampling network is trained to mimic the MCTS results using the previous sampling network, thus being enhanced. The reconstruction network is trained to give the highest reconstruction quality, given the MCTS sampling pattern. Through this framework, we are able to train the two networks without providing any direct supervision on sampling.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 8; 2023: 5; 2024: 5; 2025: 1; 2026: 1.
24 papers.
Sort:
By area:
- 2021Active 3D Shape Reconstruction from Vision and Touchcited by 34
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 32
- 2022On learning adaptive acquisition policies for undersampled multi-coil MRI reconstructioncited by 14
- 2021End-to-End Sequential Sampling and Reconstruction for MRIcited by 13
- 2021A review and experimental evaluation of deep learning methods for MRI reconstructioncited by 13
- 2024Adaptive Compressed Sensing with Diffusion-Based Posterior Samplingcited by 12
- 2024Adaptive Sampling of k-Space in Magnetic Resonance for Rapid Pathology Predictioncited by 7
- 2021One Network to Solve Them All: A Sequential Multi-Task Joint Learning Network Framework for MR Imaging Pipelinecited by 5
- 2022PUERT: Probabilistic Under-sampling and Explicable Reconstruction Network for CS-MRIcited by 5
- 2022Accelerated Intravascular Ultrasound Imaging using Deep Reinforcement Learningcited by 4
- 2025Diffusion Active Learning: Towards Data-Driven Experimental Design in Computed Tomographycited by 4
- 2022JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRIcited by 3
12 more
- 2022Active CT Reconstruction with a Learned Sampling Policycited by 3
- 2023On the Feasibility of Machine Learning Augmented Magnetic Resonance for Point-of-Care Identification of Diseasecited by 3
- 2023Matrix Completion-Informed Deep Unfolded Equilibrium Models for Self-Supervised k-Space Interpolation in MRIcited by 3
- 2022Active Phase-Encode Selection for Slice-Specific Fast MR Scanning Using a Transformer-Based Deep Reinforcement Learning Frameworkcited by 1
- 2023Learning to sample in Cartesian MRIcited by 1
- 2024Optimal OnTheFly Feedback Control of Event Sensorscited by 1
- 2022A Note on Machine Learning Approach for Computational Imagingcited by 0
- 2022L2SR: Learning to Sample and Reconstruct for Accelerated MRI via Reinforcement Learningcited by 0
- 2023Reinforcement Learning for Sampling on Temporal Medical Imaging Sequencescited by 0
- 2024Reinforcement Learning of Adaptive Acquisition Policies for Inverse Problemscited by 0
- 2024LSST: Learned Single-Shot Trajectory and Reconstruction Network for MR Imagingcited by 0
- 2026Prior-aware and Context-guided Group Sampling for Active Probabilistic Subsamplingcited by 0
- 2026Prior-aware and Context-guided Group Sampling for Active Probabilistic Subsampling8 Jul 2026
- 2025Diffusion Active Learning: Towards Data-Driven Experimental Design in Computed Tomography4 Apr 2025
- 2024Optimal OnTheFly Feedback Control of Event Sensors23 Aug 2024
- 2024LSST: Learned Single-Shot Trajectory and Reconstruction Network for MR Imaging8 Aug 2024
- 2024Adaptive Compressed Sensing with Diffusion-Based Posterior Sampling11 Jul 2024
- 2024Reinforcement Learning of Adaptive Acquisition Policies for Inverse Problems10 Jul 2024
- 2024Adaptive Sampling of k-Space in Magnetic Resonance for Rapid Pathology Prediction6 Jun 2024
- 2023Learning to sample in Cartesian MRI7 Dec 2023
- 2023A comprehensive survey on deep active learning in medical image analysis22 Oct 2023
- 2023Matrix Completion-Informed Deep Unfolded Equilibrium Models for Self-Supervised k-Space Interpolation in MRI24 Sep 2023
- 2023Reinforcement Learning for Sampling on Temporal Medical Imaging Sequences28 Aug 2023
- 2023On the Feasibility of Machine Learning Augmented Magnetic Resonance for Point-of-Care Identification of Disease27 Jan 2023
12 more
- 2022L2SR: Learning to Sample and Reconstruct for Accelerated MRI via Reinforcement Learning5 Dec 2022
- 2022Active CT Reconstruction with a Learned Sampling Policy3 Nov 2022
- 2022JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRI22 Oct 2022
- 2022PUERT: Probabilistic Under-sampling and Explicable Reconstruction Network for CS-MRI24 Apr 2022
- 2022On learning adaptive acquisition policies for undersampled multi-coil MRI reconstruction30 Mar 2022
- 2022Active Phase-Encode Selection for Slice-Specific Fast MR Scanning Using a Transformer-Based Deep Reinforcement Learning Framework11 Mar 2022
- 2022A Note on Machine Learning Approach for Computational Imaging24 Feb 2022
- 2022Accelerated Intravascular Ultrasound Imaging using Deep Reinforcement Learning24 Jan 2022
- 2021A review and experimental evaluation of deep learning methods for MRI reconstruction17 Sep 2021
- 2021Active 3D Shape Reconstruction from Vision and Touch20 Jul 2021
- 2021One Network to Solve Them All: A Sequential Multi-Task Joint Learning Network Framework for MR Imaging Pipeline14 May 2021
- 2021End-to-End Sequential Sampling and Reconstruction for MRI13 May 2021
- 2021Active 3D Shape Reconstruction from Vision and Touchcited by 34
- 2023A comprehensive survey on deep active learning in medical image analysiscited by 32
- 2022On learning adaptive acquisition policies for undersampled multi-coil MRI reconstructioncited by 14
- 2021End-to-End Sequential Sampling and Reconstruction for MRIcited by 13
- 2021A review and experimental evaluation of deep learning methods for MRI reconstructioncited by 13
- 2024Adaptive Compressed Sensing with Diffusion-Based Posterior Samplingcited by 12
- 2024Adaptive Sampling of k-Space in Magnetic Resonance for Rapid Pathology Predictioncited by 7
- 2021One Network to Solve Them All: A Sequential Multi-Task Joint Learning Network Framework for MR Imaging Pipelinecited by 5
- 2022PUERT: Probabilistic Under-sampling and Explicable Reconstruction Network for CS-MRIcited by 5
- 2022Accelerated Intravascular Ultrasound Imaging using Deep Reinforcement Learningcited by 4
- 2022JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRIcited by 3
- 2022Active CT Reconstruction with a Learned Sampling Policycited by 3
12 most cited of 23 All 23 (JSON)
- 2026Prior-aware and Context-guided Group Sampling for Active Probabilistic Subsampling8 Jul 2026
- 2024Optimal OnTheFly Feedback Control of Event Sensors23 Aug 2024
- 2024LSST: Learned Single-Shot Trajectory and Reconstruction Network for MR Imaging8 Aug 2024
- 2024Adaptive Compressed Sensing with Diffusion-Based Posterior Sampling11 Jul 2024
- 2024Reinforcement Learning of Adaptive Acquisition Policies for Inverse Problems10 Jul 2024
- 2024Adaptive Sampling of k-Space in Magnetic Resonance for Rapid Pathology Prediction6 Jun 2024
- 2023Learning to sample in Cartesian MRI7 Dec 2023
- 2023A comprehensive survey on deep active learning in medical image analysis22 Oct 2023
- 2023Matrix Completion-Informed Deep Unfolded Equilibrium Models for Self-Supervised k-Space Interpolation in MRI24 Sep 2023
- 2023Reinforcement Learning for Sampling on Temporal Medical Imaging Sequences28 Aug 2023
- 2023On the Feasibility of Machine Learning Augmented Magnetic Resonance for Point-of-Care Identification of Disease27 Jan 2023
- 2022L2SR: Learning to Sample and Reconstruct for Accelerated MRI via Reinforcement Learning5 Dec 2022
12 newest of 23 All 23 (JSON)