K-band: Self-supervised MRI Reconstruction via Stochastic Gradient Descent over K-space Subsets
Not on the map. Why?
Abstract (arXiv)
Although deep learning (DL) methods are powerful for solving inverse problems, their reliance on high-quality training data is a major hurdle. This is significant in high-dimensional (dynamic/volumetric) magnetic resonance imaging (MRI), where acquisition of high-resolution fully sampled k-space data is impractical. We introduce a novel mathematical framework, dubbed k-band, that enables training DL models using only partial, limited-resolution k-space data. Specifically, we introduce training with stochastic gradient descent (SGD) over k-space subsets. In each training iteration, rather than using the fully sampled k-space for computing gradients, we use only a small k-space portion. This concept is compatible with different sampling strategies; here we demonstrate the method for k-space "bands", which have limited resolution in one dimension and can hence be acquired rapidly. We prove analytically that our method stochastically approximates the gradients computed in a fully-supervised setup, when two simple conditions are met: (i) the limited-resolution axis is chosen randomly-uniformly for every new scan, hence k-space is fully covered across the entire training set, and (ii) the loss function is weighed with a mask, derived here analytically, which facilitates accurate reconstruction of high-resolution details. Numerical experiments with raw MRI data indicate that k-band outperforms two other methods trained on limited-resolution data and performs comparably to state-of-the-art (SoTA) methods trained on high-resolution data. k-band hence obtains SoTA performance, with the advantage of training using only limited-resolution data. This work hence introduces a practical, easy-to-implement, self-supervised training framework, which involves fast acquisition and self-supervised reconstruction and offers theoretical guarantees.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 26 of its 66 references that are in the map. First posted on arXiv 5 Aug 2023.
Builds on
26 of 66 references.
References · 26
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 533
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 387
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 342
- 2017Image reconstruction by domain transform manifold learningcited by 232
- 2018An overview of deep learning in medical imaging focusing on MRIcited by 140
- 2019Noisier2Noise: Learning to Denoise from Unpaired Noisy Datacited by 126
- 2018Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networkscited by 120
- 2023Ambient Diffusion: Learning Clean Distributions from Corrupted Datacited by 111
- 2019Deep Learning Methods for Parallel Magnetic Resonance Image Reconstructioncited by 81
- 2021Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformerscited by 77
- 2017A Deep Cascade of Convolutional Neural Networks for MR Image Reconstructioncited by 74
- 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
14 more
- 2019Image Reconstruction: From Sparsity to Data-adaptive Methods and Machine Learningcited by 60
- 2021Zero-Shot Self-Supervised Learning for MRI Reconstructioncited by 54
- 2018Deep Residual Learning for Accelerated MRI using Magnitude and Phase Networkscited by 53
- 2022Physics-Driven Deep Learning for Computational Magnetic Resonance Imagingcited by 50
- 2018Unsupervised Learning with Stein's Unbiased Risk Estimatorcited by 47
- 2022SKM-TEA: A Dataset for Accelerated MRI Reconstruction with Dense Image Labels for Quantitative Clinical Evaluationcited by 44
- 2021AI-based Reconstruction for Fast MRI -- A Systematic Review and Meta-analysiscited by 38
- 2022A theoretical framework for self-supervised MR image reconstruction using sub-sampling via variable density Noisier2Noisecited by 30
- 2020Unsupervised MRI Reconstruction with Generative Adversarial Networkscited by 24
- 2019Self-Supervised Physics-Based Deep Learning MRI Reconstruction Without Fully-Sampled Datacited by 17
- 2021Unsupervised Deep Learning Methods for Biological Image Reconstruction and Enhancementcited by 17
- 2019Extreme MRI: Large-Scale Volumetric Dynamic Imaging from Continuous Non-Gated Acquisitionscited by 12
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methodscited by 8
- 2022SelfCoLearn: Self-supervised collaborative learning for accelerating dynamic MR imagingcited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 2.
6 papers.
- 2024Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Datacited by 32
- 2024Deep Learning for Accelerated and Robust MRI Reconstruction: a Reviewcited by 9
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstructioncited by 4
- 2025Accelerated Patient-specific Non-Cartesian MRI Reconstruction using Implicit Neural Representationscited by 2
- 2026NexOP: Joint Optimization of NEX-Aware k-space Sampling and Image Reconstruction for Low-Field MRIcited by 0
- 2026Hankel Subspace Self-Supervised Learning for Parallel MRI Reconstructioncited by 0
- 2026Hankel Subspace Self-Supervised Learning for Parallel MRI Reconstruction8 Oct 2026
- 2026NexOP: Joint Optimization of NEX-Aware k-space Sampling and Image Reconstruction for Low-Field MRI12 May 2026
- 2025Accelerated Patient-specific Non-Cartesian MRI Reconstruction using Implicit Neural Representations7 Mar 2025
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction19 Feb 2025
- 2024Deep Learning for Accelerated and Robust MRI Reconstruction: a Review24 Apr 2024
- 2024Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Data13 Mar 2024