A theoretical framework for self-supervised MR image reconstruction using sub-sampling via variable density Noisier2Noise
Not on the map. Why?
Abstract (arXiv)
In recent years, there has been attention on leveraging the statistical modeling capabilities of neural networks for reconstructing sub-sampled Magnetic Resonance Imaging (MRI) data. Most proposed methods assume the existence of a representative fully-sampled dataset and use fully-supervised training. However, for many applications, fully sampled training data is not available, and may be highly impractical to acquire. The development and understanding of self-supervised methods, which use only sub-sampled data for training, are therefore highly desirable. This work extends the Noisier2Noise framework, which was originally constructed for self-supervised denoising tasks, to variable density sub-sampled MRI data. We use the Noisier2Noise framework to analytically explain the performance of Self-Supervised Learning via Data Undersampling (SSDU), a recently proposed method that performs well in practice but until now lacked theoretical justification. Further, we propose two modifications of SSDU that arise as a consequence of the theoretical developments. Firstly, we propose partitioning the sampling set so that the subsets have the same type of distribution as the original sampling mask. Secondly, we propose a loss weighting that compensates for the sampling and partitioning densities. On the fastMRI dataset we show that these changes significantly improve SSDU's image restoration quality and robustness to the partitioning parameters.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 32 of its 68 references that are in the map. First posted on arXiv 20 May 2022.
Builds on
32 of 68 references.
References · 32
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017Deep Image Priorcited by 1,098
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 533
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 470
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 387
- 2018Noise2Void - Learning Denoising from Single Noisy Imagescited by 364
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 342
- 2019Noise2Self: Blind Denoising by Self-Supervisioncited by 276
- 2017Image reconstruction by domain transform manifold learningcited by 232
- 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 202
- 2019Noisier2Noise: Learning to Denoise from Unpaired Noisy Datacited by 126
20 more
- 2021Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean Imagescited by 113
- 2016A deep convolutional neural network using directional wavelets for low-dose X-ray CT reconstructioncited by 87
- 2017Compressed Sensing MRI Reconstruction using a Generative Adversarial Network with a Cyclic Losscited by 82
- 2019Plug and play methods for magnetic resonance imaging (long version)cited by 75
- 2019Time-Dependent Deep Image Prior for Dynamic MRIcited by 70
- 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
- 2020Noise2Same: Optimizing A Self-Supervised Bound for Image Denoisingcited by 56
- 2021Robust Equivariant Imaging: a fully unsupervised framework for learning to image from noisy and partial measurementscited by 56
- 2022Physics-Driven Deep Learning for Computational Magnetic Resonance Imagingcited by 50
- 2021AI-based Reconstruction for Fast MRI -- A Systematic Review and Meta-analysiscited by 38
- 2018DIMENSION: Dynamic MR Imaging with Both K-space and Spatial Prior Knowledge Obtained via Multi-Supervised Network Trainingcited by 26
- 2021Self-Supervised Learning for MRI Reconstruction with a Parallel Network Training Frameworkcited by 26
- 2020Unsupervised MRI Reconstruction with Generative Adversarial Networkscited by 24
- 2020Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRIcited by 14
- 2021Deformation-Compensated Learning for Image Reconstruction without Ground Truthcited by 9
- 2022PARCEL: Physics-based Unsupervised Contrastive Representation Learning for Multi-coil MR Imagingcited by 8
- 2019Deep Plug-and-Play Prior for Parallel MRI Reconstructioncited by 3
- 2020Improved Supervised Training of Physics-Guided Deep Learning Image Reconstruction with Multi-Maskingcited by 3
- 2016Astronomical image reconstruction with convolutional neural networkscited by 1
- 2021MRI Recovery with A Self-calibrated Denoisercited by 1
Built on by
Citing papers per year: 2023: 6; 2024: 5; 2025: 11; 2026: 8.
30 papers.
Sort:
By area:
- 2023Ambient Diffusion: Learning Clean Distributions from Corrupted Datacited by 111
- 2024Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Datacited by 32
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methodscited by 8
- 2023Self-Supervised Scalable Deep Compressed Sensingcited by 8
- 2025Measurement Score-Based Diffusion Modelcited by 8
- 2023A Deep Learning Method for Simultaneous Denoising and Missing Wedge Reconstruction in Cryogenic Electron Tomographycited by 7
- 2023K-band: Self-supervised MRI Reconstruction via Stochastic Gradient Descent over K-space Subsetscited by 6
- 2025Noisier2Inverse: Self-Supervised Learning for Image Reconstruction with Correlated Noisecited by 5
- 2026Self-Supervised Learning from Noisy and Incomplete Datacited by 5
- 2023Joint Supervised and Self-supervised Learning for MRI Reconstructioncited by 4
- 2024Robust multi-coil MRI reconstruction via self-supervised denoisingcited by 4
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstructioncited by 4
18 more
- 2025Sparsity-Driven Parallel Imaging Consistency for Improved Self-Supervised MRI Reconstructioncited by 4
- 2024Deep Learning-based Accelerated MR Cholangiopancreatography without Fully-sampled Datacited by 2
- 2024MotionTTT: 2D Test-Time-Training Motion Estimation for 3D Motion Corrected MRIcited by 2
- 2024Fast MRI for All: Bridging Access Gaps by Training without Raw Datacited by 2
- 2025Re-Visible Dual-Domain Self-Supervised Deep Unfolding Network for MRI Reconstructioncited by 1
- 2025Equivariant Splitting: Self-supervised learning from incomplete datacited by 1
- 2025UPMRI: Unsupervised Parallel MRI Reconstruction via Projected Conditional Flow Matchingcited by 1
- 2025An Adaptive, Disentangled Representation for Multidimensional MRI Reconstructioncited by 1
- 2025Extendable Generalization Self-Supervised Diffusion for Low-Dose CT Reconstructioncited by 0
- 2025MID: A Self-supervised Multimodal Iterative Denoising Frameworkcited by 0
- 2025Locally-Supervised Global Image Restorationcited by 0
- 2026HyDRA: Hybrid Denoising Regularization for Measurement-Only DEQ Trainingcited by 0
- 2026Accelerating Stroke MRI with Diffusion Probabilistic Models through Large-Scale Pre-training and Target-Specific Fine-Tuningcited by 0
- 2026Self-Supervised Uncertainty Estimation For Super-Resolution of Satellite Imagescited by 0
- 2026Self-Supervised Angular Deblurring in Photoacoustic Reconstruction via Noisier2Inversecited by 0
- 2026CoilDrop-MRI: Self-supervised physics-guided MRI reconstruction with coil dropoutcited by 0
- 2026Enhancing Implicit Neural Representations with Image Feature Embedding for Unsupervised Cardiac Cine MRI Reconstructioncited by 0
- 2026Hankel Subspace Self-Supervised Learning for Parallel MRI Reconstructioncited by 0
- 2026Hankel Subspace Self-Supervised Learning for Parallel MRI Reconstruction8 Oct 2026
- 2026Enhancing Implicit Neural Representations with Image Feature Embedding for Unsupervised Cardiac Cine MRI Reconstruction5 Jul 2026
- 2026CoilDrop-MRI: Self-supervised physics-guided MRI reconstruction with coil dropout26 May 2026
- 2026Self-Supervised Angular Deblurring in Photoacoustic Reconstruction via Noisier2Inverse17 Apr 2026
- 2026Self-Supervised Uncertainty Estimation For Super-Resolution of Satellite Images14 Mar 2026
- 2026Accelerating Stroke MRI with Diffusion Probabilistic Models through Large-Scale Pre-training and Target-Specific Fine-Tuning13 Mar 2026
- 2026Self-Supervised Learning from Noisy and Incomplete Data6 Jan 2026
- 2026HyDRA: Hybrid Denoising Regularization for Measurement-Only DEQ Training3 Jan 2026
- 2025An Adaptive, Disentangled Representation for Multidimensional MRI Reconstruction31 Dec 2025
- 2025UPMRI: Unsupervised Parallel MRI Reconstruction via Projected Conditional Flow Matching19 Dec 2025
- 2025Locally-Supervised Global Image Restoration3 Nov 2025
- 2025MID: A Self-supervised Multimodal Iterative Denoising Framework2 Nov 2025
18 more
- 2025Equivariant Splitting: Self-supervised learning from incomplete data1 Oct 2025
- 2025Extendable Generalization Self-Supervised Diffusion for Low-Dose CT Reconstruction28 Sep 2025
- 2025Sparsity-Driven Parallel Imaging Consistency for Improved Self-Supervised MRI Reconstruction30 May 2025
- 2025Measurement Score-Based Diffusion Model17 May 2025
- 2025Noisier2Inverse: Self-Supervised Learning for Image Reconstruction with Correlated Noise25 Mar 2025
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction19 Feb 2025
- 2025Re-Visible Dual-Domain Self-Supervised Deep Unfolding Network for MRI Reconstruction7 Jan 2025
- 2024Fast MRI for All: Bridging Access Gaps by Training without Raw Data20 Nov 2024
- 2024Robust multi-coil MRI reconstruction via self-supervised denoising19 Nov 2024
- 2024MotionTTT: 2D Test-Time-Training Motion Estimation for 3D Motion Corrected MRI14 Sep 2024
- 2024Deep Learning-based Accelerated MR Cholangiopancreatography without Fully-sampled Data6 May 2024
- 2024Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Data13 Mar 2024
- 2023Joint Supervised and Self-supervised Learning for MRI Reconstruction27 Nov 2023
- 2023A Deep Learning Method for Simultaneous Denoising and Missing Wedge Reconstruction in Cryogenic Electron Tomography9 Nov 2023
- 2023Self-Supervised Scalable Deep Compressed Sensing26 Aug 2023
- 2023K-band: Self-supervised MRI Reconstruction via Stochastic Gradient Descent over K-space Subsets5 Aug 2023
- 2023Ambient Diffusion: Learning Clean Distributions from Corrupted Data30 May 2023
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methods30 May 2023
- 2024Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Datacited by 32
- 2025Measurement Score-Based Diffusion Modelcited by 8
- 2025UPMRI: Unsupervised Parallel MRI Reconstruction via Projected Conditional Flow Matchingcited by 1
- 2026Accelerating Stroke MRI with Diffusion Probabilistic Models through Large-Scale Pre-training and Target-Specific Fine-Tuningcited by 0
- 2026Accelerating Stroke MRI with Diffusion Probabilistic Models through Large-Scale Pre-training and Target-Specific Fine-Tuning13 Mar 2026
- 2025UPMRI: Unsupervised Parallel MRI Reconstruction via Projected Conditional Flow Matching19 Dec 2025
- 2025Measurement Score-Based Diffusion Model17 May 2025
- 2024Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Data13 Mar 2024
- 2023Ambient Diffusion: Learning Clean Distributions from Corrupted Datacited by 111
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methodscited by 8
- 2023Self-Supervised Scalable Deep Compressed Sensingcited by 8
- 2023A Deep Learning Method for Simultaneous Denoising and Missing Wedge Reconstruction in Cryogenic Electron Tomographycited by 7
- 2023K-band: Self-supervised MRI Reconstruction via Stochastic Gradient Descent over K-space Subsetscited by 6
- 2025Noisier2Inverse: Self-Supervised Learning for Image Reconstruction with Correlated Noisecited by 5
- 2026Self-Supervised Learning from Noisy and Incomplete Datacited by 5
- 2023Joint Supervised and Self-supervised Learning for MRI Reconstructioncited by 4
- 2024Robust multi-coil MRI reconstruction via self-supervised denoisingcited by 4
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstructioncited by 4
- 2025Sparsity-Driven Parallel Imaging Consistency for Improved Self-Supervised MRI Reconstructioncited by 4
- 2024Deep Learning-based Accelerated MR Cholangiopancreatography without Fully-sampled Datacited by 2
12 most cited of 26 All 26 (JSON)
- 2026Hankel Subspace Self-Supervised Learning for Parallel MRI Reconstruction8 Oct 2026
- 2026Enhancing Implicit Neural Representations with Image Feature Embedding for Unsupervised Cardiac Cine MRI Reconstruction5 Jul 2026
- 2026CoilDrop-MRI: Self-supervised physics-guided MRI reconstruction with coil dropout26 May 2026
- 2026Self-Supervised Angular Deblurring in Photoacoustic Reconstruction via Noisier2Inverse17 Apr 2026
- 2026Self-Supervised Uncertainty Estimation For Super-Resolution of Satellite Images14 Mar 2026
- 2026Self-Supervised Learning from Noisy and Incomplete Data6 Jan 2026
- 2026HyDRA: Hybrid Denoising Regularization for Measurement-Only DEQ Training3 Jan 2026
- 2025An Adaptive, Disentangled Representation for Multidimensional MRI Reconstruction31 Dec 2025
- 2025Locally-Supervised Global Image Restoration3 Nov 2025
- 2025MID: A Self-supervised Multimodal Iterative Denoising Framework2 Nov 2025
- 2025Equivariant Splitting: Self-supervised learning from incomplete data1 Oct 2025
- 2025Extendable Generalization Self-Supervised Diffusion for Low-Dose CT Reconstruction28 Sep 2025
12 newest of 26 All 26 (JSON)