Deformation-Compensated Learning for Image Reconstruction without Ground Truth
Not on the map. Why?
Abstract (arXiv)
Deep neural networks for medical image reconstruction are traditionally trained using high-quality ground-truth images as training targets. Recent work on Noise2Noise (N2N) has shown the potential of using multiple noisy measurements of the same object as an alternative to having a ground-truth. However, existing N2N-based methods are not suitable for learning from the measurements of an object undergoing nonrigid deformation. This paper addresses this issue by proposing the deformation-compensated learning (DeCoLearn) method for training deep reconstruction networks by compensating for object deformations. A key component of DeCoLearn is a deep registration module, which is jointly trained with the deep reconstruction network without any ground-truth supervision. We validate DeCoLearn on both simulated and experimentally collected magnetic resonance imaging (MRI) data and show that it significantly improves imaging quality.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 40 of its 89 references that are in the map. First posted on arXiv 12 Jul 2021.
Builds on
40 of 89 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2015Spatial Transformer Networkscited by 1,423
- 2017Deep Image Priorcited by 1,097
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
- 2018Noise2Void - Learning Denoising from Single Noisy Imagescited by 359
28 more
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 303
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
- 2019Noise2Self: Blind Denoising by Self-Supervisioncited by 274
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
- 2019High-Quality Self-Supervised Deep Image Denoisingcited by 161
- 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
- 2019Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernelscited by 112
- 2019Deep Learning in Medical Image Registration: A Reviewcited by 98
- 2019DeepRED: Deep Image Prior Powered by REDcited by 84
- 2017A Review of Convolutional Neural Networks for Inverse Problems in Imagingcited by 81
- 2019Deep Learning Methods for Parallel Magnetic Resonance Image Reconstructioncited by 81
- 2015Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolationcited by 78
- 2019Plug and play methods for magnetic resonance imaging (long version)cited by 75
- 2019Time-Dependent Deep Image Prior for Dynamic MRIcited by 70
- 2018Image Restoration using Total Variation Regularized Deep Image Priorcited by 65
- 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
- 2021Zero-Shot Self-Supervised Learning for MRI Reconstructioncited by 53
- 2019Probabilistic Noise2Void: Unsupervised Content-Aware Denoisingcited by 51
- 2018Training Deep Learning Based Denoisers without Ground Truth Datacited by 43
- 2018Model-blind Video Denoising Via Frame-to-frame Trainingcited by 34
- 2015On learning optimized reaction diffusion processes for effective image restorationcited by 25
- 2021SGD-Net: Efficient Model-Based Deep Learning with Theoretical Guaranteescited by 18
- 2019Self-Supervised Physics-Based Deep Learning MRI Reconstruction Without Fully-Sampled Datacited by 17
- 2021Deformed2Self: Self-Supervised Denoising for Dynamic Medical Imagingcited by 15
- 2018Cryo-CARE: Content-Aware Image Restoration for Cryo-Transmission Electron Microscopy Datacited by 13
- 2017ssEMnet: Serial-section Electron Microscopy Image Registration using a Spatial Transformer Network with Learned Featurescited by 7
- 2018Regularized Fourier Ptychography using an Online Plug-and-Play Algorithmcited by 7
- 2020Deep Image Reconstruction using Unregistered Measurements without Groundtruthcited by 3
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 2; 2025: 1; 2026: 1.
9 papers.
- 2022A theoretical framework for self-supervised MR image reconstruction using sub-sampling via variable density Noisier2Noisecited by 29
- 2023Deep Learning for Retrospective Motion Correction in MRI: A Comprehensive Reviewcited by 18
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstructioncited by 4
- 2024Fully Unsupervised Dynamic MRI Reconstruction via Diffeo-Temporal Equivariancecited by 3
- 2023Efficient Model-Based Deep Learning via Network Pruning and Fine-Tuningcited by 2
- 2022Self-Supervised Deep Equilibrium Models for Inverse Problems with Theoretical Guaranteescited by 1
- 2026A Unified Framework for Multimodal Image Reconstruction and Synthesis using Denoising Diffusion Modelscited by 1
- 2023Regularization by Neural Style Transfer for MRI Field-Transfer Reconstruction with Limited Datacited by 0
- 2024Investigating Self-Supervised Image Denoising with Denaturationcited by 0
- 2026A Unified Framework for Multimodal Image Reconstruction and Synthesis using Denoising Diffusion Models9 Feb 2026
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction19 Feb 2025
- 2024Fully Unsupervised Dynamic MRI Reconstruction via Diffeo-Temporal Equivariance11 Oct 2024
- 2024Investigating Self-Supervised Image Denoising with Denaturation2 May 2024
- 2023Efficient Model-Based Deep Learning via Network Pruning and Fine-Tuning3 Nov 2023
- 2023Regularization by Neural Style Transfer for MRI Field-Transfer Reconstruction with Limited Data21 Aug 2023
- 2023Deep Learning for Retrospective Motion Correction in MRI: A Comprehensive Review11 May 2023
- 2022Self-Supervised Deep Equilibrium Models for Inverse Problems with Theoretical Guarantees7 Oct 2022
- 2022A theoretical framework for self-supervised MR image reconstruction using sub-sampling via variable density Noisier2Noise20 May 2022