Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers
Not on the map. Why?
Abstract (arXiv)
Supervised reconstruction models are characteristically trained on matched pairs of undersampled and fully-sampled data to capture an MRI prior, along with supervision regarding the imaging operator to enforce data consistency. To reduce supervision requirements, the recent deep image prior framework instead conjoins untrained MRI priors with the imaging operator during inference. Yet, canonical convolutional architectures are suboptimal in capturing long-range relationships, and priors based on randomly initialized networks may yield suboptimal performance. To address these limitations, here we introduce a novel unsupervised MRI reconstruction method based on zero-Shot Learned Adversarial TransformERs (SLATER). SLATER embodies a deep adversarial network with cross-attention transformers to map noise and latent variables onto coil-combined MR images. During pre-training, this unconditional network learns a high-quality MRI prior in an unsupervised generative modeling task. During inference, a zero-shot reconstruction is then performed by incorporating the imaging operator and optimizing the prior to maximize consistency to undersampled data. Comprehensive experiments on brain MRI datasets clearly demonstrate the superior performance of SLATER against state-of-the-art unsupervised methods.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). Builds on 58 of its 111 references that are in the map. First posted on arXiv 15 May 2021.
Builds on
58 of 111 references.
References · 58
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2019Generating Long Sequences with Sparse Transformerscited by 1,523
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2017Deep Image Priorcited by 1,097
- 2016An overview of gradient descent optimization algorithmscited by 1,021
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2018Which Training Methods for GANs do actually Converge?cited by 672
38 more
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
- 2021GAN Inversion: A Surveycited by 366
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
- 2017Learned Primal-dual Reconstructioncited by 251
- 2017Image reconstruction by domain transform manifold learningcited by 231
- 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
- 2021Generative Adversarial Transformerscited by 120
- 2017Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstructioncited by 105
- 2019Invertible generative models for inverse problems: mitigating representation error and dataset biascited by 93
- 2017Deep learning for undersampled MRI reconstructioncited by 91
- 2017A Deep Cascade of Convolutional Neural Networks for MR Image Reconstructioncited by 74
- 2019Time-Dependent Deep Image Prior for Dynamic MRIcited by 70
- 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
- 2018Deep Residual Learning for Accelerated MRI using Magnitude and Phase Networkscited by 53
- 2017A Transfer-Learning Approach for Accelerated MRI using Deep Neural Networkscited by 43
- 2020Compressive sensing with un-trained neural networks: Gradient descent finds the smoothest approximationcited by 39
- 2020Synthetic Learning: Learn From Distributed Asynchronized Discriminator GAN Without Sharing Medical Image Datacited by 38
- 2017MR image reconstruction using deep density priorscited by 37
- 2017Deep Learning with Domain Adaptation for Accelerated Projection-Reconstruction MRcited by 31
- 2020Unpaired Deep Learning for Accelerated MRI using Optimal Transport Driven CycleGANcited by 28
- 2019LORAKI: Autocalibrated Recurrent Neural Networks for Autoregressive MRI Reconstruction in k-Spacecited by 27
- 2018DIMENSION: Dynamic MR Imaging with Both K-space and Spatial Prior Knowledge Obtained via Multi-Supervised Network Trainingcited by 26
- 2018Quantitative Susceptibility Mapping using Deep Neural Network: QSMnetcited by 24
- 2020Unsupervised MRI Reconstruction with Generative Adversarial Networkscited by 24
- 2019Model Learning: Primal Dual Networks for Fast MR imagingcited by 22
- 2018Real-time Cardiovascular MR with Spatio-temporal Artifact Suppression using Deep Learning - Proof of Concept in Congenital Heart Diseasecited by 18
- 2018A Provably Convergent Scheme for Compressive Sensing under Random Generative Priorscited by 15
- 2019Wasserstein GANs for MR Imaging: from Paired to Unpaired Trainingcited by 14
- 2020Neural Network-based Reconstruction in Compressed Sensing MRI Without Fully-sampled Training Datacited by 14
- 2020Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRIcited by 13
- 2020ENSURE: A General Approach for Unsupervised Training of Deep Image Reconstruction Algorithmscited by 13
- 2019Image Reconstruction with Low-rankness and Self-consistency of k-space Data in Parallel MRIcited by 12
- 2020A Sparse Model-inspired Deep Thresholding Network for Exponential Signal Reconstruction -- Application in Fast Biological Spectroscopycited by 12
- 2019Joint multi-contrast Variational Network reconstruction (jVN) with application to rapid 2D and 3D imagingcited by 11
- 2020DC-WCNN: A deep cascade of wavelet based convolutional neural networks for MR Image Reconstructioncited by 8
- 2020Two-Stage Deep Learning for Accelerated 3D Time-of-Flight MRA without Matched Training Datacited by 7
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2021: 8; 2022: 25; 2023: 23; 2024: 7; 2025: 9; 2026: 4.
76 papers.
Sort:
By area:
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
- 2022Adaptive Diffusion Priors for Accelerated MRI Reconstructioncited by 117
- 2023Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Reviewcited by 62
- 2022Swin Transformer for Fast MRIcited by 56
- 2022ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformercited by 52
- 2021Multi-Modal Transformer for Accelerated MR Imagingcited by 42
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
- 2022One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputationcited by 40
- 2021Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative modelscited by 36
38 more
- 2021Specificity-Preserving Federated Learning for MR Image Reconstructioncited by 35
- 2022Class-Aware Adversarial Transformers for Medical Image Segmentationcited by 33
- 2022Federated Learning of Generative Image Priors for MRI Reconstructioncited by 33
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2022DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstructioncited by 30
- 2022HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstructioncited by 30
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translationcited by 26
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modelingcited by 26
- 2022BolT: Fused Window Transformers for fMRI Time Series Analysiscited by 23
- 2022One Model to Unite Them All: Personalized Federated Learning of Multi-Contrast MRI Synthesiscited by 22
- 2023Transformers in Healthcare: A Surveycited by 17
- 2021CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translationcited by 15
- 2023DreaMR: Diffusion-driven Counterfactual Explanation for Functional MRIcited by 14
- 2021A review and experimental evaluation of deep learning methods for MRI reconstructioncited by 13
- 2023Dual-Domain Self-Supervised Learning for Accelerated Non-Cartesian MRI Reconstructioncited by 13
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstructioncited by 13
- 2023LIT-Former: Linking In-plane and Through-plane Transformers for Simultaneous CT Image Denoising and Deblurringcited by 12
- 2023SADIR: Shape-Aware Diffusion Models for 3D Image Reconstructioncited by 12
- 2022One-shot Generative Prior in Hankel-k-space for Parallel Imaging Reconstructioncited by 11
- 2023CDiffMR: Can We Replace the Gaussian Noise with K-Space Undersampling for Fast MRI?cited by 11
- 2024DenoMamba: A fused state-space model for low-dose CT denoisingcited by 11
- 2021High-Resolution Pelvic MRI Reconstruction Using a Generative Adversarial Network with Attention and Cyclic Losscited by 10
- 2023Transformer-based Generative Adversarial Networks in Computer Vision: A Comprehensive Surveycited by 10
- 2023Cross-Modal Vertical Federated Learning for MRI Reconstructioncited by 9
- 2023TransMRSR: Transformer-based Self-Distilled Generative Prior for Brain MRI Super-Resolutioncited by 9
- 2023Global k-Space Interpolation for Dynamic MRI Reconstruction using Masked Image Modelingcited by 8
- 2022MISSU: 3D Medical Image Segmentation via Self-distilling TransUNetcited by 7
- 2022Content-Based Medical Image Retrieval with Opponent Class Adaptive Margin Losscited by 7
- 2023FD-Net: An Unsupervised Deep Forward-Distortion Model for Susceptibility Artifact Correction in EPIcited by 7
- 2024MambaRecon: MRI Reconstruction with Structured State Space Modelscited by 7
- 2024Physics-Driven Autoregressive State Space Models for Medical Image Reconstructioncited by 7
- 2022Validation and Generalizability of Self-Supervised Image Reconstruction Methods for Undersampled MRIcited by 6
- 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversificationcited by 6
- 2022Undersampled MRI Reconstruction with Side Information-Guided Normalisationcited by 5
- 2023BlindHarmony: "Blind" Harmonization for MR Images via Flow modelcited by 5
- 2023K-band: Self-supervised MRI Reconstruction via Stochastic Gradient Descent over K-space Subsetscited by 5
- 2023Federated Pseudo Modality Generation for Incomplete Multi-Modal MRI Reconstructioncited by 5
- 2022Multi-branch Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstructioncited by 4
50 most cited of 76 All 76 (JSON)
- 2026Frequency-Hierarchical Active k-Space Sampling for Diagnostic MRI22 Jul 2026
- 2026Trustworthy MRI Reconstruction via Bayesian Uncertainty Quantification with Sparsity Prior Models15 Jun 2026
- 2026SO-Mamba: State-Ownership Mamba for Unrolled MRI Reconstruction21 May 2026
- 2026Bayesian Uncertainty-Aware MRI Reconstruction13 Mar 2026
- 2025HiFi-MambaV2: Hierarchical Shared-Routed MoE for High-Fidelity MRI Reconstruction23 Nov 2025
- 2025Reconstruction of Optical Coherence Tomography Images from Wavelength-space Using Deep-learning23 Sep 2025
- 2025HiFi-Mamba: Dual-Stream W-Laplacian Enhanced Mamba for High-Fidelity MRI Reconstruction7 Aug 2025
- 2025Deep learning of personalized priors from past MRI scans enables fast, quality-enhanced point-of-care MRI with low-cost systems5 May 2025
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstruction10 Mar 2025
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction19 Feb 2025
- 2025Generative Autoregressive Transformers for Model-Agnostic Federated MRI Reconstruction6 Feb 2025
- 2025Advancing MRI Reconstruction: A Systematic Review of Deep Learning and Compressed Sensing Integration24 Jan 2025
38 more
- 2025DH-Mamba: Exploring Dual-domain Hierarchical State Space Models for MRI Reconstruction14 Jan 2025
- 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversification14 Dec 2024
- 2024Physics-Driven Autoregressive State Space Models for Medical Image Reconstruction12 Dec 2024
- 2024DenoMamba: A fused state-space model for low-dose CT denoising19 Sep 2024
- 2024MambaRecon: MRI Reconstruction with Structured State Space Models19 Sep 2024
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling22 May 2024
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translation10 May 2024
- 2024DuDoUniNeXt: Dual-domain unified hybrid model for single and multi-contrast undersampled MRI reconstruction8 Mar 2024
- 2023Towards Architecture-Agnostic Untrained Network Priors for Image Reconstruction with Frequency Regularization15 Dec 2023
- 2023Unsupervised Adaptive Implicit Neural Representation Learning for Scan-Specific MRI Reconstruction1 Dec 2023
- 2023Score-based Diffusion Models With Self-supervised Learning For Accelerated 3D Multi-contrast Cardiac Magnetic Resonance Imaging7 Oct 2023
- 2023SADIR: Shape-Aware Diffusion Models for 3D Image Reconstruction6 Sep 2023
- 2023Federated Pseudo Modality Generation for Incomplete Multi-Modal MRI Reconstruction20 Aug 2023
- 2023K-band: Self-supervised MRI Reconstruction via Stochastic Gradient Descent over K-space Subsets5 Aug 2023
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstruction2 Aug 2023
- 2023Global k-Space Interpolation for Dynamic MRI Reconstruction using Masked Image Modeling24 Jul 2023
- 2023DreaMR: Diffusion-driven Counterfactual Explanation for Functional MRI18 Jul 2023
- 2023Transformers in Healthcare: A Survey30 Jun 2023
- 2023CDiffMR: Can We Replace the Gaussian Noise with K-Space Undersampling for Fast MRI?25 Jun 2023
- 2023CAMP-Net: Consistency-Aware Multi-Prior Network for Accelerated MRI Reconstruction20 Jun 2023
- 2023TransMRSR: Transformer-based Self-Distilled Generative Prior for Brain MRI Super-Resolution11 Jun 2023
- 2023Cross-Modal Vertical Federated Learning for MRI Reconstruction5 Jun 2023
- 2023BlindHarmony: "Blind" Harmonization for MR Images via Flow model18 May 2023
- 2023Adapting model-based deep learning to multiple acquisition conditions: Ada-MoDL21 Apr 2023
- 2023Deep Learning-based Diffusion Tensor Cardiac Magnetic Resonance Reconstruction: A Comparison Study31 Mar 2023
- 2023FD-Net: An Unsupervised Deep Forward-Distortion Model for Susceptibility Artifact Correction in EPI18 Mar 2023
- 2023LIT-Former: Linking In-plane and Through-plane Transformers for Simultaneous CT Image Denoising and Deblurring21 Feb 2023
- 2023Dual-Domain Self-Supervised Learning for Accelerated Non-Cartesian MRI Reconstruction18 Feb 2023
- 2023Transformer-based Generative Adversarial Networks in Computer Vision: A Comprehensive Survey17 Feb 2023
- 2023Hierarchical Perception Adversarial Learning Framework for Compressed Sensing MRI27 Jan 2023
- 2023Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Review9 Jan 2023
- 2022Unsupervised Domain Adaptation for Automated Knee Osteoarthritis Phenotype Classification14 Dec 2022
- 2022Content-Based Medical Image Retrieval with Opponent Class Adaptive Margin Loss22 Nov 2022
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey14 Nov 2022
- 2022One-shot Generative Prior in Hankel-k-space for Parallel Imaging Reconstruction15 Aug 2022
- 2022COVID-19 Detection from Respiratory Sounds with Hierarchical Spectrogram Transformers19 Jul 2022
- 2022Multi-branch Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstruction18 Jul 2022
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Models17 Jul 2022
50 newest of 76 All 76 (JSON)
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
- 2022Adaptive Diffusion Priors for Accelerated MRI Reconstructioncited by 117
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translationcited by 26
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstructioncited by 13
- 2023SADIR: Shape-Aware Diffusion Models for 3D Image Reconstructioncited by 12
- 2023CDiffMR: Can We Replace the Gaussian Noise with K-Space Undersampling for Fast MRI?cited by 11
- 2023Score-based Diffusion Models With Self-supervised Learning For Accelerated 3D Multi-contrast Cardiac Magnetic Resonance Imagingcited by 4
- 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translation10 May 2024
- 2023Score-based Diffusion Models With Self-supervised Learning For Accelerated 3D Multi-contrast Cardiac Magnetic Resonance Imaging7 Oct 2023
- 2023SADIR: Shape-Aware Diffusion Models for 3D Image Reconstruction6 Sep 2023
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstruction2 Aug 2023
- 2023CDiffMR: Can We Replace the Gaussian Noise with K-Space Undersampling for Fast MRI?25 Jun 2023
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey14 Nov 2022
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Models17 Jul 2022
- 2022Adaptive Diffusion Priors for Accelerated MRI Reconstruction12 Jul 2022
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modelingcited by 26
- 2024MambaRecon: MRI Reconstruction with Structured State Space Modelscited by 7
- 2025DH-Mamba: Exploring Dual-domain Hierarchical State Space Models for MRI Reconstructioncited by 3
- 2025HiFi-Mamba: Dual-Stream W-Laplacian Enhanced Mamba for High-Fidelity MRI Reconstructioncited by 3
- 2026SO-Mamba: State-Ownership Mamba for Unrolled MRI Reconstructioncited by 0
- 2026SO-Mamba: State-Ownership Mamba for Unrolled MRI Reconstruction21 May 2026
- 2025HiFi-Mamba: Dual-Stream W-Laplacian Enhanced Mamba for High-Fidelity MRI Reconstruction7 Aug 2025
- 2025DH-Mamba: Exploring Dual-domain Hierarchical State Space Models for MRI Reconstruction14 Jan 2025
- 2024MambaRecon: MRI Reconstruction with Structured State Space Models19 Sep 2024
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling22 May 2024
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
- 2023Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Reviewcited by 62
- 2022Swin Transformer for Fast MRIcited by 56
- 2022ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformercited by 52
- 2021Multi-Modal Transformer for Accelerated MR Imagingcited by 42
- 2022Transformers in Medical Image Analysis: A Reviewcited by 41
- 2022One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputationcited by 40
- 2021Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative modelscited by 36
- 2021Specificity-Preserving Federated Learning for MR Image Reconstructioncited by 35
- 2022Class-Aware Adversarial Transformers for Medical Image Segmentationcited by 33
- 2022Federated Learning of Generative Image Priors for MRI Reconstructioncited by 33
12 most cited of 62 All 62 (JSON)
- 2026Frequency-Hierarchical Active k-Space Sampling for Diagnostic MRI22 Jul 2026
- 2026Trustworthy MRI Reconstruction via Bayesian Uncertainty Quantification with Sparsity Prior Models15 Jun 2026
- 2026Bayesian Uncertainty-Aware MRI Reconstruction13 Mar 2026
- 2025Reconstruction of Optical Coherence Tomography Images from Wavelength-space Using Deep-learning23 Sep 2025
- 2025Deep learning of personalized priors from past MRI scans enables fast, quality-enhanced point-of-care MRI with low-cost systems5 May 2025
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstruction10 Mar 2025
- 2025Benchmarking Self-Supervised Learning Methods for Accelerated MRI Reconstruction19 Feb 2025
- 2025Generative Autoregressive Transformers for Model-Agnostic Federated MRI Reconstruction6 Feb 2025
- 2025Advancing MRI Reconstruction: A Systematic Review of Deep Learning and Compressed Sensing Integration24 Jan 2025
- 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversification14 Dec 2024
- 2024Physics-Driven Autoregressive State Space Models for Medical Image Reconstruction12 Dec 2024
- 2024DenoMamba: A fused state-space model for low-dose CT denoising19 Sep 2024
12 newest of 62 All 62 (JSON)