mlsanityData to 7 Oct 2026

Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers

arXiv 2105.08059 ↗First posted 15 May 2021eess.IV cs.CV cs.LGcited by 76

Not on the map. Why?

Abstract (arXiv)

Supervised reconstruction models are characteristically trained on matched pairs of undersampled and fully-sampled data to capture an MRI prior, along with supervision regarding the imaging operator to enforce data consistency. To reduce supervision requirements, the recent deep image prior framework instead conjoins untrained MRI priors with the imaging operator during inference. Yet, canonical convolutional architectures are suboptimal in capturing long-range relationships, and priors based on randomly initialized networks may yield suboptimal performance. To address these limitations, here we introduce a novel unsupervised MRI reconstruction method based on zero-Shot Learned Adversarial TransformERs (SLATER). SLATER embodies a deep adversarial network with cross-attention transformers to map noise and latent variables onto coil-combined MR images. During pre-training, this unconditional network learns a high-quality MRI prior in an unsupervised generative modeling task. During inference, a zero-shot reconstruction is then performed by incorporating the imaging operator and optimizing the prior to maximize consistency to undersampled data. Comprehensive experiments on brain MRI datasets clearly demonstrate the superior performance of SLATER against state-of-the-art unsupervised methods.

Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). Builds on 58 of its 111 references that are in the map. First posted on arXiv 15 May 2021.

Builds on

58 of 111 references.

References · 58

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  5. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  6. 2019Generating Long Sequences with Sparse Transformerscited by 1,523
  7. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
  8. 2017Deep Image Priorcited by 1,097
  9. 2016An overview of gradient descent optimization algorithmscited by 1,021
  10. 2018Self-Attention Generative Adversarial Networkscited by 809
  11. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  12. 2018Which Training Methods for GANs do actually Converge?cited by 672
38 more
  1. 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
  2. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  3. 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
  4. 2021GAN Inversion: A Surveycited by 366
  5. 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
  6. 2017Learned Primal-dual Reconstructioncited by 251
  7. 2017Image reconstruction by domain transform manifold learningcited by 231
  8. 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
  9. 2021Generative Adversarial Transformerscited by 120
  10. 2017Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstructioncited by 105
  11. 2019Invertible generative models for inverse problems: mitigating representation error and dataset biascited by 93
  12. 2017Deep learning for undersampled MRI reconstructioncited by 91
  13. 2017A Deep Cascade of Convolutional Neural Networks for MR Image Reconstructioncited by 74
  14. 2019Time-Dependent Deep Image Prior for Dynamic MRIcited by 70
  15. 2019RARE: Image Reconstruction using Deep Priors Learned without Ground Truthcited by 64
  16. 2018Deep Residual Learning for Accelerated MRI using Magnitude and Phase Networkscited by 53
  17. 2017A Transfer-Learning Approach for Accelerated MRI using Deep Neural Networkscited by 43
  18. 2020Compressive sensing with un-trained neural networks: Gradient descent finds the smoothest approximationcited by 39
  19. 2020Synthetic Learning: Learn From Distributed Asynchronized Discriminator GAN Without Sharing Medical Image Datacited by 38
  20. 2017MR image reconstruction using deep density priorscited by 37
  21. 2017Deep Learning with Domain Adaptation for Accelerated Projection-Reconstruction MRcited by 31
  22. 2020Unpaired Deep Learning for Accelerated MRI using Optimal Transport Driven CycleGANcited by 28
  23. 2019LORAKI: Autocalibrated Recurrent Neural Networks for Autoregressive MRI Reconstruction in k-Spacecited by 27
  24. 2018DIMENSION: Dynamic MR Imaging with Both K-space and Spatial Prior Knowledge Obtained via Multi-Supervised Network Trainingcited by 26
  25. 2018Quantitative Susceptibility Mapping using Deep Neural Network: QSMnetcited by 24
  26. 2020Unsupervised MRI Reconstruction with Generative Adversarial Networkscited by 24
  27. 2019Model Learning: Primal Dual Networks for Fast MR imagingcited by 22
  28. 2018Real-time Cardiovascular MR with Spatio-temporal Artifact Suppression using Deep Learning - Proof of Concept in Congenital Heart Diseasecited by 18
  29. 2018A Provably Convergent Scheme for Compressive Sensing under Random Generative Priorscited by 15
  30. 2019Wasserstein GANs for MR Imaging: from Paired to Unpaired Trainingcited by 14
  31. 2020Neural Network-based Reconstruction in Compressed Sensing MRI Without Fully-sampled Training Datacited by 14
  32. 2020Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRIcited by 13
  33. 2020ENSURE: A General Approach for Unsupervised Training of Deep Image Reconstruction Algorithmscited by 13
  34. 2019Image Reconstruction with Low-rankness and Self-consistency of k-space Data in Parallel MRIcited by 12
  35. 2020A Sparse Model-inspired Deep Thresholding Network for Exponential Signal Reconstruction -- Application in Fast Biological Spectroscopycited by 12
  36. 2019Joint multi-contrast Variational Network reconstruction (jVN) with application to rapid 2D and 3D imagingcited by 11
  37. 2020DC-WCNN: A deep cascade of wavelet based convolutional neural networks for MR Image Reconstructioncited by 8
  38. 2020Two-Stage Deep Learning for Accelerated 3D Time-of-Flight MRA without Matched Training Datacited by 7

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 25; 2023: 23; 2024: 7; 2025: 9; 2026: 4.

76 papers.

Sort:

By area:

  1. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
  2. 2022Transformers in Medical Imaging: A Surveycited by 245
  3. 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
  4. 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
  5. 2022Adaptive Diffusion Priors for Accelerated MRI Reconstructioncited by 117
  6. 2023Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Reviewcited by 62
  7. 2022Swin Transformer for Fast MRIcited by 56
  8. 2022ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformercited by 52
  9. 2021Multi-Modal Transformer for Accelerated MR Imagingcited by 42
  10. 2022Transformers in Medical Image Analysis: A Reviewcited by 41
  11. 2022One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputationcited by 40
  12. 2021Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative modelscited by 36
38 more
  1. 2021Specificity-Preserving Federated Learning for MR Image Reconstructioncited by 35
  2. 2022Class-Aware Adversarial Transformers for Medical Image Segmentationcited by 33
  3. 2022Federated Learning of Generative Image Priors for MRI Reconstructioncited by 33
  4. 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
  5. 2022DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstructioncited by 30
  6. 2022HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstructioncited by 30
  7. 2024Self-Consistent Recursive Diffusion Bridge for Medical Image Translationcited by 26
  8. 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modelingcited by 26
  9. 2022BolT: Fused Window Transformers for fMRI Time Series Analysiscited by 23
  10. 2022One Model to Unite Them All: Personalized Federated Learning of Multi-Contrast MRI Synthesiscited by 22
  11. 2023Transformers in Healthcare: A Surveycited by 17
  12. 2021CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translationcited by 15
  13. 2023DreaMR: Diffusion-driven Counterfactual Explanation for Functional MRIcited by 14
  14. 2021A review and experimental evaluation of deep learning methods for MRI reconstructioncited by 13
  15. 2023Dual-Domain Self-Supervised Learning for Accelerated Non-Cartesian MRI Reconstructioncited by 13
  16. 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstructioncited by 13
  17. 2023LIT-Former: Linking In-plane and Through-plane Transformers for Simultaneous CT Image Denoising and Deblurringcited by 12
  18. 2023SADIR: Shape-Aware Diffusion Models for 3D Image Reconstructioncited by 12
  19. 2022One-shot Generative Prior in Hankel-k-space for Parallel Imaging Reconstructioncited by 11
  20. 2023CDiffMR: Can We Replace the Gaussian Noise with K-Space Undersampling for Fast MRI?cited by 11
  21. 2024DenoMamba: A fused state-space model for low-dose CT denoisingcited by 11
  22. 2021High-Resolution Pelvic MRI Reconstruction Using a Generative Adversarial Network with Attention and Cyclic Losscited by 10
  23. 2023Transformer-based Generative Adversarial Networks in Computer Vision: A Comprehensive Surveycited by 10
  24. 2023Cross-Modal Vertical Federated Learning for MRI Reconstructioncited by 9
  25. 2023TransMRSR: Transformer-based Self-Distilled Generative Prior for Brain MRI Super-Resolutioncited by 9
  26. 2023Global k-Space Interpolation for Dynamic MRI Reconstruction using Masked Image Modelingcited by 8
  27. 2022MISSU: 3D Medical Image Segmentation via Self-distilling TransUNetcited by 7
  28. 2022Content-Based Medical Image Retrieval with Opponent Class Adaptive Margin Losscited by 7
  29. 2023FD-Net: An Unsupervised Deep Forward-Distortion Model for Susceptibility Artifact Correction in EPIcited by 7
  30. 2024MambaRecon: MRI Reconstruction with Structured State Space Modelscited by 7
  31. 2024Physics-Driven Autoregressive State Space Models for Medical Image Reconstructioncited by 7
  32. 2022Validation and Generalizability of Self-Supervised Image Reconstruction Methods for Undersampled MRIcited by 6
  33. 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversificationcited by 6
  34. 2022Undersampled MRI Reconstruction with Side Information-Guided Normalisationcited by 5
  35. 2023BlindHarmony: "Blind" Harmonization for MR Images via Flow modelcited by 5
  36. 2023K-band: Self-supervised MRI Reconstruction via Stochastic Gradient Descent over K-space Subsetscited by 5
  37. 2023Federated Pseudo Modality Generation for Incomplete Multi-Modal MRI Reconstructioncited by 5
  38. 2022Multi-branch Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstructioncited by 4

50 most cited of 76 All 76 (JSON)