mlsanityData to 7 Oct 2026

DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstruction

arXiv 2201.10776 ↗First posted 26 Jan 2022eess.IV cs.CV cs.LGcited by 30

Not on the map. Why?

Abstract (arXiv)

Multi-contrast MRI (MC-MRI) captures multiple complementary imaging modalities to aid in radiological decision-making. Given the need for lowering the time cost of multiple acquisitions, current deep accelerated MRI reconstruction networks focus on exploiting the redundancy between multiple contrasts. However, existing works are largely supervised with paired data and/or prohibitively expensive fully-sampled MRI sequences. Further, reconstruction networks typically rely on convolutional architectures which are limited in their capacity to model long-range interactions and may lead to suboptimal recovery of fine anatomical detail. To these ends, we present a dual-domain self-supervised transformer (DSFormer) for accelerated MC-MRI reconstruction. DSFormer develops a deep conditional cascade transformer (DCCT) consisting of several cascaded Swin transformer reconstruction networks (SwinRN) trained under two deep conditioning strategies to enable MC-MRI information sharing. We further present a dual-domain (image and k-space) self-supervised learning strategy for DCCT to alleviate the costs of acquiring fully sampled training data. DSFormer generates high-fidelity reconstructions which experimentally outperform current fully-supervised baselines. Moreover, we find that DSFormer achieves nearly the same performance when trained either with full supervision or with our proposed dual-domain self-supervision.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 27 of its 49 references that are in the map. First posted on arXiv 26 Jan 2022.

Builds on

27 of 49 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  6. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  7. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  8. 2020Pre-Trained Image Processing Transformercited by 891
  9. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  10. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
  11. 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 464
  12. 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
15 more
  1. 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
  2. 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
  3. 2017Image reconstruction by domain transform manifold learningcited by 231
  4. 2017Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstructioncited by 105
  5. 2021Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformerscited by 76
  6. 2020DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction with Deep T1 Priorcited by 72
  7. 2019Reducing Uncertainty in Undersampled MRI Reconstruction with Active Acquisitioncited by 55
  8. 2021Zero-Shot Self-Supervised Learning for MRI Reconstructioncited by 53
  9. 2020Active MR k-space Sampling with Reinforcement Learningcited by 45
  10. 2020Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problemscited by 38
  11. 2021Over-and-Under Complete Convolutional RNN for MRI Reconstructioncited by 29
  12. 2021Self-Supervised Learning for MRI Reconstruction with a Parallel Network Training Frameworkcited by 26
  13. 2018A Deep Information Sharing Network for Multi-contrast Compressed Sensing MRI Reconstructioncited by 22
  14. 2021Universal Undersampled MRI Reconstructioncited by 15
  15. 2020Neural Network-based Reconstruction in Compressed Sensing MRI Without Fully-sampled Training Datacited by 14

Built on by

Cited by year

Citing papers per year: 2022: 4; 2023: 13; 2024: 9; 2025: 4.

30 papers.

Sort:

By area:

  1. 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
  2. 2023Transformers in Healthcare: A Surveycited by 17
  3. 2024MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusioncited by 15
  4. 2022Scaling Laws For Deep Learning Based Image Reconstructioncited by 14
  5. 2023Dual-Domain Self-Supervised Learning for Accelerated Non-Cartesian MRI Reconstructioncited by 13
  6. 20242.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correctioncited by 13
  7. 2022Vision Transformers in Medical Imaging: A Reviewcited by 8
  8. 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methodscited by 8
  9. 2023Self-Supervised Scalable Deep Compressed Sensingcited by 8
  10. 2024MambaRecon: MRI Reconstruction with Structured State Space Modelscited by 7
  11. 2024Physics-Driven Autoregressive State Space Models for Medical Image Reconstructioncited by 7
  12. 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversificationcited by 6
18 more
  1. 2022Undersampled MRI Reconstruction with Side Information-Guided Normalisationcited by 5
  2. 2023Spatial and Modal Optimal Transport for Fast Cross-Modal MRI Reconstructioncited by 5
  3. 2023Joint Supervised and Self-supervised Learning for MRI Reconstructioncited by 4
  4. 2023FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-institutional Low-count PET Denoisingcited by 3
  5. 2023Generalizing Supervised Deep Learning MRI Reconstruction to Multiple and Unseen Contrasts using Meta-Learning Hypernetworkscited by 2
  6. 2024Deep-ER: Deep Learning ECCENTRIC Reconstruction for fast high-resolution neurometabolic imagingcited by 2
  7. 2023Rethinking Dual-Domain Undersampled MRI reconstruction: domain-specific design from the perspective of the receptive fieldcited by 1
  8. 2023SDLFormer: A Sparse and Dense Locality-enhanced Transformer for Accelerated MR Image Reconstructioncited by 1
  9. 2024DuDoUniNeXt: Dual-domain unified hybrid model for single and multi-contrast undersampled MRI reconstructioncited by 1
  10. 2024Accelerating MRI with Longitudinally-informed Latent Posterior Samplingcited by 1
  11. 2025Re-Visible Dual-Domain Self-Supervised Deep Unfolding Network for MRI Reconstructioncited by 1
  12. 2025A Comprehensive Survey on Magnetic Resonance Image Reconstructioncited by 1
  13. 2023Exploring the Power of Generative Deep Learning for Image-to-Image Translation and MRI Reconstruction: A Cross-Domain Reviewcited by 0
  14. 2023Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Networkcited by 0
  15. 2023Unsupervised Adaptive Implicit Neural Representation Learning for Scan-Specific MRI Reconstructioncited by 0
  16. 2024Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Modelcited by 0
  17. 2025Dual-domain Multi-path Self-supervised Diffusion Model for Accelerated MRI Reconstructioncited by 0
  18. 2025FLAT: FLow-Aligned Training of Unrolled Networks for MRI Reconstructioncited by 0