DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstruction
Not on the map. Why?
Abstract (arXiv)
Multi-contrast MRI (MC-MRI) captures multiple complementary imaging modalities to aid in radiological decision-making. Given the need for lowering the time cost of multiple acquisitions, current deep accelerated MRI reconstruction networks focus on exploiting the redundancy between multiple contrasts. However, existing works are largely supervised with paired data and/or prohibitively expensive fully-sampled MRI sequences. Further, reconstruction networks typically rely on convolutional architectures which are limited in their capacity to model long-range interactions and may lead to suboptimal recovery of fine anatomical detail. To these ends, we present a dual-domain self-supervised transformer (DSFormer) for accelerated MC-MRI reconstruction. DSFormer develops a deep conditional cascade transformer (DCCT) consisting of several cascaded Swin transformer reconstruction networks (SwinRN) trained under two deep conditioning strategies to enable MC-MRI information sharing. We further present a dual-domain (image and k-space) self-supervised learning strategy for DCCT to alleviate the costs of acquiring fully sampled training data. DSFormer generates high-fidelity reconstructions which experimentally outperform current fully-supervised baselines. Moreover, we find that DSFormer achieves nearly the same performance when trained either with full supervision or with our proposed dual-domain self-supervision.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 27 of its 49 references that are in the map. First posted on arXiv 26 Jan 2022.
Builds on
27 of 49 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2020Pre-Trained Image Processing Transformercited by 891
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 464
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
15 more
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
- 2017Image reconstruction by domain transform manifold learningcited by 231
- 2017Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstructioncited by 105
- 2021Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformerscited by 76
- 2020DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction with Deep T1 Priorcited by 72
- 2019Reducing Uncertainty in Undersampled MRI Reconstruction with Active Acquisitioncited by 55
- 2021Zero-Shot Self-Supervised Learning for MRI Reconstructioncited by 53
- 2020Active MR k-space Sampling with Reinforcement Learningcited by 45
- 2020Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problemscited by 38
- 2021Over-and-Under Complete Convolutional RNN for MRI Reconstructioncited by 29
- 2021Self-Supervised Learning for MRI Reconstruction with a Parallel Network Training Frameworkcited by 26
- 2018A Deep Information Sharing Network for Multi-contrast Compressed Sensing MRI Reconstructioncited by 22
- 2021Universal Undersampled MRI Reconstructioncited by 15
- 2020Neural Network-based Reconstruction in Compressed Sensing MRI Without Fully-sampled Training Datacited by 14
Built on by
Citing papers per year: 2022: 4; 2023: 13; 2024: 9; 2025: 4.
30 papers.
Sort:
By area:
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2023Transformers in Healthcare: A Surveycited by 17
- 2024MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusioncited by 15
- 2022Scaling Laws For Deep Learning Based Image Reconstructioncited by 14
- 2023Dual-Domain Self-Supervised Learning for Accelerated Non-Cartesian MRI Reconstructioncited by 13
- 20242.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correctioncited by 13
- 2022Vision Transformers in Medical Imaging: A Reviewcited by 8
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methodscited by 8
- 2023Self-Supervised Scalable Deep Compressed Sensingcited by 8
- 2024MambaRecon: MRI Reconstruction with Structured State Space Modelscited by 7
- 2024Physics-Driven Autoregressive State Space Models for Medical Image Reconstructioncited by 7
- 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversificationcited by 6
18 more
- 2022Undersampled MRI Reconstruction with Side Information-Guided Normalisationcited by 5
- 2023Spatial and Modal Optimal Transport for Fast Cross-Modal MRI Reconstructioncited by 5
- 2023Joint Supervised and Self-supervised Learning for MRI Reconstructioncited by 4
- 2023FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-institutional Low-count PET Denoisingcited by 3
- 2023Generalizing Supervised Deep Learning MRI Reconstruction to Multiple and Unseen Contrasts using Meta-Learning Hypernetworkscited by 2
- 2024Deep-ER: Deep Learning ECCENTRIC Reconstruction for fast high-resolution neurometabolic imagingcited by 2
- 2023Rethinking Dual-Domain Undersampled MRI reconstruction: domain-specific design from the perspective of the receptive fieldcited by 1
- 2023SDLFormer: A Sparse and Dense Locality-enhanced Transformer for Accelerated MR Image Reconstructioncited by 1
- 2024DuDoUniNeXt: Dual-domain unified hybrid model for single and multi-contrast undersampled MRI reconstructioncited by 1
- 2024Accelerating MRI with Longitudinally-informed Latent Posterior Samplingcited by 1
- 2025Re-Visible Dual-Domain Self-Supervised Deep Unfolding Network for MRI Reconstructioncited by 1
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstructioncited by 1
- 2023Exploring the Power of Generative Deep Learning for Image-to-Image Translation and MRI Reconstruction: A Cross-Domain Reviewcited by 0
- 2023Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Networkcited by 0
- 2023Unsupervised Adaptive Implicit Neural Representation Learning for Scan-Specific MRI Reconstructioncited by 0
- 2024Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Modelcited by 0
- 2025Dual-domain Multi-path Self-supervised Diffusion Model for Accelerated MRI Reconstructioncited by 0
- 2025FLAT: FLow-Aligned Training of Unrolled Networks for MRI Reconstructioncited by 0
- 2025FLAT: FLow-Aligned Training of Unrolled Networks for MRI Reconstruction2 Dec 2025
- 2025Dual-domain Multi-path Self-supervised Diffusion Model for Accelerated MRI Reconstruction24 Mar 2025
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstruction10 Mar 2025
- 2025Re-Visible Dual-Domain Self-Supervised Deep Unfolding Network for MRI Reconstruction7 Jan 2025
- 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversification14 Dec 2024
- 2024Physics-Driven Autoregressive State Space Models for Medical Image Reconstruction12 Dec 2024
- 2024Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Model6 Nov 2024
- 2024Deep-ER: Deep Learning ECCENTRIC Reconstruction for fast high-resolution neurometabolic imaging26 Sep 2024
- 2024MambaRecon: MRI Reconstruction with Structured State Space Models19 Sep 2024
- 2024Accelerating MRI with Longitudinally-informed Latent Posterior Sampling29 Jun 2024
- 2024MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion27 Jun 2024
- 20242.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correction12 Jun 2024
18 more
- 2024DuDoUniNeXt: Dual-domain unified hybrid model for single and multi-contrast undersampled MRI reconstruction8 Mar 2024
- 2023Unsupervised Adaptive Implicit Neural Representation Learning for Scan-Specific MRI Reconstruction1 Dec 2023
- 2023Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network1 Dec 2023
- 2023Joint Supervised and Self-supervised Learning for MRI Reconstruction27 Nov 2023
- 2023Self-Supervised Scalable Deep Compressed Sensing26 Aug 2023
- 2023SDLFormer: A Sparse and Dense Locality-enhanced Transformer for Accelerated MR Image Reconstruction8 Aug 2023
- 2023Generalizing Supervised Deep Learning MRI Reconstruction to Multiple and Unseen Contrasts using Meta-Learning Hypernetworks13 Jul 2023
- 2023Transformers in Healthcare: A Survey30 Jun 2023
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methods30 May 2023
- 2023Spatial and Modal Optimal Transport for Fast Cross-Modal MRI Reconstruction4 May 2023
- 2023FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-institutional Low-count PET Denoising2 Apr 2023
- 2023Rethinking Dual-Domain Undersampled MRI reconstruction: domain-specific design from the perspective of the receptive field19 Mar 2023
- 2023Exploring the Power of Generative Deep Learning for Image-to-Image Translation and MRI Reconstruction: A Cross-Domain Review16 Mar 2023
- 2023Dual-Domain Self-Supervised Learning for Accelerated Non-Cartesian MRI Reconstruction18 Feb 2023
- 2022Vision Transformers in Medical Imaging: A Review18 Nov 2022
- 2022Scaling Laws For Deep Learning Based Image Reconstruction27 Sep 2022
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives2 Jun 2022
- 2022Undersampled MRI Reconstruction with Side Information-Guided Normalisation7 Mar 2022
- 20242.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correctioncited by 13
- 2024Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Modelcited by 0
- 2025Dual-domain Multi-path Self-supervised Diffusion Model for Accelerated MRI Reconstructioncited by 0
- 2025FLAT: FLow-Aligned Training of Unrolled Networks for MRI Reconstructioncited by 0
- 2025FLAT: FLow-Aligned Training of Unrolled Networks for MRI Reconstruction2 Dec 2025
- 2025Dual-domain Multi-path Self-supervised Diffusion Model for Accelerated MRI Reconstruction24 Mar 2025
- 2024Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Model6 Nov 2024
- 20242.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correction12 Jun 2024
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 32
- 2023Transformers in Healthcare: A Surveycited by 17
- 2022Scaling Laws For Deep Learning Based Image Reconstructioncited by 14
- 2023Dual-Domain Self-Supervised Learning for Accelerated Non-Cartesian MRI Reconstructioncited by 13
- 2022Vision Transformers in Medical Imaging: A Reviewcited by 8
- 2023Analyzing the Sample Complexity of Self-Supervised Image Reconstruction Methodscited by 8
- 2023Self-Supervised Scalable Deep Compressed Sensingcited by 8
- 2024Physics-Driven Autoregressive State Space Models for Medical Image Reconstructioncited by 7
- 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversificationcited by 6
- 2022Undersampled MRI Reconstruction with Side Information-Guided Normalisationcited by 5
- 2023Spatial and Modal Optimal Transport for Fast Cross-Modal MRI Reconstructioncited by 5
- 2023Joint Supervised and Self-supervised Learning for MRI Reconstructioncited by 4
12 most cited of 24 All 24 (JSON)
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstruction10 Mar 2025
- 2025Re-Visible Dual-Domain Self-Supervised Deep Unfolding Network for MRI Reconstruction7 Jan 2025
- 2024Boosting ViT-based MRI Reconstruction from the Perspectives of Frequency Modulation, Spatial Purification, and Scale Diversification14 Dec 2024
- 2024Physics-Driven Autoregressive State Space Models for Medical Image Reconstruction12 Dec 2024
- 2024Deep-ER: Deep Learning ECCENTRIC Reconstruction for fast high-resolution neurometabolic imaging26 Sep 2024
- 2024Accelerating MRI with Longitudinally-informed Latent Posterior Sampling29 Jun 2024
- 2024DuDoUniNeXt: Dual-domain unified hybrid model for single and multi-contrast undersampled MRI reconstruction8 Mar 2024
- 2023Unsupervised Adaptive Implicit Neural Representation Learning for Scan-Specific MRI Reconstruction1 Dec 2023
- 2023Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network1 Dec 2023
- 2023Joint Supervised and Self-supervised Learning for MRI Reconstruction27 Nov 2023
- 2023Self-Supervised Scalable Deep Compressed Sensing26 Aug 2023
- 2023SDLFormer: A Sparse and Dense Locality-enhanced Transformer for Accelerated MR Image Reconstruction8 Aug 2023
12 newest of 24 All 24 (JSON)