Contrastive Learning for Local and Global Learning MRI Reconstruction
Not on the map. Why?
Abstract (arXiv)
Magnetic Resonance Imaging (MRI) is an important medical imaging modality, while it requires a long acquisition time. To reduce the acquisition time, various methods have been proposed. However, these methods failed to reconstruct images with a clear structure for two main reasons. Firstly, similar patches widely exist in MR images, while most previous deep learning-based methods ignore this property and only adopt CNN to learn local information. Secondly, the existing methods only use clear images to constrain the upper bound of the solution space, while the lower bound is not constrained, so that a better parameter of the network cannot be obtained. To address these problems, we propose a Contrastive Learning for Local and Global Learning MRI Reconstruction Network (CLGNet). Specifically, according to the Fourier theory, each value in the Fourier domain is calculated from all the values in Spatial domain. Therefore, we propose a Spatial and Fourier Layer (SFL) to simultaneously learn the local and global information in Spatial and Fourier domains. Moreover, compared with self-attention and transformer, the SFL has a stronger learning ability and can achieve better performance in less time. Based on the SFL, we design a Spatial and Fourier Residual block as the main component of our model. Meanwhile, to constrain the lower bound and upper bound of the solution space, we introduce contrastive learning, which can pull the result closer to the clear image and push the result further away from the undersampled image. Extensive experimental results on different datasets and acceleration rates demonstrate that the proposed CLGNet achieves new state-of-the-art results.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 24 of its 49 references that are in the map. First posted on arXiv 30 Nov 2021.
Builds on
24 of 49 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,712
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,876
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,469
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,259
- 2019Contrastive Representation Distillationcited by 739
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 718
12 more
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 467
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 432
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
- 2020Rethinking Transformer-based Set Prediction for Object Detectioncited by 156
- 2018A2-Nets: Double Attention Networkscited by 136
- 2017A Deep Cascade of Convolutional Neural Networks for MR Image Reconstructioncited by 74
- 2020DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction with Deep T1 Priorcited by 73
- 2021Task Transformer Network for Joint MRI Reconstruction and Super-Resolutioncited by 58
- 2021Towards Compact Single Image Super-Resolution via Contrastive Self-distillationcited by 24
- 2019Model Learning: Primal Dual Networks for Fast MR imagingcited by 22
- 2021Dual-Octave Convolution for Accelerated Parallel MR Image Reconstructioncited by 12
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1.
2 papers.