Global k-Space Interpolation for Dynamic MRI Reconstruction using Masked Image Modeling
Not on the map. Why?
Abstract (arXiv)
In dynamic Magnetic Resonance Imaging (MRI), k-space is typically undersampled due to limited scan time, resulting in aliasing artifacts in the image domain. Hence, dynamic MR reconstruction requires not only modeling spatial frequency components in the x and y directions of k-space but also considering temporal redundancy. Most previous works rely on image-domain regularizers (priors) to conduct MR reconstruction. In contrast, we focus on interpolating the undersampled k-space before obtaining images with Fourier transform. In this work, we connect masked image modeling with k-space interpolation and propose a novel Transformer-based k-space Global Interpolation Network, termed k-GIN. Our k-GIN learns global dependencies among low- and high-frequency components of 2D+t k-space and uses it to interpolate unsampled data. Further, we propose a novel k-space Iterative Refinement Module (k-IRM) to enhance the high-frequency components learning. We evaluate our approach on 92 in-house 2D+t cardiac MR subjects and compare it to MR reconstruction methods with image-domain regularizers. Experiments show that our proposed k-space interpolation method quantitatively and qualitatively outperforms baseline methods. Importantly, the proposed approach achieves substantially higher robustness and generalizability in cases of highly-undersampled MR data. For video presentation, poster, GIF results and code please check our project page: https://jzpeterpan.github.io/k-gin.github.io/.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 24 Jul 2023.
Builds on
20 of 40 references.
References · 20
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 468
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
- 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
- 2021Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformerscited by 76
- 2022Swin Transformer for Fast MRIcited by 56
8 more
- 2022Neural Implicit k-Space for Binning-free Non-Cartesian Cardiac MR Imagingcited by 35
- 2020Deep Low-rank plus Sparse Network for Dynamic MR Imagingcited by 32
- 2019LORAKI: Autocalibrated Recurrent Neural Networks for Autoregressive MRI Reconstruction in k-Spacecited by 27
- 2019Spatio-Temporal Deep Learning-Based Undersampling Artefact Reduction for 2D Radial Cine MRI with Limited Datacited by 14
- 2022Learning-based and unrolled motion-compensated reconstruction for cardiac MR CINE imagingcited by 11
- 2023Motion-compensated MR CINE reconstruction with reconstruction-driven motion estimationcited by 8
- 2022A Projection-Based K-space Transformer Network for Undersampled Radial MRI Reconstruction with Limited Training Subjectscited by 4
- 2022K-Space Transformer for Undersampled MRI Reconstructioncited by 3
Built on by
Citing papers per year: 2024: 6; 2025: 1; 2026: 1.
8 papers.
- 2024Masked Image Modeling: A Surveycited by 28
- 2024Whole Heart 3D+T Representation Learning Through Sparse 2D Cardiac MR Imagescited by 9
- 2024Classification, Regression and Segmentation directly from k-Space in Cardiac MRIcited by 8
- 2024Direct Cardiac Segmentation from Undersampled K-space Using Transformerscited by 5
- 2024Score-based Generative Priors Guided Model-driven Network for MRI Reconstructioncited by 3
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstructioncited by 1
- 2024Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Modelcited by 0
- 2026No Image, No Problem: End-to-End Multi-Task Cardiac Analysis from Undersampled k-Spacecited by 0
- 2026No Image, No Problem: End-to-End Multi-Task Cardiac Analysis from Undersampled k-Space10 Mar 2026
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstruction10 Mar 2025
- 2024Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Model6 Nov 2024
- 2024Masked Image Modeling: A Survey13 Aug 2024
- 2024Classification, Regression and Segmentation directly from k-Space in Cardiac MRI29 Jul 2024
- 2024Whole Heart 3D+T Representation Learning Through Sparse 2D Cardiac MR Images1 Jun 2024
- 2024Direct Cardiac Segmentation from Undersampled K-space Using Transformers31 May 2024
- 2024Score-based Generative Priors Guided Model-driven Network for MRI Reconstruction5 May 2024