# Global k-Space Interpolation for Dynamic MRI Reconstruction using Masked Image Modeling

arXiv: https://arxiv.org/abs/2307.12672 · HTML: https://mlsanity.com/paper/2307.12672/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 40 references that are in the map.
- First posted on arXiv 24 Jul 2023.

## Builds on (most cited first, 20 of 20)

- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Masked Autoencoders Are Scalable Vision Learners](https://mlsanity.com/paper/2111.06377/) (2021)
- [FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness](https://mlsanity.com/paper/2205.14135/) (2022)
- [Deformable DETR: Deformable Transformers for End-to-End Object Detection](https://mlsanity.com/paper/2010.04159/) (2020)
- [SimMIM: A Simple Framework for Masked Image Modeling](https://mlsanity.com/paper/2111.09886/) (2021)
- [Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attention](https://mlsanity.com/paper/2102.03902/) (2021)
- [Deep Convolutional Neural Network for Inverse Problems in Imaging](https://mlsanity.com/paper/1611.03679/) (2016)
- [Learning a Variational Network for Reconstruction of Accelerated MRI Data](https://mlsanity.com/paper/1704.00447/) (2017)
- [NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images](https://mlsanity.com/paper/2111.13679/) (2021)
- [A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction](https://mlsanity.com/paper/1704.02422/) (2017)
- [Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers](https://mlsanity.com/paper/2105.08059/) (2021)
- [Swin Transformer for Fast MRI](https://mlsanity.com/paper/2201.03230/) (2022)
- [Neural Implicit k-Space for Binning-free Non-Cartesian Cardiac MR Imaging](https://mlsanity.com/paper/2212.08479/) (2022)
- [Deep Low-rank plus Sparse Network for Dynamic MR Imaging](https://mlsanity.com/paper/2010.13677/) (2020)
- [LORAKI: Autocalibrated Recurrent Neural Networks for Autoregressive MRI Reconstruction in k-Space](https://mlsanity.com/paper/1904.09390/) (2019)
- [Spatio-Temporal Deep Learning-Based Undersampling Artefact Reduction for 2D Radial Cine MRI with Limited Data](https://mlsanity.com/paper/1904.01574/) (2019)
- [Learning-based and unrolled motion-compensated reconstruction for cardiac MR CINE imaging](https://mlsanity.com/paper/2209.03671/) (2022)
- [Motion-compensated MR CINE reconstruction with reconstruction-driven motion estimation](https://mlsanity.com/paper/2302.02504/) (2023)
- [A Projection-Based K-space Transformer Network for Undersampled Radial MRI Reconstruction with Limited Training Subjects](https://mlsanity.com/paper/2206.07219/) (2022)
- [K-Space Transformer for Undersampled MRI Reconstruction](https://mlsanity.com/paper/2206.06947/) (2022)

## Built on by (most cited first, 8 of 8)

- [Masked Image Modeling: A Survey](https://mlsanity.com/paper/2408.06687/) (2024)
- [Whole Heart 3D+T Representation Learning Through Sparse 2D Cardiac MR Images](https://mlsanity.com/paper/2406.00329/) (2024)
- [Classification, Regression and Segmentation directly from k-Space in Cardiac MRI](https://mlsanity.com/paper/2407.20108/) (2024)
- [Direct Cardiac Segmentation from Undersampled K-space Using Transformers](https://mlsanity.com/paper/2406.00192/) (2024)
- [Score-based Generative Priors Guided Model-driven Network for MRI Reconstruction](https://mlsanity.com/paper/2405.02958/) (2024)
- [A Comprehensive Survey on Magnetic Resonance Image Reconstruction](https://mlsanity.com/paper/2503.07097/) (2025)
- [Zero-shot Dynamic MRI Reconstruction with Global-to-local Diffusion Model](https://mlsanity.com/paper/2411.03723/) (2024)
- [No Image, No Problem: End-to-End Multi-Task Cardiac Analysis from Undersampled k-Space](https://mlsanity.com/paper/2603.09945/) (2026)

## Abstract (arXiv)

In dynamic Magnetic Resonance Imaging (MRI), k-space is typically undersampled due to limited scan time, resulting in aliasing artifacts in the image domain. Hence, dynamic MR reconstruction requires not only modeling spatial frequency components in the x and y directions of k-space but also considering temporal redundancy. Most previous works rely on image-domain regularizers (priors) to conduct MR reconstruction. In contrast, we focus on interpolating the undersampled k-space before obtaining images with Fourier transform. In this work, we connect masked image modeling with k-space interpolation and propose a novel Transformer-based k-space Global Interpolation Network, termed k-GIN. Our k-GIN learns global dependencies among low- and high-frequency components of 2D+t k-space and uses it to interpolate unsampled data. Further, we propose a novel k-space Iterative Refinement Module (k-IRM) to enhance the high-frequency components learning. We evaluate our approach on 92 in-house 2D+t cardiac MR subjects and compare it to MR reconstruction methods with image-domain regularizers. Experiments show that our proposed k-space interpolation method quantitatively and qualitatively outperforms baseline methods. Importantly, the proposed approach achieves substantially higher robustness and generalizability in cases of highly-undersampled MR data. For video presentation, poster, GIF results and code please check our project page: https://jzpeterpan.github.io/k-gin.github.io/.