mlsanityData to 7 Oct 2026

Global k-Space Interpolation for Dynamic MRI Reconstruction using Masked Image Modeling

arXiv 2307.12672 ↗First posted 24 Jul 2023eess.IV cs.CV cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

In dynamic Magnetic Resonance Imaging (MRI), k-space is typically undersampled due to limited scan time, resulting in aliasing artifacts in the image domain. Hence, dynamic MR reconstruction requires not only modeling spatial frequency components in the x and y directions of k-space but also considering temporal redundancy. Most previous works rely on image-domain regularizers (priors) to conduct MR reconstruction. In contrast, we focus on interpolating the undersampled k-space before obtaining images with Fourier transform. In this work, we connect masked image modeling with k-space interpolation and propose a novel Transformer-based k-space Global Interpolation Network, termed k-GIN. Our k-GIN learns global dependencies among low- and high-frequency components of 2D+t k-space and uses it to interpolate unsampled data. Further, we propose a novel k-space Iterative Refinement Module (k-IRM) to enhance the high-frequency components learning. We evaluate our approach on 92 in-house 2D+t cardiac MR subjects and compare it to MR reconstruction methods with image-domain regularizers. Experiments show that our proposed k-space interpolation method quantitatively and qualitatively outperforms baseline methods. Importantly, the proposed approach achieves substantially higher robustness and generalizability in cases of highly-undersampled MR data. For video presentation, poster, GIF results and code please check our project page: https://jzpeterpan.github.io/k-gin.github.io/.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 24 Jul 2023.

Builds on

20 of 40 references.

References · 20

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  4. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  5. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  6. 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 468
  7. 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
  8. 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
  9. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  10. 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
  11. 2021Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformerscited by 76
  12. 2022Swin Transformer for Fast MRIcited by 56
8 more
  1. 2022Neural Implicit k-Space for Binning-free Non-Cartesian Cardiac MR Imagingcited by 35
  2. 2020Deep Low-rank plus Sparse Network for Dynamic MR Imagingcited by 32
  3. 2019LORAKI: Autocalibrated Recurrent Neural Networks for Autoregressive MRI Reconstruction in k-Spacecited by 27
  4. 2019Spatio-Temporal Deep Learning-Based Undersampling Artefact Reduction for 2D Radial Cine MRI with Limited Datacited by 14
  5. 2022Learning-based and unrolled motion-compensated reconstruction for cardiac MR CINE imagingcited by 11
  6. 2023Motion-compensated MR CINE reconstruction with reconstruction-driven motion estimationcited by 8
  7. 2022A Projection-Based K-space Transformer Network for Undersampled Radial MRI Reconstruction with Limited Training Subjectscited by 4
  8. 2022K-Space Transformer for Undersampled MRI Reconstructioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 1; 2026: 1.

8 papers.