Attention-aware non-rigid image registration for accelerated MR imaging
Not on the map. Why?
Abstract (arXiv)
Accurate motion estimation at high acceleration factors enables rapid motion-compensated reconstruction in Magnetic Resonance Imaging (MRI) without compromising the diagnostic image quality. In this work, we introduce an attention-aware deep learning-based framework that can perform non-rigid pairwise registration for fully sampled and accelerated MRI. We extract local visual representations to build similarity maps between the registered image pairs at multiple resolution levels and additionally leverage long-range contextual information using a transformer-based module to alleviate ambiguities in the presence of artifacts caused by undersampling. We combine local and global dependencies to perform simultaneous coarse and fine motion estimation. The proposed method was evaluated on in-house acquired fully sampled and accelerated data of 101 patients and 62 healthy subjects undergoing cardiac and thoracic MRI. The impact of motion estimation accuracy on the downstream task of motion-compensated reconstruction was analyzed. We demonstrate that our model derives reliable and consistent motion fields across different sampling trajectories (Cartesian and radial) and acceleration factors of up to 16x for cardiac motion and 30x for respiratory motion and achieves superior image quality in motion-compensated reconstruction qualitatively and quantitatively compared to conventional and recent deep learning-based approaches. The code is publicly available at https://github.com/lab-midas/GMARAFT.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 23 of its 77 references that are in the map. First posted on arXiv 26 Apr 2024.
Builds on
23 of 77 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2017Non-local Neural Networkscited by 2,293
- 2018Group Normalizationcited by 1,524
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 675
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 553
- 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 224
- 2020Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networkscited by 107
- 2021ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registrationcited by 87
11 more
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 85
- 2020CycleMorph: Cycle Consistent Unsupervised Deformable Image Registrationcited by 79
- 2017End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Networkcited by 75
- 2017A Deep Cascade of Convolutional Neural Networks for MR Image Reconstructioncited by 74
- 2021Conditional Deformable Image Registration with Convolutional Neural Networkcited by 59
- 2021High-Resolution Optical Flow from 1D Attention and Correlationcited by 54
- 2021Learning Optical Flow from a Few Matchescited by 53
- 2018Joint Learning of Motion Estimation and Segmentation for Cardiac MR Image Sequencescited by 47
- 2022XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attentioncited by 46
- 2021LAPNet: Non-rigid Registration derived in k-space for Magnetic Resonance Imagingcited by 11
- 2022Learning-based and unrolled motion-compensated reconstruction for cardiac MR CINE imagingcited by 11
Built on by
Citing papers per year: 2024: 2; 2025: 2.
4 papers.
- 2025Towards Cardiac MRI Foundation Models: Comprehensive Visual-Tabular Representations for Whole-Heart Assessment and Beyondcited by 14
- 2024Mamba? Catch The Hype Or Rethink What Really Helps for Image Registrationcited by 9
- 2025An unsupervised method for MRI recovery: Deep image prior with structured sparsitycited by 2
- 2024Highly efficient non-rigid registration in k-space with application to cardiac Magnetic Resonance Imagingcited by 0
- 2025Towards Cardiac MRI Foundation Models: Comprehensive Visual-Tabular Representations for Whole-Heart Assessment and Beyond17 Apr 2025
- 2025An unsupervised method for MRI recovery: Deep image prior with structured sparsity2 Jan 2025
- 2024Highly efficient non-rigid registration in k-space with application to cardiac Magnetic Resonance Imaging24 Oct 2024
- 2024Mamba? Catch The Hype Or Rethink What Really Helps for Image Registration27 Jul 2024