Accelerating Cardiac MRI Reconstruction with CMRatt: An Attention-Driven Approach
Not on the map. Why?
Abstract (arXiv)
Cine cardiac magnetic resonance (CMR) imaging is recognised as the benchmark modality for the comprehensive assessment of cardiac function. Nevertheless, the acquisition process of cine CMR is considered as an impediment due to its prolonged scanning time. One commonly used strategy to expedite the acquisition process is through k-space undersampling, though it comes with a drawback of introducing aliasing effects in the reconstructed image. Lately, deep learning-based methods have shown remarkable results over traditional approaches in rapidly achieving precise CMR reconstructed images. This study aims to explore the untapped potential of attention mechanisms incorporated with a deep learning model within the context of the CMR reconstruction problem. We are motivated by the fact that attention has proven beneficial in downstream tasks such as image classification and segmentation, but has not been systematically analysed in the context of CMR reconstruction. Our primary goal is to identify the strengths and potential limitations of attention algorithms when integrated with a convolutional backbone model such as a U-Net. To achieve this, we benchmark different state-of-the-art spatial and channel attention mechanisms on the CMRxRecon dataset and quantitatively evaluate the quality of reconstruction using objective metrics. Furthermore, inspired by the best performing attention mechanism, we propose a new, simple yet effective, attention pipeline specifically optimised for the task of cardiac image reconstruction that outperforms other state-of-the-art attention methods. The layer and model code will be made publicly available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 28 references that are in the map. First posted on arXiv 10 Apr 2024.
Builds on
17 of 28 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 718
- 2019GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyondcited by 331
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2018BAM: Bottleneck Attention Modulecited by 172
- 2022On The Computational Complexity of Self-Attentioncited by 139
- 2019SRM : A Style-based Recalibration Module for Convolutional Neural Networkscited by 66
- 2022ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformercited by 52
- 2019Gated Channel Transformation for Visual Recognitioncited by 43
5 more
- 2023CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstructioncited by 21
- 2018MRI Reconstruction via Cascaded Channel-wise Attention Networkcited by 20
- 2023Fill the K-Space and Refine the Image: Prompting for Dynamic and Multi-Contrast MRI Reconstructioncited by 17
- 2023Deep Cardiac MRI Reconstruction with ADMMcited by 6
- 2020Attention as Activationcited by 3
Built on by
Not cited yet.