mlsanityData to 7 Oct 2026

GASA-UNet: Global Axial Self-Attention U-Net for 3D Medical Image Segmentation

arXiv 2409.13146 ↗First posted 20 Sep 2024eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate segmentation of multiple organs and the differentiation of pathological tissues in medical imaging are crucial but challenging, especially for nuanced classifications and ambiguous organ boundaries. To tackle these challenges, we introduce GASA-UNet, a refined U-Net-like model featuring a novel Global Axial Self-Attention (GASA) block. This block processes image data as a 3D entity, with each 2D plane representing a different anatomical cross-section. Voxel features are defined within this spatial context, and a Multi-Head Self-Attention (MHSA) mechanism is utilized on extracted 1D patches to facilitate connections across these planes. Positional embeddings (PE) are incorporated into our attention framework, enriching voxel features with spatial context and enhancing tissue classification and organ edge delineation. Our model has demonstrated promising improvements in segmentation performance, particularly for smaller anatomical structures, as evidenced by enhanced Dice scores and Normalized Surface Dice (NSD) on three benchmark datasets, i.e., BTCV, AMOS, and KiTS23.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 32 references that are in the map. First posted on arXiv 20 Sep 2024.

Builds on

22 of 32 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  5. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  7. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  8. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  9. 2017Deep Learning for Medical Image Analysiscited by 399
  10. 2019Axial Attention in Multidimensional Transformerscited by 350
  11. 2020Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentationcited by 326
  12. 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
10 more
  1. 2018A Probabilistic U-Net for Segmentation of Ambiguous Imagescited by 281
  2. 2016Using the Output Embedding to Improve Language Modelscited by 266
  3. 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
  4. 2018Towards Understanding the Role of Over-Parametrization in Generalization of Neural Networkscited by 140
  5. 2019PHiSeg: Capturing Uncertainty in Medical Image Segmentationcited by 128
  6. 2018Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapycited by 76
  7. 2014On the Computational Efficiency of Training Neural Networkscited by 71
  8. 2017Massive Exploration of Neural Machine Translation Architecturescited by 55
  9. 2020A scoping review of transfer learning research on medical image analysis using ImageNetcited by 54
  10. 2021Extending nn-UNet for brain tumor segmentationcited by 36

Built on by

Not cited yet.