# Axial Attention Transformer Networks: A New Frontier in Breast Cancer Detection

arXiv: https://arxiv.org/abs/2409.12347 · HTML: https://mlsanity.com/paper/2409.12347/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 18 references that are in the map.
- First posted on arXiv 18 Sep 2024.

## Builds on (most cited first, 11 of 11)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation](https://mlsanity.com/paper/1511.00561/) (2015)
- [Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation](https://mlsanity.com/paper/2003.07853/) (2020)
- [ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation](https://mlsanity.com/paper/1803.06815/) (2018)
- [NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Space](https://mlsanity.com/paper/2309.14616/) (2023)
- [Survival Prediction Across Diverse Cancer Types Using Neural Networks](https://mlsanity.com/paper/2404.08713/) (2024)
- [Convolutional neural network classification of cancer cytopathology images: taking breast cancer as an example](https://mlsanity.com/paper/2404.08279/) (2024)
- [Adaptive Friction in Deep Learning: Enhancing Optimizers with Sigmoid and Tanh Function](https://mlsanity.com/paper/2408.11839/) (2024)
- [Dynamic Hypergraph-Enhanced Prediction of Sequential Medical Visits](https://mlsanity.com/paper/2408.07084/) (2024)
- [Text classification optimization algorithm based on graph neural network](https://mlsanity.com/paper/2408.15257/) (2024)

## Built on by (most cited first, 5 of 5)

- [Emotion-Aware Interaction Design in Intelligent User Interface Using Multi-Modal Deep Learning](https://mlsanity.com/paper/2411.06326/) (2024)
- [Self-Supervised Learning in Deep Networks: A Pathway to Robust Few-Shot Classification](https://mlsanity.com/paper/2411.12151/) (2024)
- [Adversarial Neural Networks in Medical Imaging Advancements and Challenges in Semantic Segmentation](https://mlsanity.com/paper/2410.13099/) (2024)
- [Balancing Innovation and Privacy: Data Security Strategies in Natural Language Processing Applications](https://mlsanity.com/paper/2410.08553/) (2024)
- [An Innovative Framework for Breast Cancer Detection Using Pyramid Adaptive Atrous Convolution, Transformer Integration, and Multi-Scale Feature Fusion](https://mlsanity.com/paper/2601.12249/) (2026)

## Abstract (arXiv)

This paper delves into the challenges and advancements in the field of medical image segmentation, particularly focusing on breast cancer diagnosis. The authors propose a novel Transformer-based segmentation model that addresses the limitations of traditional convolutional neural networks (CNNs), such as U-Net, in accurately localizing and segmenting small lesions within breast cancer images. The model introduces an axial attention mechanism to enhance the computational efficiency and address the issue of global contextual information that is often overlooked by CNNs. Additionally, the paper discusses improvements tailored to the small dataset challenge, including the incorporation of relative position information and a gated axial attention mechanism to refine the model's focus on relevant features. The proposed model aims to significantly improve the segmentation accuracy of breast cancer images, offering a more efficient and effective tool for computer-aided diagnosis.