# AAU-net: An Adaptive Attention U-net for Breast Lesions Segmentation in Ultrasound Images

arXiv: https://arxiv.org/abs/2204.12077 · HTML: https://mlsanity.com/paper/2204.12077/

## Key facts

- Cited by 43 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 53 references that are in the map.
- First posted on arXiv 26 Apr 2022.

## Builds on (most cited first, 20 of 20)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Fully Convolutional Networks for Semantic Segmentation](https://mlsanity.com/paper/1411.4038/) (2014)
- [Squeeze-and-Excitation Networks](https://mlsanity.com/paper/1709.01507/) (2017)
- [DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs](https://mlsanity.com/paper/1606.00915/) (2016)
- [Pyramid Scene Parsing Network](https://mlsanity.com/paper/1612.01105/) (2016)
- [CBAM: Convolutional Block Attention Module](https://mlsanity.com/paper/1807.06521/) (2018)
- [SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation](https://mlsanity.com/paper/1511.00561/) (2015)
- [Attention U-Net: Learning Where to Look for the Pancreas](https://mlsanity.com/paper/1804.03999/) (2018)
- [UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation](https://mlsanity.com/paper/1912.05074/) (2019)
- [ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks](https://mlsanity.com/paper/1910.03151/) (2019)
- [Selective Kernel Networks](https://mlsanity.com/paper/1903.06586/) (2019)
- [UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation](https://mlsanity.com/paper/2004.08790/) (2020)
- [A Novel Focal Tversky loss function with improved Attention U-Net for lesion segmentation](https://mlsanity.com/paper/1810.07842/) (2018)
- [Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networks](https://mlsanity.com/paper/1803.02579/) (2018)
- [Squeeze-and-Attention Networks for Semantic Segmentation](https://mlsanity.com/paper/1909.03402/) (2019)
- [Attention Guided Network for Retinal Image Segmentation](https://mlsanity.com/paper/1907.12930/) (2019)
- [Global Guidance Network for Breast Lesion Segmentation in Ultrasound Images](https://mlsanity.com/paper/2104.01896/) (2021)
- [Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound](https://mlsanity.com/paper/1907.01743/) (2019)
- [Joint Weakly and Semi-Supervised Deep Learning for Localization and Classification of Masses in Breast Ultrasound Images](https://mlsanity.com/paper/1710.03778/) (2017)
- [Automatic Breast Ultrasound Image Segmentation: A Survey](https://mlsanity.com/paper/1704.01472/) (2017)

## Built on by (most cited first, 30 of 43)

- [EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentation](https://mlsanity.com/paper/2405.06880/) (2024)
- [Beyond Adapting SAM: Towards End-to-End Ultrasound Image Segmentation via Auto Prompting](https://mlsanity.com/paper/2309.06824/) (2023)
- [Spider: A Unified Framework for Context-dependent Concept Segmentation](https://mlsanity.com/paper/2405.01002/) (2024)
- [From Pretraining to Privacy: Federated Ultrasound Foundation Model with Self-Supervised Learning](https://mlsanity.com/paper/2411.16380/) (2024)
- [Rethinking the Unpretentious U-net for Medical Ultrasound Image Segmentation](https://mlsanity.com/paper/2209.07193/) (2022)
- [M2SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentation](https://mlsanity.com/paper/2303.10894/) (2023)
- [CC-SAM: SAM with Cross-feature Attention and Context for Ultrasound Image Segmentation](https://mlsanity.com/paper/2408.00181/) (2024)
- [Inspiring the Next Generation of Segment Anything Models: Comprehensively Evaluate SAM and SAM 2 with Diverse Prompts Towards Context-Dependent Concepts under Different Scenes](https://mlsanity.com/paper/2412.01240/) (2024)
- [PSFHS Challenge Report: Pubic Symphysis and Fetal Head Segmentation from Intrapartum Ultrasound Images](https://mlsanity.com/paper/2409.10980/) (2024)
- [ESKNet-An enhanced adaptive selection kernel convolution for breast tumors segmentation](https://mlsanity.com/paper/2211.02915/) (2022)
- [Comparative Analysis of Segment Anything Model and U-Net for Breast Tumor Detection in Ultrasound and Mammography Images](https://mlsanity.com/paper/2306.12510/) (2023)
- [TP-Seg: Task-Prototype Framework for Unified Medical Lesion Segmentation](https://mlsanity.com/paper/2604.00684/) (2026)
- [MCANet: Medical Image Segmentation with Multi-Scale Cross-Axis Attention](https://mlsanity.com/paper/2312.08866/) (2023)
- [SAMCT: Segment Any CT Allowing Labor-Free Task-Indicator Prompts](https://mlsanity.com/paper/2403.13258/) (2024)
- [UniUltra: Interactive Parameter-Efficient SAM2 for Universal Ultrasound Segmentation](https://mlsanity.com/paper/2511.15771/) (2025)
- [Grounding DINO-US-SAM: Text-Prompted Multi-Organ Segmentation in Ultrasound with LoRA-Tuned Vision-Language Models](https://mlsanity.com/paper/2506.23903/) (2025)
- [FreqDINO: Frequency-Guided Adaptation for Generalized Boundary-Aware Ultrasound Image Segmentation](https://mlsanity.com/paper/2512.11335/) (2025)
- [LightBTSeg: A lightweight breast tumor segmentation model using ultrasound images via dual-path joint knowledge distillation](https://mlsanity.com/paper/2311.11086/) (2023)
- [Residual-SwinCA-Net: A Channel-Aware Integrated Residual CNN-Swin Transformer for Malignant Lesion Segmentation in BUSI](https://mlsanity.com/paper/2512.08243/) (2025)
- [Progressive Dual Priori Network for Generalized Breast Tumor Segmentation](https://mlsanity.com/paper/2310.13574/) (2023)
- [Morphology-Enhanced CAM-Guided SAM for weakly supervised Breast Lesion Segmentation](https://mlsanity.com/paper/2311.11176/) (2023)
- [BUSClean: Open-source software for breast ultrasound image pre-processing and knowledge extraction for medical AI](https://mlsanity.com/paper/2407.11316/) (2024)
- [Minding Fuzzy Regions: A Data-driven Alternating Learning Paradigm for Stable Lesion Segmentation](https://mlsanity.com/paper/2503.11140/) (2025)
- [MAMBO-NET: Multi-Causal Aware Modeling Backdoor-Intervention Optimization for Medical Image Segmentation Network](https://mlsanity.com/paper/2505.21874/) (2025)
- [BAAF: A benchmark attention adaptive framework for medical ultrasound image segmentation tasks](https://mlsanity.com/paper/2310.00919/) (2023)
- [Is Two-shot All You Need? A Label-efficient Approach for Video Segmentation in Breast Ultrasound](https://mlsanity.com/paper/2402.04921/) (2024)
- [CP-UNet: Contour-based Probabilistic Model for Medical Ultrasound Images Segmentation](https://mlsanity.com/paper/2411.14250/) (2024)
- [UltraBones100k: A reliable automated labeling method and large-scale dataset for ultrasound-based bone surface extraction](https://mlsanity.com/paper/2502.03783/) (2025)
- [Multi-Scale Target-Aware Representation Learning for Fundus Image Enhancement](https://mlsanity.com/paper/2505.01831/) (2025)
- [Dual Attention Residual U-Net for Accurate Brain Ultrasound Segmentation in IVH Detection](https://mlsanity.com/paper/2505.17683/) (2025)

## Abstract (arXiv)

Various deep learning methods have been proposed to segment breast lesion from ultrasound images. However, similar intensity distributions, variable tumor morphology and blurred boundaries present challenges for breast lesions segmentation, especially for malignant tumors with irregular shapes. Considering the complexity of ultrasound images, we develop an adaptive attention U-net (AAU-net) to segment breast lesions automatically and stably from ultrasound images. Specifically, we introduce a hybrid adaptive attention module, which mainly consists of a channel self-attention block and a spatial self-attention block, to replace the traditional convolution operation. Compared with the conventional convolution operation, the design of the hybrid adaptive attention module can help us capture more features under different receptive fields. Different from existing attention mechanisms, the hybrid adaptive attention module can guide the network to adaptively select more robust representation in channel and space dimensions to cope with more complex breast lesions segmentation. Extensive experiments with several state-of-the-art deep learning segmentation methods on three public breast ultrasound datasets show that our method has better performance on breast lesion segmentation. Furthermore, robustness analysis and external experiments demonstrate that our proposed AAU-net has better generalization performance on the segmentation of breast lesions. Moreover, the hybrid adaptive attention module can be flexibly applied to existing network frameworks.
