mlsanityData to 14 Oct 2026

MSLAU-Net: A Hybrid CNN-Transformer Network for Medical Image Segmentation

arXiv 2505.18823 ↗First posted 24 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate medical image segmentation allows for the precise delineation of anatomical structures and pathological regions, which is essential for treatment planning, surgical navigation, and disease monitoring. Both CNN-based and Transformer-based methods have achieved remarkable success in medical image segmentation tasks. However, CNN-based methods struggle to effectively capture global contextual information due to the inherent limitations of convolution operations. Meanwhile, Transformer-based methods suffer from insufficient local feature modeling and face challenges related to the high computational complexity caused by the self-attention mechanism. To address these limitations, we propose a novel hybrid CNN-Transformer architecture, named MSLAU-Net, which integrates the strengths of both paradigms. The proposed MSLAU-Net incorporates two key ideas. First, it introduces Multi-Scale Linear Attention, designed to efficiently extract multi-scale features from medical images while modeling long-range dependencies with low computational complexity. Second, it adopts a top-down feature aggregation mechanism, which performs multi-level feature aggregation and restores spatial resolution using a lightweight structure. Extensive experiments conducted on benchmark datasets covering three imaging modalities demonstrate that the proposed MSLAU-Net outperforms other state-of-the-art methods on nearly all evaluation metrics, validating the superiority, effectiveness, and robustness of our approach.Our code is available at https://github.com/Monsoon49/MSLAU-Net.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 52 references that are in the map. First posted on arXiv 24 May 2025.

Builds on

37 of 52 references.

References · 37

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  6. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  7. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
  8. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  9. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  10. 2016Pyramid Scene Parsing Networkcited by 2,479
  11. 2017Non-local Neural Networkscited by 2,293
  12. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
25 more
  1. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  2. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  3. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
  4. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  5. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
  6. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
  7. 2018Efficient Attention: Attention with Linear Complexitiescited by 368
  8. 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 332
  9. 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
  10. 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 287
  11. 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 272
  12. 2019CE-Net: Context Encoder Network for 2D Medical Image Segmentationcited by 220
  13. 2022UniFormer: Unifying Convolution and Self-attention for Visual Recognitioncited by 206
  14. 2021nnFormer: Interleaved Transformer for Volumetric Segmentationcited by 180
  15. 2023FLatten Transformer: Vision Transformer using Focused Linear Attentioncited by 171
  16. 2023BiFormer: Vision Transformer with Bi-Level Routing Attentioncited by 151
  17. 2021UTNet: A Hybrid Transformer Architecture for Medical Image Segmentationcited by 116
  18. 2021MISSFormer: An Effective Medical Image Segmentation Transformercited by 103
  19. 2022HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentationcited by 95
  20. 2023Agent Attention: On the Integration of Softmax and Linear Attentioncited by 90
  21. 2024EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentationcited by 64
  22. 2022Hydra Attention: Efficient Attention with Many Headscited by 55
  23. 2021MSRF-Net: A Multi-Scale Residual Fusion Network for Biomedical Image Segmentationcited by 53
  24. 2024BRAU-Net++: U-Shaped Hybrid CNN-Transformer Network for Medical Image Segmentationcited by 7
  25. 2024Pubic Symphysis-Fetal Head Segmentation Network Using BiFormer Attention Mechanism and Multipath Dilated Convolutioncited by 3

Built on by

Not cited yet.