mlsanityData to 14 Oct 2026

Deep models for stroke segmentation: do complex architectures always perform better?

arXiv 2403.17177 ↗First posted 25 Mar 2024eess.IV cs.CV cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Stroke segmentation plays a crucial role in the diagnosis and treatment of stroke patients by providing spatial information about affected brain regions and the extent of damage. Segmenting stroke lesions accurately is a challenging task, given that conventional manual techniques are time consuming and prone to errors. Recently, advanced deep models have been introduced for general medical image segmentation, demonstrating promising results that surpass many state of the art networks when evaluated on specific datasets. With the advent of the vision Transformers, several models have been introduced based on them, while others have aimed to design better modules based on traditional convolutional layers to extract long-range dependencies like Transformers. The question of whether such high-level designs are necessary for all segmentation cases to achieve the best results remains unanswered. In this study, we selected four types of deep models that were recently proposed and evaluated their performance for stroke segmentation: a pure Transformer-based architecture (DAE-Former), two advanced CNN-based models (LKA and DLKA) with attention mechanisms in their design, an advanced hybrid model that incorporates CNNs with Transformers (FCT), and the well-known self-adaptive nnUNet framework with its configuration based on given data. We examined their performance on two publicly available datasets, and found that the nnUNet achieved the best results with the simplest design among all. Revealing the robustness issue of Transformers to such variabilities serves as a potential reason for their weaker performance. Furthermore, nnUNet's success underscores the significant impact of preprocessing and postprocessing techniques in enhancing segmentation results, surpassing the focus solely on architectural designs

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 41 of its 72 references that are in the map. First posted on arXiv 25 Mar 2024.

Builds on

41 of 72 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2017Squeeze-and-Excitation Networkscited by 4,789
  6. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  7. 2016Pyramid Scene Parsing Networkcited by 2,479
  8. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  9. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  10. 2017Deformable Convolutional Networkscited by 1,488
  11. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
  12. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
29 more
  1. 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
  2. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
  3. 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
  4. 2021MetaFormer Is Actually What You Need for Visioncited by 524
  5. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 422
  6. 2018Efficient Attention: Attention with Linear Complexitiescited by 368
  7. 2021XCiT: Cross-Covariance Image Transformerscited by 338
  8. 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
  9. 2021TransFuse: Fusing Transformers and CNNs for Medical Image Segmentationcited by 258
  10. 2022Visual Attention Networkcited by 210
  11. 2022ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation datasetcited by 106
  12. 2021MISSFormer: An Effective Medical Image Segmentation Transformercited by 103
  13. 2021Mixed Transformer U-Net For Medical Image Segmentationcited by 95
  14. 2022HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentationcited by 95
  15. 2021LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentationcited by 85
  16. 2022TransDeepLab: Convolution-Free Transformer-based DeepLab v3+ for Medical Image Segmentationcited by 43
  17. 2021TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentationcited by 41
  18. 2022TransNorm: Transformer Provides a Strong Spatial Normalization Mechanism for a Deep Segmentation Modelcited by 34
  19. 2022Contextual Attention Network: Transformer Meets U-Netcited by 33
  20. 2022The Fully Convolutional Transformer for Medical Image Segmentationcited by 32
  21. 2023Beyond Self-Attention: Deformable Large Kernel Attention for Medical Image Segmentationcited by 30
  22. 2022DAE-Former: Dual Attention-guided Efficient Transformer for Medical Image Segmentationcited by 27
  23. 2019D-UNet: a dimension-fusion U shape network for chronic stroke lesion segmentationcited by 24
  24. 2020Multi-level Context Gating of Embedded Collective Knowledge for Medical Image Segmentationcited by 23
  25. 2022ScaleFormer: Revisiting the Transformer-based Backbones from a Scale-wise Perspective for Medical Image Segmentationcited by 10
  26. 2022MAPPING: Model Average with Post-processing for Stroke Lesion Segmentationcited by 9
  27. 2018Ischemic Stroke Lesion Segmentation in CT Perfusion Scans using Pyramid Pooling and Focal Losscited by 7
  28. 2023Large-kernel Attention for Efficient and Robust Brain Lesion Segmentationcited by 5
  29. 2023Concurrent ischemic lesion age estimation and segmentation of CT brain using a Transformer-based networkcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.