Deep models for stroke segmentation: do complex architectures always perform better?
Not on the map. Why?
Abstract (arXiv)
Stroke segmentation plays a crucial role in the diagnosis and treatment of stroke patients by providing spatial information about affected brain regions and the extent of damage. Segmenting stroke lesions accurately is a challenging task, given that conventional manual techniques are time consuming and prone to errors. Recently, advanced deep models have been introduced for general medical image segmentation, demonstrating promising results that surpass many state of the art networks when evaluated on specific datasets. With the advent of the vision Transformers, several models have been introduced based on them, while others have aimed to design better modules based on traditional convolutional layers to extract long-range dependencies like Transformers. The question of whether such high-level designs are necessary for all segmentation cases to achieve the best results remains unanswered. In this study, we selected four types of deep models that were recently proposed and evaluated their performance for stroke segmentation: a pure Transformer-based architecture (DAE-Former), two advanced CNN-based models (LKA and DLKA) with attention mechanisms in their design, an advanced hybrid model that incorporates CNNs with Transformers (FCT), and the well-known self-adaptive nnUNet framework with its configuration based on given data. We examined their performance on two publicly available datasets, and found that the nnUNet achieved the best results with the simplest design among all. Revealing the robustness issue of Transformers to such variabilities serves as a potential reason for their weaker performance. Furthermore, nnUNet's success underscores the significant impact of preprocessing and postprocessing techniques in enhancing segmentation results, surpassing the focus solely on architectural designs
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 41 of its 72 references that are in the map. First posted on arXiv 25 Mar 2024.
Builds on
41 of 72 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2017Deformable Convolutional Networkscited by 1,488
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
29 more
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2021MetaFormer Is Actually What You Need for Visioncited by 524
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 422
- 2018Efficient Attention: Attention with Linear Complexitiescited by 368
- 2021XCiT: Cross-Covariance Image Transformerscited by 338
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
- 2021TransFuse: Fusing Transformers and CNNs for Medical Image Segmentationcited by 258
- 2022Visual Attention Networkcited by 210
- 2022ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation datasetcited by 106
- 2021MISSFormer: An Effective Medical Image Segmentation Transformercited by 103
- 2021Mixed Transformer U-Net For Medical Image Segmentationcited by 95
- 2022HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentationcited by 95
- 2021LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentationcited by 85
- 2022TransDeepLab: Convolution-Free Transformer-based DeepLab v3+ for Medical Image Segmentationcited by 43
- 2021TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentationcited by 41
- 2022TransNorm: Transformer Provides a Strong Spatial Normalization Mechanism for a Deep Segmentation Modelcited by 34
- 2022Contextual Attention Network: Transformer Meets U-Netcited by 33
- 2022The Fully Convolutional Transformer for Medical Image Segmentationcited by 32
- 2023Beyond Self-Attention: Deformable Large Kernel Attention for Medical Image Segmentationcited by 30
- 2022DAE-Former: Dual Attention-guided Efficient Transformer for Medical Image Segmentationcited by 27
- 2019D-UNet: a dimension-fusion U shape network for chronic stroke lesion segmentationcited by 24
- 2020Multi-level Context Gating of Embedded Collective Knowledge for Medical Image Segmentationcited by 23
- 2022ScaleFormer: Revisiting the Transformer-based Backbones from a Scale-wise Perspective for Medical Image Segmentationcited by 10
- 2022MAPPING: Model Average with Post-processing for Stroke Lesion Segmentationcited by 9
- 2018Ischemic Stroke Lesion Segmentation in CT Perfusion Scans using Pyramid Pooling and Focal Losscited by 7
- 2023Large-kernel Attention for Efficient and Robust Brain Lesion Segmentationcited by 5
- 2023Concurrent ischemic lesion age estimation and segmentation of CT brain using a Transformer-based networkcited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025A Hybrid CNN-VSSM model for Multi-View, Multi-Task Mammography Analysis: Robust Diagnosis with Attention-Based Fusioncited by 2
- 2025Stroke Locus Net: Occluded Vessel Localization from MRI Modalitiescited by 0
- 2026Automated Lesion Segmentation of Stroke MRI Using nnU-Net: A Comprehensive External Validation Across Acute and Chronic Lesionscited by 0
- 2026Automated Lesion Segmentation of Stroke MRI Using nnU-Net: A Comprehensive External Validation Across Acute and Chronic Lesions13 Jan 2026
- 2025Stroke Locus Net: Occluded Vessel Localization from MRI Modalities11 Oct 2025
- 2025A Hybrid CNN-VSSM model for Multi-View, Multi-Task Mammography Analysis: Robust Diagnosis with Attention-Based Fusion22 Jul 2025