A Survey on Deep Learning for Skin Lesion Segmentation
Not on the map. Why?
Abstract (arXiv)
Skin cancer is a major public health problem that could benefit from computer-aided diagnosis to reduce the burden of this common disease. Skin lesion segmentation from images is an important step toward achieving this goal. However, the presence of natural and artificial artifacts (e.g., hair and air bubbles), intrinsic factors (e.g., lesion shape and contrast), and variations in image acquisition conditions make skin lesion segmentation a challenging task. Recently, various researchers have explored the applicability of deep learning models to skin lesion segmentation. In this survey, we cross-examine 177 research papers that deal with deep learning-based segmentation of skin lesions. We analyze these works along several dimensions, including input data (datasets, preprocessing, and synthetic data generation), model design (architecture, modules, and losses), and evaluation aspects (data annotation requirements and segmentation performance). We discuss these dimensions both from the viewpoint of select seminal works, and from a systematic viewpoint, examining how those choices have influenced current trends, and how their limitations should be addressed. To facilitate comparisons, we summarize all examined works in a comprehensive table as well as an interactive table available online at https://github.com/sfu-mial/skin-lesion-segmentation-survey.
Key facts. Cited by 22 papers in the map (data through 13 Oct 2026). Builds on 148 of its 490 references that are in the map. First posted on arXiv 1 Jun 2022.
Builds on
148 of 490 references.
References · 148
- 2017Attention Is All You Needcited by 60,106
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,625
- 2016Densely Connected Convolutional Networkscited by 6,707
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,426
- 2022Generative Adversarial Networkscited by 5,614
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,849
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,840
38 more
- 2017Squeeze-and-Excitation Networkscited by 4,772
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,516
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,240
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,216
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,975
- 2016Pyramid Scene Parsing Networkcited by 2,474
- 2015Learning Deep Features for Discriminative Localizationcited by 2,434
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,326
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,159
- 2019Searching for MobileNetV3cited by 1,990
- 2021Vision Transformers for Dense Predictioncited by 1,795
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,590
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,554
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,429
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,219
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,199
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,183
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,178
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,129
- 2018Dual Attention Network for Scene Segmentationcited by 1,002
- 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 941
- 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 916
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2017A Survey on Multi-Task Learningcited by 840
- 2018Image Transformercited by 771
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 664
- 2017Generative Adversarial Networks: An Overviewcited by 589
- 2018Albumentations: fast and flexible image augmentationscited by 558
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2019Stand-Alone Self-Attention in Vision Modelscited by 542
- 2018Invariant Information Clustering for Unsupervised Image Classification and Segmentationcited by 455
- 2020Exploring Self-attention for Image Recognitioncited by 313
- 2019On the Relationship between Self-Attention and Convolutional Layerscited by 300
- 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 297
- 2019Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentationcited by 259
- 2019Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentationcited by 259
- 2021TransFuse: Fusing Transformers and CNNs for Medical Image Segmentationcited by 258
50 most cited of 148 All 148 (JSON)
Built on by
Citing papers per year: 2023: 5; 2024: 11; 2025: 5; 2026: 1.
22 papers.
Sort:
By area:
- 2024Shortcut Learning in Medical Image Segmentationcited by 16
- 2024FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Imagescited by 14
- 2025In the Picture: Medical Imaging Datasets, Artifacts, and their Living Reviewcited by 8
- 2024Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasetscited by 7
- 2024A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Datacited by 6
- 2024S-SYNTH: Knowledge-Based, Synthetic Generation of Skin Imagescited by 6
- 2023Syn3DWound: A Synthetic Dataset for 3D Wound Bed Analysiscited by 5
- 2023DermSynth3D: Synthesis of in-the-wild Annotated Dermatology Imagescited by 4
- 2024LSSF-Net: Lightweight Segmentation with Self-Awareness, Spatial Attention, and Focal Modulationcited by 4
- 2023AViT: Adapting Vision Transformers for Small Skin Lesion Segmentation Datasetscited by 3
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentationcited by 3
- 2023UCM-Net: A Lightweight and Efficient Solution for Skin Lesion Segmentation using MLP and CNNcited by 2
10 more
- 2024Spatial-Frequency Dual Progressive Attention Network For Medical Image Segmentationcited by 2
- 2024Segmentation Style Discovery: Application to Skin Lesion Imagescited by 2
- 2025What Can We Learn from Inter-Annotator Variability in Skin Lesion Segmentation?cited by 2
- 2025ASP-VMUNet: Atrous Shifted Parallel Vision Mamba U-Net for Skin Lesion Segmentationcited by 1
- 2023Pelvic floor MRI segmentation based on semi-supervised deep learningcited by 0
- 2024XAI for Skin Cancer Detection with Prototypes and Non-Expert Supervisioncited by 0
- 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentationcited by 0
- 2024Memorizing SAM: 3D Medical Segment Anything Model with Memorizing Transformercited by 0
- 2025SkinGenBench: Generative Model and Preprocessing Effects for Synthetic Dermoscopic Augmentation in Melanoma Diagnosiscited by 0
- 2026Exploring the Impact of Skin Color on Skin Lesion Segmentationcited by 0
- 2026Exploring the Impact of Skin Color on Skin Lesion Segmentation31 Mar 2026
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentation25 Dec 2025
- 2025SkinGenBench: Generative Model and Preprocessing Effects for Synthetic Dermoscopic Augmentation in Melanoma Diagnosis19 Dec 2025
- 2025What Can We Learn from Inter-Annotator Variability in Skin Lesion Segmentation?12 Aug 2025
- 2025ASP-VMUNet: Atrous Shifted Parallel Vision Mamba U-Net for Skin Lesion Segmentation25 Mar 2025
- 2025In the Picture: Medical Imaging Datasets, Artifacts, and their Living Review18 Jan 2025
- 2024Memorizing SAM: 3D Medical Segment Anything Model with Memorizing Transformer18 Dec 2024
- 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentation14 Nov 2024
- 2024LSSF-Net: Lightweight Segmentation with Self-Awareness, Spatial Attention, and Focal Modulation3 Sep 2024
- 2024Segmentation Style Discovery: Application to Skin Lesion Images5 Aug 2024
- 2024S-SYNTH: Knowledge-Based, Synthetic Generation of Skin Images31 Jul 2024
- 2024Spatial-Frequency Dual Progressive Attention Network For Medical Image Segmentation12 Jun 2024
10 more
- 2024A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data21 May 2024
- 2024FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Images14 Mar 2024
- 2024Shortcut Learning in Medical Image Segmentation11 Mar 2024
- 2024XAI for Skin Cancer Detection with Prototypes and Non-Expert Supervision2 Feb 2024
- 2024Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasets25 Jan 2024
- 2023Syn3DWound: A Synthetic Dataset for 3D Wound Bed Analysis27 Nov 2023
- 2023Pelvic floor MRI segmentation based on semi-supervised deep learning6 Nov 2023
- 2023UCM-Net: A Lightweight and Efficient Solution for Skin Lesion Segmentation using MLP and CNN14 Oct 2023
- 2023AViT: Adapting Vision Transformers for Small Skin Lesion Segmentation Datasets26 Jul 2023
- 2023DermSynth3D: Synthesis of in-the-wild Annotated Dermatology Images22 May 2023
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentationcited by 3
- 2025ASP-VMUNet: Atrous Shifted Parallel Vision Mamba U-Net for Skin Lesion Segmentationcited by 1
- 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentationcited by 0
- 2025UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentation25 Dec 2025
- 2025ASP-VMUNet: Atrous Shifted Parallel Vision Mamba U-Net for Skin Lesion Segmentation25 Mar 2025
- 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentation14 Nov 2024
- 2024Shortcut Learning in Medical Image Segmentationcited by 16
- 2024FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Imagescited by 14
- 2025In the Picture: Medical Imaging Datasets, Artifacts, and their Living Reviewcited by 8
- 2024Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasetscited by 7
- 2024A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Datacited by 6
- 2024S-SYNTH: Knowledge-Based, Synthetic Generation of Skin Imagescited by 6
- 2023Syn3DWound: A Synthetic Dataset for 3D Wound Bed Analysiscited by 5
- 2023DermSynth3D: Synthesis of in-the-wild Annotated Dermatology Imagescited by 4
- 2024LSSF-Net: Lightweight Segmentation with Self-Awareness, Spatial Attention, and Focal Modulationcited by 4
- 2023AViT: Adapting Vision Transformers for Small Skin Lesion Segmentation Datasetscited by 3
- 2023UCM-Net: A Lightweight and Efficient Solution for Skin Lesion Segmentation using MLP and CNNcited by 2
- 2024Spatial-Frequency Dual Progressive Attention Network For Medical Image Segmentationcited by 2
12 most cited of 18 All 18 (JSON)
- 2026Exploring the Impact of Skin Color on Skin Lesion Segmentation31 Mar 2026
- 2025What Can We Learn from Inter-Annotator Variability in Skin Lesion Segmentation?12 Aug 2025
- 2025In the Picture: Medical Imaging Datasets, Artifacts, and their Living Review18 Jan 2025
- 2024Memorizing SAM: 3D Medical Segment Anything Model with Memorizing Transformer18 Dec 2024
- 2024LSSF-Net: Lightweight Segmentation with Self-Awareness, Spatial Attention, and Focal Modulation3 Sep 2024
- 2024Segmentation Style Discovery: Application to Skin Lesion Images5 Aug 2024
- 2024S-SYNTH: Knowledge-Based, Synthetic Generation of Skin Images31 Jul 2024
- 2024Spatial-Frequency Dual Progressive Attention Network For Medical Image Segmentation12 Jun 2024
- 2024A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data21 May 2024
- 2024FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Images14 Mar 2024
- 2024Shortcut Learning in Medical Image Segmentation11 Mar 2024
- 2024XAI for Skin Cancer Detection with Prototypes and Non-Expert Supervision2 Feb 2024
12 newest of 18 All 18 (JSON)