SkinSAM: Empowering Skin Cancer Segmentation with Segment Anything Model
Not on the map. Why?
Abstract (arXiv)
Skin cancer is a prevalent and potentially fatal disease that requires accurate and efficient diagnosis and treatment. Although manual tracing is the current standard in clinics, automated tools are desired to reduce human labor and improve accuracy. However, developing such tools is challenging due to the highly variable appearance of skin cancers and complex objects in the background. In this paper, we present SkinSAM, a fine-tuned model based on the Segment Anything Model that showed outstanding segmentation performance. The models are validated on HAM10000 dataset which includes 10015 dermatoscopic images. While larger models (ViT_L, ViT_H) performed better than the smaller one (ViT_b), the finetuned model (ViT_b_finetuned) exhibited the greatest improvement, with a Mean pixel accuracy of 0.945, Mean dice score of 0.8879, and Mean IoU score of 0.7843. Among the lesion types, vascular lesions showed the best segmentation results. Our research demonstrates the great potential of adapting SAM to medical image segmentation tasks.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 8 of its 17 references that are in the map. First posted on arXiv 27 Apr 2023.
Builds on
8 of 17 references.
References · 8
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023Segment Anythingcited by 8,234
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Mask R-CNNcited by 7,277
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 422
- 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
Built on by
Citing papers per year: 2023: 14; 2024: 13; 2025: 4; 2026: 1.
32 papers.
Sort:
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2023Polyp-SAM: Transfer SAM for Polyp Segmentationcited by 64
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decodingcited by 48
- 2023A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineeringcited by 45
- 2024RobustSAM: Segment Anything Robustly on Degraded Imagescited by 36
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Modelcited by 32
- 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 27
- 2023On the Robustness of Segment Anythingcited by 25
- 2023Segment Anything Model (SAM) for Radiation Oncologycited by 24
- 2023Towards Segment Anything Model (SAM) for Medical Image Segmentation: A Surveycited by 21
20 more
- 2023Self-Sampling Meta SAM: Enhancing Few-shot Medical Image Segmentation with Meta-Learningcited by 18
- 2024On Efficient Variants of Segment Anything Model: A Surveycited by 16
- 2023BreastSAM: A Study of Segment Anything Model for Breast Tumor Detection in Ultrasound Imagescited by 7
- 2023TongueSAM: An Universal Tongue Segmentation Model Based on SAM with Zero-Shotcited by 7
- 2023Large Scale Foundation Models for Intelligent Manufacturing Applications: A Surveycited by 6
- 2023Hybrid Whale-Mud-Ring Optimization for Precise Color Skin Cancer Image Segmentationcited by 5
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Surveycited by 5
- 2025Deep Skin Lesion Segmentation with Transformer-CNN Fusion: Toward Intelligent Skin Cancer Analysiscited by 5
- 2023Industrial Segment Anything -- a Case Study in Aircraft Manufacturing, Intralogistics, Maintenance, Repair, and Overhaulcited by 4
- 2024Enhancing Skin Disease Diagnosis: Interpretable Visual Concept Discovery with SAMcited by 4
- 2023Empirical Analysis of a Segmentation Foundation Model in Prostate Imagingcited by 3
- 2024SSTD: Stripe-Like Space Target Detection Using Single-Point Weak Supervisioncited by 2
- 2024Foundation AI Model for Medical Image Segmentationcited by 2
- 2025PG-SAM: Prior-Guided SAM with Medical for Multi-organ Segmentationcited by 2
- 2024Leveraging SAM for Single-Source Domain Generalization in Medical Image Segmentationcited by 1
- 2024Urban Waterlogging Detection: A Challenging Benchmark and Large-Small Model Co-Adaptercited by 1
- 2024Adaptive Prompt Learning with SAM for Few-shot Scanning Probe Microscope Image Segmentationcited by 1
- 2025Fully Automated SAM for Single-source Domain Generalization in Medical Image Segmentationcited by 1
- 2025SAM-DCE: Addressing Token Uniformity and Semantic Over-Smoothing in Medical Segmentationcited by 0
- 2026PEFT-MedSAM: Efficient Fine-Tuning of Medical Foundation Models for Explainable Skin Lesion Segmentationcited by 0
- 2026PEFT-MedSAM: Efficient Fine-Tuning of Medical Foundation Models for Explainable Skin Lesion Segmentation17 Jun 2026
- 2025SAM-DCE: Addressing Token Uniformity and Semantic Over-Smoothing in Medical Segmentation21 Sep 2025
- 2025Deep Skin Lesion Segmentation with Transformer-CNN Fusion: Toward Intelligent Skin Cancer Analysis20 Aug 2025
- 2025Fully Automated SAM for Single-source Domain Generalization in Medical Image Segmentation23 Jul 2025
- 2025PG-SAM: Prior-Guided SAM with Medical for Multi-organ Segmentation23 Mar 2025
- 2024Foundation AI Model for Medical Image Segmentation5 Nov 2024
- 2024Adaptive Prompt Learning with SAM for Few-shot Scanning Probe Microscope Image Segmentation16 Oct 2024
- 2024On Efficient Variants of Segment Anything Model: A Survey7 Oct 2024
- 2024Enhancing Skin Disease Diagnosis: Interpretable Visual Concept Discovery with SAM14 Sep 2024
- 2024SSTD: Stripe-Like Space Target Detection Using Single-Point Weak Supervision25 Jul 2024
- 2024Urban Waterlogging Detection: A Challenging Benchmark and Large-Small Model Co-Adapter11 Jul 2024
- 2024RobustSAM: Segment Anything Robustly on Degraded Images13 Jun 2024
20 more
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Model15 Apr 2024
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decoding27 Mar 2024
- 2024Colorectal Polyp Segmentation in the Deep Learning Era: A Comprehensive Survey22 Jan 2024
- 2024Foundation Models for Biomedical Image Segmentation: A Survey15 Jan 2024
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directions7 Jan 2024
- 2024Leveraging SAM for Single-Source Domain Generalization in Medical Image Segmentation4 Jan 2024
- 2023Large Scale Foundation Models for Intelligent Manufacturing Applications: A Survey11 Dec 2023
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomy23 Nov 2023
- 2023Hybrid Whale-Mud-Ring Optimization for Precise Color Skin Cancer Image Segmentation22 Nov 2023
- 2023Self-Sampling Meta SAM: Enhancing Few-shot Medical Image Segmentation with Meta-Learning31 Aug 2023
- 2023TongueSAM: An Universal Tongue Segmentation Model Based on SAM with Zero-Shot12 Aug 2023
- 2023Industrial Segment Anything -- a Case Study in Aircraft Manufacturing, Intralogistics, Maintenance, Repair, and Overhaul24 Jul 2023
- 2023Empirical Analysis of a Segmentation Foundation Model in Prostate Imaging6 Jul 2023
- 2023Segment Anything Model (SAM) for Radiation Oncology20 Jun 2023
- 2023On the Robustness of Segment Anything25 May 2023
- 2023BreastSAM: A Study of Segment Anything Model for Breast Tumor Detection in Ultrasound Images21 May 2023
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyond14 May 2023
- 2023A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineering12 May 2023
- 2023Towards Segment Anything Model (SAM) for Medical Image Segmentation: A Survey5 May 2023
- 2023Polyp-SAM: Transfer SAM for Polyp Segmentation29 Apr 2023
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2023Polyp-SAM: Transfer SAM for Polyp Segmentationcited by 64
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decodingcited by 48
- 2023A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineeringcited by 45
- 2024RobustSAM: Segment Anything Robustly on Degraded Imagescited by 36
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Modelcited by 32
- 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 27
- 2023On the Robustness of Segment Anythingcited by 25
- 2023Segment Anything Model (SAM) for Radiation Oncologycited by 24
- 2023Towards Segment Anything Model (SAM) for Medical Image Segmentation: A Surveycited by 21
12 most cited of 32 All 32 (JSON)
- 2026PEFT-MedSAM: Efficient Fine-Tuning of Medical Foundation Models for Explainable Skin Lesion Segmentation17 Jun 2026
- 2025SAM-DCE: Addressing Token Uniformity and Semantic Over-Smoothing in Medical Segmentation21 Sep 2025
- 2025Deep Skin Lesion Segmentation with Transformer-CNN Fusion: Toward Intelligent Skin Cancer Analysis20 Aug 2025
- 2025Fully Automated SAM for Single-source Domain Generalization in Medical Image Segmentation23 Jul 2025
- 2025PG-SAM: Prior-Guided SAM with Medical for Multi-organ Segmentation23 Mar 2025
- 2024Foundation AI Model for Medical Image Segmentation5 Nov 2024
- 2024Adaptive Prompt Learning with SAM for Few-shot Scanning Probe Microscope Image Segmentation16 Oct 2024
- 2024On Efficient Variants of Segment Anything Model: A Survey7 Oct 2024
- 2024Enhancing Skin Disease Diagnosis: Interpretable Visual Concept Discovery with SAM14 Sep 2024
- 2024SSTD: Stripe-Like Space Target Detection Using Single-Point Weak Supervision25 Jul 2024
- 2024Urban Waterlogging Detection: A Challenging Benchmark and Large-Small Model Co-Adapter11 Jul 2024
- 2024RobustSAM: Segment Anything Robustly on Degraded Images13 Jun 2024
12 newest of 32 All 32 (JSON)