ProtoSAM: One-Shot Medical Image Segmentation With Foundational Models
Not on the map. Why?
Abstract (arXiv)
This work introduces a new framework, ProtoSAM, for one-shot medical image segmentation. It combines the use of prototypical networks, known for few-shot segmentation, with SAM - a natural image foundation model. The method proposed creates an initial coarse segmentation mask using the ALPnet prototypical network, augmented with a DINOv2 encoder. Following the extraction of an initial mask, prompts are extracted, such as points and bounding boxes, which are then input into the Segment Anything Model (SAM). State-of-the-art results are shown on several medical image datasets and demonstrate automated segmentation capabilities using a single image example (one shot) with no need for fine-tuning of the foundation model. Our code is available at: https://github.com/levayz/ProtoSAM
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 9 Jul 2024.
Builds on
15 of 25 references.
References · 15
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 485
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
- 2020Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotationcited by 128
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2023AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encodercited by 70
- 2019'Squeeze & Excite' Guided Few-Shot Segmentation of Volumetric Imagescited by 69
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 5.
12 papers.
- 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentationcited by 37
- 2025SynPo: Boosting Training-Free Few-Shot Medical Segmentation via High-Quality Negative Promptscited by 9
- 2025Prompt learning with bounding box constraints for medical image segmentationcited by 2
- 2025Proxy Prompt: Endowing SAM and SAM 2 with Auto-Interactive-Prompt for Medical Segmentationcited by 1
- 2025DescriptorMedSAM: Language-Image Fusion with Multi-Aspect Text Guidance for Medical Image Segmentationcited by 1
- 2026Focus on Background: Exploring SAM's Potential in Few-shot Medical Image Segmentation with Background-centric Promptingcited by 1
- 2026Mask to Concept: Auto-Promptable SAM3 via Efficient Test-Time Concept Embedding Search for Few-Shot Annotationcited by 1
- 2026Prototype Memory-Guided Training-Free Anomaly Classification and Localization in Prenatal Ultrasoundcited by 1
- 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domaincited by 0
- 2025Optimization of MedSAM model based on bounding box adaptive perturbation algorithmcited by 0
- 2026DiffuSAM: Diffusion-Based Prompt-Free SAM2 for Few-Shot and Source-Free Medical Image Segmentationcited by 0
- 2026Memory-Supported Synergistic Adaptation for Training-Free Test-Time Medical Image Segmentationcited by 0
- 2026Memory-Supported Synergistic Adaptation for Training-Free Test-Time Medical Image Segmentation20 Jul 2026
- 2026Prototype Memory-Guided Training-Free Anomaly Classification and Localization in Prenatal Ultrasound1 Jul 2026
- 2026Mask to Concept: Auto-Promptable SAM3 via Efficient Test-Time Concept Embedding Search for Few-Shot Annotation25 Jun 2026
- 2026DiffuSAM: Diffusion-Based Prompt-Free SAM2 for Few-Shot and Source-Free Medical Image Segmentation27 Apr 2026
- 2026Focus on Background: Exploring SAM's Potential in Few-shot Medical Image Segmentation with Background-centric Prompting22 Mar 2026
- 2025Prompt learning with bounding box constraints for medical image segmentation3 Jul 2025
- 2025SynPo: Boosting Training-Free Few-Shot Medical Segmentation via High-Quality Negative Prompts18 Jun 2025
- 2025Optimization of MedSAM model based on bounding box adaptive perturbation algorithm25 Mar 2025
- 2025DescriptorMedSAM: Language-Image Fusion with Multi-Aspect Text Guidance for Medical Image Segmentation18 Mar 2025
- 2025Proxy Prompt: Endowing SAM and SAM 2 with Auto-Interactive-Prompt for Medical Segmentation5 Feb 2025
- 2024Med-PerSAM: One-Shot Visual Prompt Tuning for Personalized Segment Anything Model in Medical Domain25 Nov 2024
- 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentation28 Sep 2024