Segment Anything in Medical Images
Not on the map. Why?
Abstract (arXiv)
Medical image segmentation is a critical component in clinical practice, facilitating accurate diagnosis, treatment planning, and disease monitoring. However, existing methods, often tailored to specific modalities or disease types, lack generalizability across the diverse spectrum of medical image segmentation tasks. Here we present MedSAM, a foundation model designed for bridging this gap by enabling universal medical image segmentation. The model is developed on a large-scale medical image dataset with 1,570,263 image-mask pairs, covering 10 imaging modalities and over 30 cancer types. We conduct a comprehensive evaluation on 86 internal validation tasks and 60 external validation tasks, demonstrating better accuracy and robustness than modality-wise specialist models. By delivering accurate and efficient segmentation across a wide spectrum of tasks, MedSAM holds significant potential to expedite the evolution of diagnostic tools and the personalization of treatment plans.
Key facts. Cited by 226 papers in the map (data through 7 Oct 2026). Builds on 27 of its 54 references that are in the map. First posted on arXiv 24 Apr 2023.
Builds on
27 of 54 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Segment Anythingcited by 8,158
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Layer Normalizationcited by 5,579
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2020Image Segmentation Using Deep Learning: A Surveycited by 659
- 2021The Medical Segmentation Decathloncited by 620
15 more
- 2023Segment Everything Everywhere All at Oncecited by 546
- 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 508
- 2017Deep Learning for Medical Image Analysiscited by 399
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
- 2023Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applicationscited by 121
- 2017DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentationcited by 110
- 2017Interactive Medical Image Segmentation using Deep Learning with Image-specific Fine-tuningcited by 110
- 2023Can SAM Segment Anything? When SAM Meets Camouflaged Object Detectioncited by 99
- 2023SAM Struggles in Concealed Scenes -- Empirical Study on Segment Anythingcited by 75
- 2023Can SAM Segment Polyps?cited by 59
- 2023When SAM Meets Medical Images: An Investigation of Segment Anything Model (SAM) on Multi-phase Liver Tumor Segmentationcited by 52
- 2021MIDeepSeg: Minimally Interactive Segmentation of Unseen Objects from Medical Images Using Deep Learningcited by 45
- 2023SAM vs BET: A Comparative Study for Brain Extraction and Segmentation of Magnetic Resonance Images using Deep Learningcited by 24
- 2023Learning to "Segment Anything" in Thermal Infrared Images through Knowledge Distillation with a Large Scale Dataset SATIRcited by 11
Built on by
Citing papers per year: 2023: 18; 2024: 82; 2025: 95; 2026: 31.
226 papers.
Sort:
By area:
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
- 2023Large-Vocabulary Segmentation for Medical Images with Text Promptscited by 60
- 2024TotalSegmentator MRI: Robust Sequence-independent Segmentation of Multiple Anatomic Structures in MRIcited by 58
- 2023Annotation-free Audio-Visual Segmentationcited by 44
- 2023Are Natural Domain Foundation Models Useful for Medical Image Classification?cited by 44
- 2024A large-scale multicenter breast cancer DCE-MRI benchmark dataset with expert segmentationscited by 40
- 2023The Multi-modality Cell Segmentation Challenge: Towards Universal Solutionscited by 39
- 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentationcited by 37
- 2024Multi-Scale and Detail-Enhanced Segment Anything Model for Salient Object Detectioncited by 29
- 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
- 2024Data-Centric Foundation Models in Computational Healthcare: A Surveycited by 27
38 more
- 2024Foundation Models in Radiology: What, How, When, Why and Why Notcited by 26
- 2025Scaling up self-supervised learning for improved surgical foundation modelscited by 25
- 2024UltraSam: A Foundation Model for Ultrasound using Large Open-Access Segmentation Datasetscited by 23
- 2024EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learningcited by 22
- 2024Knowledge-enhanced Pretraining for Vision-language Pathology Foundation Model on Cancer Diagnosiscited by 21
- 2025EdgeTAM: On-Device Track Anything Modelcited by 21
- 2024Exploring Deeper! Segment Anything Model with Depth Perception for Camouflaged Object Detectioncited by 20
- 2023Learning the What and How of Annotation in Video Object Segmentationcited by 19
- 2023Self-Sampling Meta SAM: Enhancing Few-shot Medical Image Segmentation with Meta-Learningcited by 18
- 2023SAM-DA: UAV Tracks Anything at Night with SAM-Powered Domain Adaptationcited by 17
- 2024On Efficient Variants of Segment Anything Model: A Surveycited by 16
- 2024ICH-SCNet: Intracerebral Hemorrhage Segmentation and Prognosis Classification Network Using CLIP-guided SAM mechanismcited by 16
- 2023AnyStar: Domain randomized universal star-convex 3D instance segmentationcited by 14
- 2023Open-NeRF: Towards Open Vocabulary NeRF Decompositioncited by 13
- 2024Frontiers in Intelligent Colonoscopycited by 13
- 2024SAM Fewshot Finetuning for Anatomical Segmentation in Medical Imagescited by 12
- 2024HICEScore: A Hierarchical Metric for Image Captioning Evaluationcited by 12
- 2024ASI-Seg: Audio-Driven Surgical Instrument Segmentation with Surgeon Intention Understandingcited by 12
- 2025Enhancing SAM with Efficient Prompting and Preference Optimization for Semi-supervised Medical Image Segmentationcited by 12
- 2025CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentationcited by 12
- 2023RigNet++: Semantic Assisted Repetitive Image Guided Network for Depth Completioncited by 11
- 2024VIBESegmentator: Full Body MRI Segmentation for the NAKO and UK Biobankcited by 11
- 2025Noise-Inspired Diffusion Model for Generalizable Low-Dose CT Reconstructioncited by 11
- 2025GAMED-Snake: Gradient-aware Adaptive Momentum Evolution Deep Snake Model for Multi-organ Segmentationcited by 10
- 20253D Foundation Model for Generalizable Disease Detection in Head Computed Tomographycited by 10
- 2023When 3D Bounding-Box Meets SAM: Point Cloud Instance Segmentation with Weak-and-Noisy Supervisioncited by 9
- 2025Building a General SimCLR Self-Supervised Foundation Model Across Neurological Diseases to Advance 3D Brain MRI Diagnosescited by 9
- 2023Using Unreliable Pseudo-Labels for Label-Efficient Semantic Segmentationcited by 8
- 2024Surgical-DeSAM: Decoupling SAM for Instrument Segmentation in Robotic Surgerycited by 8
- 2024Polyp SAM 2: Advancing Zero shot Polyp Segmentation in Colorectal Cancer Detectioncited by 8
- 2024PSFHS Challenge Report: Pubic Symphysis and Fetal Head Segmentation from Intrapartum Ultrasound Imagescited by 8
- 2024Pixel super-resolved virtual staining of label-free tissue using diffusion modelscited by 8
- 2025MediSee: Reasoning-based Pixel-level Perception in Medical Imagescited by 8
- 2025CenterMamba-SAM: Center-Prioritized Scanning and Temporal Prototypes for Brain Lesion Segmentationcited by 8
- 2023Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)cited by 7
- 2023How to Efficiently Annotate Images for Best-Performing Deep Learning Based Segmentation Models: An Empirical Study with Weak and Noisy Annotations and Segment Anything Modelcited by 7
- 2024Augmenting Efficient Real-time Surgical Instrument Segmentation in Video with Point Tracking and Segment Anythingcited by 7
- 2024Embedded Visual Prompt Tuningcited by 7
50 most cited of 226 All 226 (JSON)
- 2026UniFLM: United Segmentation and Measurement on Fetal Limb Ultrasonic Image27 Aug 2026
- 2026TEAMS: Text-prompted spatiotEmporal dual-heAd Mamba Snake18 Aug 2026
- 2026Bootstrapping Vision-Language Model for Hysteroscopic Surgical Scene Segmentation10 Aug 2026
- 2026Generative AI and Foundation Models in Medical Image3 Aug 2026
- 2026Federated Medical Image Segmentation under Real-World Label Noise: A Benchmark Suite for Noisy Label Learning Method Selection15 Jun 2026
- 2026Enhancing MedSAM with a Lightweight Box Predictor for Medical Image Segmentation3 Jun 2026
- 2026Robust Cross-Domain Generalization Using Unlabeled Target Data with Source-Domain Supervision27 May 2026
- 2026Learning Emergent Modular Representations in Multi-modality Medical Vision Foundation Models21 May 2026
- 2026Edge Deep Learning in Computer Vision and Medical Diagnostics: A Comprehensive Survey7 May 2026
- 2026Robustness Evaluation of a Foundation Segmentation Model Under Simulated Domain Shifts in Abdominal CT: Implications for Health Digital Twin Deployment28 Apr 2026
- 2026Semantic Segmentation for Histopathology using Learned Regularization based on Global Proportions27 Apr 2026
- 2026CRC-SAM: SAM-Based Multi-Modal Segmentation and Quantification of Colorectal Cancer in CT, Colonoscopy, and Histology Images25 Apr 2026
38 more
- 2026DyABD: The Abdominal Muscle Segmentation in Dynamic MRI Benchmark25 Apr 2026
- 2026Is SAM3 ready for pathology segmentation?20 Apr 2026
- 2026Unified Ultrasound Intelligence Toward an End-to-End Agentic System18 Apr 2026
- 2026AdaLoRA-QAT: Adaptive Low-Rank and Quantization-Aware Segmentation1 Apr 2026
- 2026FOSCU: Feasibility of Synthetic MRI Generation via Duo-Diffusion Models for Enhancement of 3D U-Nets in Hepatic Segmentation31 Mar 2026
- 2026Adapting SAM to Nuclei Instance Segmentation and Classification via Cooperative Fine-Grained Refinement30 Mar 2026
- 2026AURORA: Adaptive Unified Representation for Robust Ultrasound Analysis19 Mar 2026
- 2026Training-free Temporal Object Tracking in Surgical Videos8 Mar 2026
- 2026GUIDE-US: Grade-Informed Unpaired Distillation of Encoder Knowledge from Histopathology to Micro-UltraSound22 Feb 2026
- 2026Promptable segmentation with region exploration enables minimal-effort expert-level prostate cancer delineation19 Feb 2026
- 2026Generative Latent Representations of 3D Brain MRI for Multi-Task Downstream Analysis in Down Syndrome14 Feb 2026
- 2026SAM3-LiteText: An Anatomical Study of the SAM3 Text Encoder for Efficient Vision-Language Segmentation12 Feb 2026
- 2026Opportunistic Promptable Segmentation: Leveraging Routine Radiological Annotations to Guide 3D CT Lesion Segmentation30 Jan 2026
- 2026From Specialist to Generalist: Unlocking SAM's Learning Potential on Unlabeled Medical Images25 Jan 2026
- 2026FMIR, a foundation model-based Image Registration Framework for Robust Image Registration24 Jan 2026
- 2026On The Robustness of Foundational 3D Medical Image Segmentation Models Against Imprecise Visual Prompts23 Jan 2026
- 2026Wetland mapping from sparse annotations with satellite image time series and temporal-aware segment anything model16 Jan 2026
- 2026BrainSegNet: A Novel Framework for Whole-Brain MRI Parcellation Enhanced by Large Models14 Jan 2026
- 2026Point Tracking as a Temporal Cue for Robust Myocardial Segmentation in Echocardiography Videos14 Jan 2026
- 2025Bridging the Perception-Cognition Gap:Re-engineering SAM2 with Hilbert-Mamba for Robust VLM-based Medical Diagnosis30 Dec 2025
- 2025Foundation Models in Biomedical Imaging: Turning Hype into Reality17 Dec 2025
- 2025FreqDINO: Frequency-Guided Adaptation for Generalized Boundary-Aware Ultrasound Image Segmentation12 Dec 2025
- 2025MedROV: Towards Real-Time Open-Vocabulary Detection Across Diverse Medical Imaging Modalities25 Nov 2025
- 2025SAM-MI: A Mask-Injected Framework for Enhancing Open-Vocabulary Semantic Segmentation with SAM25 Nov 2025
- 2025DCL-SE: Dynamic Curriculum Learning for Spatiotemporal Encoding of Brain Imaging19 Nov 2025
- 2025HSMix: Hard and Soft Mixing Data Augmentation for Medical Image Segmentation18 Nov 2025
- 2025TM-UNet: Token-Memory Enhanced Sequential Modeling for Efficient Medical Image Segmentation15 Nov 2025
- 2025FocusSDF: Boundary-Aware Learning for Medical Image Segmentation via Signed Distance Supervision14 Nov 2025
- 2025Glioma C6: A Novel Dataset for Training and Benchmarking Cell Segmentation10 Nov 2025
- 2025Covariance Descriptors Meet General Vision Encoders: Riemannian Deep Learning for Medical Image Classification6 Nov 2025
- 2025CenterMamba-SAM: Center-Prioritized Scanning and Temporal Prototypes for Brain Lesion Segmentation3 Nov 2025
- 2025VesSAM: Efficient Multi-Prompting for Segmenting Complex Vessel2 Nov 2025
- 2025ProstNFound+: A Prospective Study using Medical Foundation Models for Prostate Cancer Detection30 Oct 2025
- 2025Generative AI for Healthcare: Fundamentals, Challenges, and Perspectives28 Oct 2025
- 2025A Structured Review and Quantitative Profiling of Public Brain MRI Datasets for Foundation Model Development23 Oct 2025
- 2025Curvilinear Structure-preserving Unpaired Cross-domain Medical Image Translation22 Oct 2025
- 2025DuetMatch: Harmonizing Semi-Supervised Brain MRI Segmentation via Decoupled Branch Optimization17 Oct 2025
- 2025J-RAS: Mutual Adaptation for Medical Image Segmentation via Contrastive Retrieval-Augmented Joint Optimization11 Oct 2025
50 newest of 226 All 226 (JSON)
- 2025Noise-Inspired Diffusion Model for Generalizable Low-Dose CT Reconstructioncited by 11
- 2024Pixel super-resolved virtual staining of label-free tissue using diffusion modelscited by 8
- 2026FOSCU: Feasibility of Synthetic MRI Generation via Duo-Diffusion Models for Enhancement of 3D U-Nets in Hepatic Segmentationcited by 2
- 2025Diffusion Prism: Enhancing Diversity and Morphology Consistency in Mask-to-Image Diffusioncited by 1
- 2025AortaDiff: A Unified Multitask Diffusion Framework For Contrast-Free AAA Imagingcited by 0
- 2026Training-free Temporal Object Tracking in Surgical Videoscited by 0
- 2026FOSCU: Feasibility of Synthetic MRI Generation via Duo-Diffusion Models for Enhancement of 3D U-Nets in Hepatic Segmentation31 Mar 2026
- 2026Training-free Temporal Object Tracking in Surgical Videos8 Mar 2026
- 2025AortaDiff: A Unified Multitask Diffusion Framework For Contrast-Free AAA Imaging1 Oct 2025
- 2025Noise-Inspired Diffusion Model for Generalizable Low-Dose CT Reconstruction27 Jun 2025
- 2025Diffusion Prism: Enhancing Diversity and Morphology Consistency in Mask-to-Image Diffusion1 Jan 2025
- 2024Pixel super-resolved virtual staining of label-free tissue using diffusion models26 Oct 2024
- 2024Knowledge-enhanced Pretraining for Vision-language Pathology Foundation Model on Cancer Diagnosiscited by 21
- 2025Bridging the Perception-Cognition Gap:Re-engineering SAM2 with Hilbert-Mamba for Robust VLM-based Medical Diagnosiscited by 3
- 2025Evaluating Vision Language Model Adaptations for Radiology Report Generation in Low-Resource Languagescited by 0
- 2026Bootstrapping Vision-Language Model for Hysteroscopic Surgical Scene Segmentationcited by 0
- 2026Bootstrapping Vision-Language Model for Hysteroscopic Surgical Scene Segmentation10 Aug 2026
- 2025Bridging the Perception-Cognition Gap:Re-engineering SAM2 with Hilbert-Mamba for Robust VLM-based Medical Diagnosis30 Dec 2025
- 2025Evaluating Vision Language Model Adaptations for Radiology Report Generation in Low-Resource Languages2 May 2025
- 2024Knowledge-enhanced Pretraining for Vision-language Pathology Foundation Model on Cancer Diagnosis17 Dec 2024
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
- 2023Large-Vocabulary Segmentation for Medical Images with Text Promptscited by 60
- 2024TotalSegmentator MRI: Robust Sequence-independent Segmentation of Multiple Anatomic Structures in MRIcited by 58
- 2023Annotation-free Audio-Visual Segmentationcited by 44
- 2023Are Natural Domain Foundation Models Useful for Medical Image Classification?cited by 44
- 2024A large-scale multicenter breast cancer DCE-MRI benchmark dataset with expert segmentationscited by 40
- 2023The Multi-modality Cell Segmentation Challenge: Towards Universal Solutionscited by 39
- 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentationcited by 37
- 2024Multi-Scale and Detail-Enhanced Segment Anything Model for Salient Object Detectioncited by 29
- 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
- 2024Data-Centric Foundation Models in Computational Healthcare: A Surveycited by 27
12 most cited of 212 All 212 (JSON)
- 2026UniFLM: United Segmentation and Measurement on Fetal Limb Ultrasonic Image27 Aug 2026
- 2026Generative AI and Foundation Models in Medical Image3 Aug 2026
- 2026Federated Medical Image Segmentation under Real-World Label Noise: A Benchmark Suite for Noisy Label Learning Method Selection15 Jun 2026
- 2026Enhancing MedSAM with a Lightweight Box Predictor for Medical Image Segmentation3 Jun 2026
- 2026Robust Cross-Domain Generalization Using Unlabeled Target Data with Source-Domain Supervision27 May 2026
- 2026Learning Emergent Modular Representations in Multi-modality Medical Vision Foundation Models21 May 2026
- 2026Edge Deep Learning in Computer Vision and Medical Diagnostics: A Comprehensive Survey7 May 2026
- 2026Robustness Evaluation of a Foundation Segmentation Model Under Simulated Domain Shifts in Abdominal CT: Implications for Health Digital Twin Deployment28 Apr 2026
- 2026Semantic Segmentation for Histopathology using Learned Regularization based on Global Proportions27 Apr 2026
- 2026CRC-SAM: SAM-Based Multi-Modal Segmentation and Quantification of Colorectal Cancer in CT, Colonoscopy, and Histology Images25 Apr 2026
- 2026DyABD: The Abdominal Muscle Segmentation in Dynamic MRI Benchmark25 Apr 2026
- 2026Is SAM3 ready for pathology segmentation?20 Apr 2026
12 newest of 212 All 212 (JSON)