SAM3D: Segment Anything Model in Volumetric Medical Images
Not on the map. Why?
Abstract (arXiv)
Image segmentation remains a pivotal component in medical image analysis, aiding in the extraction of critical information for precise diagnostic practices. With the advent of deep learning, automated image segmentation methods have risen to prominence, showcasing exceptional proficiency in processing medical imagery. Motivated by the Segment Anything Model (SAM)-a foundational model renowned for its remarkable precision and robust generalization capabilities in segmenting 2D natural images-we introduce SAM3D, an innovative adaptation tailored for 3D volumetric medical image analysis. Unlike current SAM-based methods that segment volumetric data by converting the volume into separate 2D slices for individual analysis, our SAM3D model processes the entire 3D volume image in a unified approach. Extensive experiments are conducted on multiple medical image datasets to demonstrate that our network attains competitive results compared with other state-of-the-art methods in 3D medical segmentation tasks while being significantly efficient in terms of parameters. Code and checkpoints are available at https://github.com/UARK-AICV/SAM3D.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 25 of its 36 references that are in the map. First posted on arXiv 7 Sep 2023.
Builds on
25 of 36 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Segment Anythingcited by 8,234
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
13 more
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 373
- 2023Customized Segment Anything Model for Medical Image Segmentationcited by 280
- 2019ResUNet++: An Advanced Architecture for Medical Image Segmentationcited by 211
- 2023SegGPT: Segmenting Everything In Contextcited by 194
- 2019Reducing the Hausdorff Distance in Medical Image Segmentation with Convolutional Neural Networkscited by 116
- 2022UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentationcited by 112
- 2021MISSFormer: An Effective Medical Image Segmentation Transformercited by 103
- 2022HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentationcited by 95
- 2022TransDeepLab: Convolution-Free Transformer-based DeepLab v3+ for Medical Image Segmentationcited by 43
Built on by
Citing papers per year: 2023: 5; 2024: 16; 2025: 10; 2026: 3.
34 papers.
Sort:
By area:
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 107
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imagingcited by 64
- 2023SA-Med2D-20M Dataset: Segment Anything in 2D Medical Imaging with 20 Million maskscited by 55
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Modelcited by 32
- 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
- 2024Segment anything model 2: an application to 2D and 3D medical imagescited by 28
- 2023I-MedSAM: Implicit Medical Image Segmentation with Segment Anythingcited by 22
- 2024Retrieval-augmented Few-shot Medical Image Segmentation with Foundation Modelscited by 20
- 2024FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Imagescited by 14
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptationcited by 12
- 2023I-AI: A Controllable & Interpretable AI System for Decoding Radiologists' Intense Focus for Accurate CXR Diagnosescited by 10
22 more
- 2024M2Depth: Self-supervised Two-Frame Multi-camera Metric Depth Estimationcited by 10
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
- 2025Recent Advances in Medical Imaging Segmentation: A Surveycited by 8
- 2023Slide-SAM: Medical SAM Meets Sliding Windowcited by 6
- 2025MedicoSAM: Robust Improvement of SAM for Medical Imagingcited by 6
- 2024Mask-Enhanced Segment Anything Model for Tumor Lesion Semantic Segmentationcited by 4
- 2024MaskSAM: Towards Auto-prompt SAM with Mask Classification for Volumetric Medical Image Segmentationcited by 4
- 2024SAM & SAM 2 in 3D Slicer: SegmentWithSAM Extension for Annotating Medical Imagescited by 3
- 2025OmniMRI: A Unified Vision--Language Foundation Model for Generalist MRI Interpretationcited by 3
- 2024MOSformer: Momentum encoder-based inter-slice fusion transformer for medical image segmentationcited by 2
- 2024Anytime, Anywhere, Anyone: Investigating the Feasibility of Segment Anything Model for Crowd-Sourcing Medical Image Annotationscited by 2
- 2024SAM-EG: Segment Anything Model with Egde Guidance framework for efficient Polyp Segmentationcited by 2
- 2025Generalist Models in Medical Image Segmentation: A Survey and Performance Comparison with Task-Specific Approachescited by 2
- 2024Post-Training Network Compression for 3D Medical Image Segmentation: Reducing Computational Efforts via Tucker Decompositioncited by 1
- 2025Neuroverse3D: Developing In-Context Learning Universal Model for Neuroimaging in 3Dcited by 1
- 2026Opportunistic Promptable Segmentation: Leveraging Routine Radiological Annotations to Guide 3D CT Lesion Segmentationcited by 1
- 2024Memorizing SAM: 3D Medical Segment Anything Model with Memorizing Transformercited by 0
- 2025UNetVL: Enhancing 3D Medical Image Segmentation with Chebyshev KAN Powered Vision-LSTMcited by 0
- 2025TAGS: 3D Tumor-Adaptive Guidance for SAMcited by 0
- 2025A Self-training Framework for Semi-supervised Pulmonary Vessel Segmentation and Its Application in COPDcited by 0
- 20263D Segment Anything Model with Visual Mamba for Diagnosing Placenta Accreta Spectrumcited by 0
- 2026MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentationcited by 0
- 2026MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentation1 Jul 2026
- 20263D Segment Anything Model with Visual Mamba for Diagnosing Placenta Accreta Spectrum30 May 2026
- 2026Opportunistic Promptable Segmentation: Leveraging Routine Radiological Annotations to Guide 3D CT Lesion Segmentation30 Jan 2026
- 2025OmniMRI: A Unified Vision--Language Foundation Model for Generalist MRI Interpretation24 Aug 2025
- 2025A Self-training Framework for Semi-supervised Pulmonary Vessel Segmentation and Its Application in COPD25 Jul 2025
- 2025Generalist Models in Medical Image Segmentation: A Survey and Performance Comparison with Task-Specific Approaches12 Jun 2025
- 2025TAGS: 3D Tumor-Adaptive Guidance for SAM21 May 2025
- 2025Recent Advances in Medical Imaging Segmentation: A Survey14 May 2025
- 2025Neuroverse3D: Developing In-Context Learning Universal Model for Neuroimaging in 3D4 Mar 2025
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Review16 Feb 2025
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptation2 Feb 2025
- 2025MedicoSAM: Robust Improvement of SAM for Medical Imaging20 Jan 2025
22 more
- 2025UNetVL: Enhancing 3D Medical Image Segmentation with Chebyshev KAN Powered Vision-LSTM13 Jan 2025
- 2024Memorizing SAM: 3D Medical Segment Anything Model with Memorizing Transformer18 Dec 2024
- 2024SAM & SAM 2 in 3D Slicer: SegmentWithSAM Extension for Annotating Medical Images27 Aug 2024
- 2024Retrieval-augmented Few-shot Medical Image Segmentation with Foundation Models16 Aug 2024
- 2024Segment anything model 2: an application to 2D and 3D medical images1 Aug 2024
- 2024SAM-EG: Segment Anything Model with Egde Guidance framework for efficient Polyp Segmentation21 Jun 2024
- 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imaging7 Jun 2024
- 2024M2Depth: Self-supervised Two-Frame Multi-camera Metric Depth Estimation3 May 2024
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Model15 Apr 2024
- 2024Post-Training Network Compression for 3D Medical Image Segmentation: Reducing Computational Efforts via Tucker Decomposition15 Apr 2024
- 2024Anytime, Anywhere, Anyone: Investigating the Feasibility of Segment Anything Model for Crowd-Sourcing Medical Image Annotations22 Mar 2024
- 2024MaskSAM: Towards Auto-prompt SAM with Mask Classification for Volumetric Medical Image Segmentation21 Mar 2024
- 2024FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Images14 Mar 2024
- 2024Mask-Enhanced Segment Anything Model for Tumor Lesion Semantic Segmentation9 Mar 2024
- 2024MOSformer: Momentum encoder-based inter-slice fusion transformer for medical image segmentation22 Jan 2024
- 2024Foundation Models for Biomedical Image Segmentation: A Survey15 Jan 2024
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directions7 Jan 2024
- 2023I-MedSAM: Implicit Medical Image Segmentation with Segment Anything28 Nov 2023
- 2023SA-Med2D-20M Dataset: Segment Anything in 2D Medical Imaging with 20 Million masks20 Nov 2023
- 2023Slide-SAM: Medical SAM Meets Sliding Window16 Nov 2023
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Images23 Oct 2023
- 2023I-AI: A Controllable & Interpretable AI System for Decoding Radiologists' Intense Focus for Accurate CXR Diagnoses24 Sep 2023
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 107
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imagingcited by 64
- 2023SA-Med2D-20M Dataset: Segment Anything in 2D Medical Imaging with 20 Million maskscited by 55
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Modelcited by 32
- 2024Foundation Models for Biomedical Image Segmentation: A Surveycited by 28
- 2024Segment anything model 2: an application to 2D and 3D medical imagescited by 28
- 2023I-MedSAM: Implicit Medical Image Segmentation with Segment Anythingcited by 22
- 2024Retrieval-augmented Few-shot Medical Image Segmentation with Foundation Modelscited by 20
- 2024FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Imagescited by 14
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptationcited by 12
- 2023I-AI: A Controllable & Interpretable AI System for Decoding Radiologists' Intense Focus for Accurate CXR Diagnosescited by 10
12 most cited of 33 All 33 (JSON)
- 2026MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentation1 Jul 2026
- 2026Opportunistic Promptable Segmentation: Leveraging Routine Radiological Annotations to Guide 3D CT Lesion Segmentation30 Jan 2026
- 2025OmniMRI: A Unified Vision--Language Foundation Model for Generalist MRI Interpretation24 Aug 2025
- 2025A Self-training Framework for Semi-supervised Pulmonary Vessel Segmentation and Its Application in COPD25 Jul 2025
- 2025Generalist Models in Medical Image Segmentation: A Survey and Performance Comparison with Task-Specific Approaches12 Jun 2025
- 2025TAGS: 3D Tumor-Adaptive Guidance for SAM21 May 2025
- 2025Recent Advances in Medical Imaging Segmentation: A Survey14 May 2025
- 2025Neuroverse3D: Developing In-Context Learning Universal Model for Neuroimaging in 3D4 Mar 2025
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Review16 Feb 2025
- 2025Self-Prompt SAM: Medical Image Segmentation via Automatic Prompt SAM Adaptation2 Feb 2025
- 2025MedicoSAM: Robust Improvement of SAM for Medical Imaging20 Jan 2025
- 2025UNetVL: Enhancing 3D Medical Image Segmentation with Chebyshev KAN Powered Vision-LSTM13 Jan 2025
12 newest of 33 All 33 (JSON)