Medical Image Segmentation Using Deep Learning: A Survey
Not on the map. Why?
Abstract (arXiv)
Deep learning has been widely used for medical image segmentation and a large number of papers has been presented recording the success of deep learning in the field. In this paper, we present a comprehensive thematic survey on medical image segmentation using deep learning techniques. This paper makes two original contributions. Firstly, compared to traditional surveys that directly divide literatures of deep learning on medical image segmentation into many groups and introduce literatures in detail for each group, we classify currently popular literatures according to a multi-level structure from coarse to fine. Secondly, this paper focuses on supervised and weakly supervised learning approaches, without including unsupervised approaches since they have been introduced in many old surveys and they are not popular currently. For supervised learning approaches, we analyze literatures in three aspects: the selection of backbone networks, the design of network blocks, and the improvement of loss functions. For weakly supervised learning approaches, we investigate literature according to data augmentation, transfer learning, and interactive segmentation, separately. Compared to existing surveys, this survey classifies the literatures very differently from before and is more convenient for readers to understand the relevant rationale and will guide them to think of appropriate improvements in medical image segmentation based on deep learning approaches.
Key facts. Cited by 164 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 14; 2023: 27; 2024: 47; 2025: 46; 2026: 21.
164 papers.
Sort:
By area:
- 2023Customized Segment Anything Model for Medical Image Segmentationcited by 280
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 179
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 111
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2023AIROGS: Artificial Intelligence for RObust Glaucoma Screening Challengecited by 35
- 2024Image Segmentation in Foundation Model Era: A Surveycited by 35
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 33
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Modelcited by 32
- 2021iSegFormer: Interactive Segmentation via Transformers with Application to 3D Knee MR Imagescited by 28
- 2023A Recent Survey of Vision Transformers for Medical Image Segmentationcited by 23
- 2024FedFMS: Exploring Federated Foundation Models for Medical Image Segmentationcited by 21
- 2021Modality specific U-Net variants for biomedical image segmentation: A surveycited by 20
38 more
- 2023Unsupervised Semantic Segmentation Through Depth-Guided Feature Correlation and Samplingcited by 19
- 2024FairDomain: Achieving Fairness in Cross-Domain Medical Image Segmentation and Classificationcited by 19
- 2021Using Soft Labels to Model Uncertainty in Medical Image Segmentationcited by 18
- 2021A survey on shape-constraint deep learning for medical image segmentationcited by 16
- 2025Show and Segment: Universal Medical Image Segmentation via In-Context Learningcited by 16
- 2022MNet: Rethinking 2D/3D Networks for Anisotropic Medical Image Segmentationcited by 13
- 2022MKIS-Net: A Light-Weight Multi-Kernel Network for Medical Image Segmentationcited by 13
- 2021BT-Unet: A self-supervised learning framework for biomedical image segmentation using Barlow Twins with U-Net modelscited by 12
- 2023SPPNet: A Single-Point Prompt Network for Nuclei Image Segmentationcited by 12
- 2024Clustering Propagation for Universal Medical Image Segmentationcited by 12
- 2024CSWin-UNet: Transformer UNet with Cross-Shaped Windows for Medical Image Segmentationcited by 12
- 2026INSID3: Training-Free In-Context Segmentation with DINOv3cited by 12
- 2024S-SAM: SVD-based Fine-Tuning of Segment Anything Model for Medical Image Segmentationcited by 11
- 2024A Survey of Medical Vision-and-Language Applications and Their Techniquescited by 11
- 2022SS-3DCapsNet: Self-supervised 3D Capsule Networks for Medical Segmentation on Less Labeled Datacited by 10
- 2024SAM-MPA: Applying SAM to Few-shot Medical Image Segmentation using Mask Propagation and Auto-promptingcited by 9
- 2022Vector Quantisation for Robust Segmentationcited by 8
- 2023Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Modelcited by 8
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
- 2025MediSee: Reasoning-based Pixel-level Perception in Medical Imagescited by 8
- 2022Graph Flow: Cross-layer Graph Flow Distillation for Dual Efficient Medical Image Segmentationcited by 7
- 2022MMGL: Multi-Scale Multi-View Global-Local Contrastive learning for Semi-supervised Cardiac Image Segmentationcited by 7
- 2023Weakly Supervised Intracranial Hemorrhage Segmentation using Head-Wise Gradient-Infused Self-Attention Maps from a Swin Transformer in Categorical Learningcited by 6
- 2023DiffuseExpand: Expanding dataset for 2D medical image segmentation using diffusion modelscited by 6
- 2023Frequency Domain Adversarial Training for Robust Volumetric Medical Segmentationcited by 6
- 2024Masked LoGoNet: Fast and Accurate 3D Image Analysis for Medical Domaincited by 6
- 2024FedLPPA: Learning Personalized Prompt and Aggregation for Federated Weakly-supervised Medical Image Segmentationcited by 6
- 2024SimTxtSeg: Weakly-Supervised Medical Image Segmentation with Simple Text Cuescited by 6
- 2024Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignmentscited by 6
- 2023A Recycling Training Strategy for Medical Image Segmentation with Diffusion Denoising Modelscited by 5
- 2023Certification of Deep Learning Models for Medical Image Segmentationcited by 5
- 2023FairSeg: A Large-Scale Medical Image Segmentation Dataset for Fairness Learning Using Segment Anything Model with Fair Error-Bound Scalingcited by 5
- 2023CLASS-M: Adaptive stain separation-based contrastive learning with pseudo-labeling for histopathological image classificationcited by 5
- 2025Few-Shot Adaptation of Training-Free Foundation Model for 3D Medical Image Segmentationcited by 5
- 2025Enhancing Fetal Plane Classification Accuracy with Data Augmentation Using Diffusion Modelscited by 5
- 2025Conditional diffusion model with spatial attention and latent embedding for medical image segmentationcited by 5
- 2022Histogram of Oriented Gradients Meet Deep Learning: A Novel Multi-task Deep Network for Medical Image Semantic Segmentationcited by 4
- 2023AttResDU-Net: Medical Image Segmentation Using Attention-based Residual Double U-Netcited by 4
50 most cited of 164 All 164 (JSON)
- 2026Decouple, Purify and Unite: Semantic-Structural Prototype Learning for Federated Medical Segmentation3 Oct 2026
- 2026UI-VISA: U-Net Initialized Vascular Image Segmentation Architecture1 Sep 2026
- 2026GazeRefine: Expert Gaze as a Test-Time Prompt for Training-Free Medical Image Segmentation1 Sep 2026
- 2026MCSeg: Pre-training and Fine-tuning Volumetric Pyramid Transformer for Multi-modal Cardiac Image Segmentation31 Aug 2026
- 2026Evaluating the Effects of Inter-Observer and Model Variability on Radiological Peritoneal Cancer Index Assessment28 Aug 2026
- 2026FAN-LoRA: A Fourier-Adaptive Nonlinear Low-Rank Adaptor for Medical Foundation Model Domain Adaptation27 Aug 2026
- 2026Random Forest-Based Prediction of Bone Volume Fraction and Fracture Position from S-Parameters26 Jul 2026
- 2026Concept Alignment Contrast and Long-Short Prompt Memory for Test-Time Adaptation of SAM3 in Medical Image Segmentation22 Jun 2026
- 2026Beyond Visual Cues: CoT-Enhanced Reasoning for Semi-supervised Medical Image Segmentation16 Jun 2026
- 2026Measuring Prediction Uncertainty in Neural Cellular Automata26 May 2026
- 2026Vol-Mark: A Watermark for 3D Medical Volume Data Via Cubic Difference Expansion and Contrastive Learning6 May 2026
- 2026An Uncertainty-Aware Loss Function Incorporating Fuzzy Logic: Application to MRI Brain Image Segmentation13 Apr 2026
38 more
- 2026MedVeriSeg: Teaching LISA-Like Medical Segmentation Models to Verify Query Validity Without Extra Training11 Apr 2026
- 2026INSID3: Training-Free In-Context Segmentation with DINOv330 Mar 2026
- 2026Clore: Interactive Pathology Image Segmentation with Click-based Local Refinement29 Mar 2026
- 2026A Novel Framework using Intuitionistic Fuzzy Logic with U-Net and U-Net++ Architecture: A case Study of MRI Bain Image Segmentation15 Mar 2026
- 2026ActiveFreq: Integrating Active Learning and Frequency Domain Analysis for Interactive Segmentation12 Mar 2026
- 2026Explainable Continuous-Time Mask Refinement with Local Self-Similarity Priors for Medical Image Segmentation28 Feb 2026
- 2026Bladder Vessel Segmentation using a Hybrid Attention-Convolution Framework10 Feb 2026
- 2026An Intuitionistic Fuzzy Logic Driven UNet architecture: Application to Brain Image segmentation4 Feb 2026
- 2026VQ-Seg: Vector-Quantized Token Perturbation for Semi-Supervised Medical Image Segmentation15 Jan 2026
- 2025SwinTF3D: A Lightweight Multimodal Fusion Approach for Text-Guided 3D Medical Image Segmentation28 Dec 2025
- 2025Meta-learners for few-shot weakly-supervised optic disc and cup segmentation on fundus images17 Dec 2025
- 2025Improvise, Adapt, Overcome -- Telescopic Adapters for Efficient Fine-tuning of Vision Language Models in Medical Imaging15 Dec 2025
- 2025Harmonizing Generalization and Specialization: Uncertainty-Informed Collaborative Learning for Semi-supervised Medical Image Segmentation15 Dec 2025
- 2025PPBoost: Progressive Prompt Boosting for Text-Driven Medical Image Segmentation26 Nov 2025
- 2025Vision-Language Enhanced Foundation Model for Semi-Supervised Medical Image Segmentation24 Nov 2025
- 2025Not All Pixels Are Equal: Pixel-wise Meta-Learning for Medical Segmentation with Noisy Labels24 Nov 2025
- 2025Layer-wise Noise Guided Selective Wavelet Reconstruction for Robust Medical Image Segmentation20 Nov 2025
- 2025MediRound: Multi-Round Entity-Level Reasoning Segmentation in Medical Images15 Nov 2025
- 2025GroupKAN: Efficient Kolmogorov-Arnold Networks via Grouped Spline Modeling7 Nov 2025
- 2025BARL: Bilateral Alignment in Representation and Label Spaces for Semi-Supervised Volumetric Medical Image Segmentation19 Oct 2025
- 2025Needles in the Landscape: Semi-Supervised Pseudolabeling for Archaeological Site Discovery under Label Scarcity19 Oct 2025
- 2025Advances in Medical Image Segmentation: A Comprehensive Survey with a Focus on Lumbar Spine Applications1 Oct 2025
- 2025EVLF-FM: Explainable Vision Language Foundation Model for Medicine29 Sep 2025
- 2025MSA2-Net: Utilizing Self-Adaptive Convolution Module to Extract Multi-Scale Information in Medical Image Segmentation1 Sep 2025
- 2025RISE: Enhancing VLM Image Annotation with Self-Supervised Reasoning17 Aug 2025
- 2025Multivariate Planar Curves: A Statistical Framework for Shape Analysis in Images15 Aug 2025
- 2025Do Edges Matter? Investigating Edge-Enhanced Pre-Training for Medical Image Segmentation4 Aug 2025
- 2025HNOSeg-XS: Extremely Small Hartley Neural Operator for Efficient and Resolution-Robust 3D Image Segmentation10 Jul 2025
- 2025WoundAIssist: Development and Evaluation of an AI-Based Mobile Application for Remote Chronic Wound Care in Elderly Patients6 Jun 2025
- 2025A Comprehensive Study on Medical Image Segmentation using Deep Neural Networks4 Jun 2025
- 2025Hierarchical Self-Prompting SAM: A Prompt-Free Medical Image Segmentation Framework3 Jun 2025
- 2025Learning and Interpreting Gravitational-Wave Features from CNNs with a Random Forest Approach26 May 2025
- 2025Semi-Supervised Medical Image Segmentation via Dual Networks23 May 2025
- 2025Leveraging Segment Anything Model for Source-Free Domain Adaptation via Dual Feature Guided Auto-Prompting13 May 2025
- 2025MediSee: Reasoning-based Pixel-level Perception in Medical Images15 Apr 2025
- 2025Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion models15 Apr 2025
- 2025Zeus: Zero-shot LLM Instruction for Union Segmentation in Multimodal Medical Imaging9 Apr 2025
- 2025Gaze-Guided Learning: Avoiding Shortcut Bias in Visual Classification8 Apr 2025
50 newest of 164 All 164 (JSON)
- 2024Image Segmentation in Foundation Model Era: A Surveycited by 35
- 2023Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Modelcited by 8
- 2023DiffuseExpand: Expanding dataset for 2D medical image segmentation using diffusion modelscited by 6
- 2023A Recycling Training Strategy for Medical Image Segmentation with Diffusion Denoising Modelscited by 5
- 2023Certification of Deep Learning Models for Medical Image Segmentationcited by 5
- 2025Enhancing Fetal Plane Classification Accuracy with Data Augmentation Using Diffusion Modelscited by 5
- 2025Conditional diffusion model with spatial attention and latent embedding for medical image segmentationcited by 5
- 2023Surf-CDM: Score-Based Surface Cold-Diffusion Model For Medical Image Segmentationcited by 2
- 2025Diffusion Transformer Meets Random Masks: An Advanced PET Reconstruction Frameworkcited by 1
- 2025Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion modelscited by 0
- 2025Bringing together invertible UNets with invertible attention modules for memory-efficient diffusion models15 Apr 2025
- 2025Diffusion Transformer Meets Random Masks: An Advanced PET Reconstruction Framework11 Mar 2025
- 2025Conditional diffusion model with spatial attention and latent embedding for medical image segmentation10 Feb 2025
- 2025Enhancing Fetal Plane Classification Accuracy with Data Augmentation Using Diffusion Models25 Jan 2025
- 2024Image Segmentation in Foundation Model Era: A Survey23 Aug 2024
- 2023Surf-CDM: Score-Based Surface Cold-Diffusion Model For Medical Image Segmentation19 Dec 2023
- 2023Certification of Deep Learning Models for Medical Image Segmentation5 Oct 2023
- 2023A Recycling Training Strategy for Medical Image Segmentation with Diffusion Denoising Models30 Aug 2023
- 2023Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Model16 May 2023
- 2023DiffuseExpand: Expanding dataset for 2D medical image segmentation using diffusion models26 Apr 2023
- 2025Topology-Aware Wavelet Mamba for Airway Structure Segmentation in Postoperative Recurrent Nasopharyngeal Carcinoma CT Scanscited by 1
- 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentationcited by 0
- 2025KM-UNet KAN Mamba UNet for medical image segmentationcited by 0
- 2025Topology-Aware Wavelet Mamba for Airway Structure Segmentation in Postoperative Recurrent Nasopharyngeal Carcinoma CT Scans20 Feb 2025
- 2025KM-UNet KAN Mamba UNet for medical image segmentation5 Jan 2025
- 2024When Mamba Meets xLSTM: An Efficient and Precise Method with the xLSTM-VMUNet Model for Skin lesion Segmentation14 Nov 2024
- 2024Machine Unlearning for Medical Imagingcited by 2
- 2024Machine Unlearning for Medical Imaging10 Jul 2024
- 2023Customized Segment Anything Model for Medical Image Segmentationcited by 280
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 179
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 111
- 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
- 2023AIROGS: Artificial Intelligence for RObust Glaucoma Screening Challengecited by 35
- 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 33
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Modelcited by 32
- 2021iSegFormer: Interactive Segmentation via Transformers with Application to 3D Knee MR Imagescited by 28
- 2023A Recent Survey of Vision Transformers for Medical Image Segmentationcited by 23
- 2024FedFMS: Exploring Federated Foundation Models for Medical Image Segmentationcited by 21
- 2021Modality specific U-Net variants for biomedical image segmentation: A surveycited by 20
- 2023Unsupervised Semantic Segmentation Through Depth-Guided Feature Correlation and Samplingcited by 19
12 most cited of 145 All 145 (JSON)
- 2026Decouple, Purify and Unite: Semantic-Structural Prototype Learning for Federated Medical Segmentation3 Oct 2026
- 2026UI-VISA: U-Net Initialized Vascular Image Segmentation Architecture1 Sep 2026
- 2026GazeRefine: Expert Gaze as a Test-Time Prompt for Training-Free Medical Image Segmentation1 Sep 2026
- 2026MCSeg: Pre-training and Fine-tuning Volumetric Pyramid Transformer for Multi-modal Cardiac Image Segmentation31 Aug 2026
- 2026Evaluating the Effects of Inter-Observer and Model Variability on Radiological Peritoneal Cancer Index Assessment28 Aug 2026
- 2026FAN-LoRA: A Fourier-Adaptive Nonlinear Low-Rank Adaptor for Medical Foundation Model Domain Adaptation27 Aug 2026
- 2026Random Forest-Based Prediction of Bone Volume Fraction and Fracture Position from S-Parameters26 Jul 2026
- 2026Concept Alignment Contrast and Long-Short Prompt Memory for Test-Time Adaptation of SAM3 in Medical Image Segmentation22 Jun 2026
- 2026Measuring Prediction Uncertainty in Neural Cellular Automata26 May 2026
- 2026Vol-Mark: A Watermark for 3D Medical Volume Data Via Cubic Difference Expansion and Contrastive Learning6 May 2026
- 2026An Uncertainty-Aware Loss Function Incorporating Fuzzy Logic: Application to MRI Brain Image Segmentation13 Apr 2026
- 2026MedVeriSeg: Teaching LISA-Like Medical Segmentation Models to Verify Query Validity Without Extra Training11 Apr 2026
12 newest of 145 All 145 (JSON)