Image Segmentation Using Deep Learning: A Survey
Not on the map. Why?
Abstract (arXiv)
Image segmentation is a key topic in image processing and computer vision with applications such as scene understanding, medical image analysis, robotic perception, video surveillance, augmented reality, and image compression, among many others. Various algorithms for image segmentation have been developed in the literature. Recently, due to the success of deep learning models in a wide range of vision applications, there has been a substantial amount of works aimed at developing image segmentation approaches using deep learning models. In this survey, we provide a comprehensive review of the literature at the time of this writing, covering a broad spectrum of pioneering works for semantic and instance-level segmentation, including fully convolutional pixel-labeling networks, encoder-decoder architectures, multi-scale and pyramid based approaches, recurrent networks, visual attention models, and generative models in adversarial settings. We investigate the similarity, strengths and challenges of these deep learning models, examine the most widely used datasets, report performances, and discuss promising future research directions in this area.
Key facts. Cited by 659 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 94; 2022: 123; 2023: 151; 2024: 139; 2025: 110; 2026: 42.
659 papers.
Sort:
By area:
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2022Language-driven Semantic Segmentationcited by 711
- 2023Segment Everything Everywhere All at Oncecited by 546
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023Segment Anything in Medical Imagescited by 226
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
- 2023A Simple Framework for Open-Vocabulary Segmentation and Detectioncited by 197
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
- 2022Medical Image Segmentation Review: The success of U-Netcited by 190
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
38 more
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 180
- 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2023Structured Pruning for Deep Convolutional Neural Networks: A surveycited by 122
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2023A Comprehensive Survey of Dataset Distillationcited by 114
- 2021Perturbed and Strict Mean Teachers for Semi-supervised Semantic Segmentationcited by 113
- 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
- 2022Image Data Augmentation for Deep Learning: A Surveycited by 96
- 2021Adversarial Sticker: A Stealthy Attack Method in the Physical Worldcited by 92
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2023LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Imagescited by 87
- 2021Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrastcited by 85
- 2022Temporal Action Segmentation: An Analysis of Modern Techniquescited by 85
- 2023The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shotcited by 83
- 2024Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentationcited by 76
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 74
- 2024OMG-Seg: Is One Model Good Enough For All Segmentation?cited by 73
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 70
- 2022Open-world Semantic Segmentation via Contrasting and Clustering Vision-Language Embeddingcited by 67
- 2022Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentationcited by 65
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2021Evaluating the Robustness of Semantic Segmentation for Autonomous Driving against Real-World Adversarial Patch Attackscited by 55
- 2021Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentationcited by 54
- 2022Discovering Object Masks with Transformers for Unsupervised Semantic Segmentationcited by 54
- 2023Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentationcited by 53
- 2023Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligencecited by 52
- 2021ZeroWaste Dataset: Towards Deformable Object Segmentation in Cluttered Scenescited by 47
- 2024UnlearnCanvas: Stylized Image Dataset for Enhanced Machine Unlearning Evaluation in Diffusion Modelscited by 47
- 2021Defending against Model Stealing via Verifying Embedded External Featurescited by 44
- 2021Look Closer to Segment Better: Boundary Patch Refinement for Instance Segmentationcited by 43
- 2021Learning Multiple Dense Prediction Tasks from Partially Annotated Datacited by 42
- 2022PseudoClick: Interactive Image Segmentation with Click Imitationcited by 42
- 2021Boundary-Aware Segmentation Network for Mobile and Web Applicationscited by 41
- 2022Simultaneously Optimizing Perturbations and Positions for Black-box Adversarial Patch Attackscited by 41
- 2023MobileSAMv2: Faster Segment Anything to Everythingcited by 41
- 2021Active Boundary Loss for Semantic Segmentationcited by 40
50 most cited of 659 All 659 (JSON)
- 2026Exploring Learning Models for Topological Relationship Recognition from Image Data28 Sep 2026
- 2026AHMAD: Adaptive Hybrid Multi-task Vision Learning with Assisted Distillation for Keypoint Detection28 Sep 2026
- 2026SomaNet: Weakly Supervised Learning for Instance Soma Segmentation in 3D Electron Microscopy with Partial Annotations19 Sep 2026
- 2026MambaMPD: A Mamba-Driven Segmentation Framework for Marine Pollution Detection from Remote Sensing Imagery14 Sep 2026
- 2026CoordFormer: Give Me Any Coordinates and I Will Give You Labels8 Sep 2026
- 2026MARS-CLIP: Multi-Resolution and Attention Refined Zero-Shot Image Segmentation8 Sep 2026
- 2026The Impact of CutMix on Reliability and Robustness in Semantic Segmentation19 Aug 2026
- 2026BASeg: Boundary-Aware Remote Sensing Segmentation with Structural Penalties16 Aug 2026
- 2026Weakly Supervised Polar Low Segmentation in Sentinel-1 SAR Imagery14 Aug 2026
- 2026ProBAG: Prototype-Guided Boundary-Aware Graph Diffusion for Weakly Supervised Histopathology Segmentation12 Aug 2026
- 2026ZMIS-SAM: Segment Anything Model Enhanced with Wavelet Transform for Zooplankton Microscopy Image Instance Segmentation30 Jul 2026
- 2026From Reconstruction to Interpretation: Zero-Setup Multi-Phase Segmentation of X-ray Tomography Data13 Jul 2026
38 more
- 2026Unsupervised Detection of Entry and Exit Regions from Vehicle Trajectories for Camera-Agnostic Turning Movement Counts12 Jul 2026
- 2026Secure-by-Disguise: A Systematic Evaluation of Image Disguising for Confidential Medical Image Modeling9 Jul 2026
- 2026Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Task1 Jul 2026
- 2026Mask Proposal Voting Based on Geodesic Framework for Robust Image Segmentation12 Jun 2026
- 2026Compute-Optimal Network Design for Echocardiography Myocardial Segmentation and Perfusion Quantification using Neural Scaling Laws4 Jun 2026
- 2026CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferences30 May 2026
- 2026Geodesics with Unified Tangent-constrained Priors and Curvature Regularization28 May 2026
- 2026Electricity Consumption Forecasting: An Approach Using Cooperative Ensemble Learning with SHapley Additive exPlanations25 May 2026
- 2026Low-Cost Stereo Vision for Robust 3D Positioning of Thin Radiata Pine Branches in Autonomous Drone Pruning6 May 2026
- 2026Positioning radiata pine branches requiring pruning by drone stereo vision12 Apr 2026
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentation25 Mar 2026
- 2026Single-Eye View: Monocular Real-time Perception Package for Autonomous Driving22 Mar 2026
- 2026In-the-Wild Camouflage Attack on Vehicle Detectors through Controllable Image Editing19 Mar 2026
- 2026Fast and Generalizable NeRF Architecture Selection for Satellite Scene Reconstruction18 Mar 2026
- 2026Data-Centric Benchmark for Label Noise Estimation and Ranking in Remote Sensing Binary Building Segmentation28 Feb 2026
- 2026Leveraging GenAI for Segmenting and Labeling Centuries-old Technical Documents24 Feb 2026
- 2026Redefining the Down-Sampling Scheme of U-Net for Precision Biomedical Image Segmentation23 Feb 2026
- 2026Bayesian Optimization for Design Parameters of 3D Image Data Analysis17 Feb 2026
- 2026AurigaNet: A Real-Time Multi-Task Network for Enhanced Urban Driving Perception11 Feb 2026
- 2026Automated rock joint trace mapping using a supervised learning model trained on synthetic data generated by parametric modelling7 Feb 2026
- 2026Generalization of Self-Supervised Vision Transformers for Protein Localization Across Microscopy Domains5 Feb 2026
- 2026RECITYGEN -- Interactive and Generative Participatory Urban Design Tool with Latent Diffusion and Segment Anything4 Feb 2026
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation3 Feb 2026
- 2026PDE-Constrained Optimization for Neural Image Segmentation with Physics Priors1 Feb 2026
- 2026Evaluating Deep Learning-Based Nerve Segmentation in Brachial Plexus Ultrasound Under Realistic Data Constraints31 Jan 2026
- 2026DTC: A Deformable Transposed Convolution Module for Medical Image Segmentation25 Jan 2026
- 2026Deep Learning for Semantic Segmentation of 3D Ultrasound Data19 Jan 2026
- 2026Jordan-Segmentable Masks: A Topology-Aware definition for characterizing Binary Image Segmentation15 Jan 2026
- 2026DR2Seg: Decomposed Two-Stage Rollouts for Efficient Reasoning Segmentation in Multimodal Large Language Models15 Jan 2026
- 2026The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Models12 Jan 2026
- 20256DAttack: Backdoor Attacks in the 6DoF Pose Estimation22 Dec 2025
- 2025Automated Mosaic Tesserae Segmentation via Deep Learning Techniques20 Dec 2025
- 2025MedNeXt-v2: Scaling 3D ConvNeXts for Large-Scale Supervised Representation Learning in Medical Image Segmentation19 Dec 2025
- 2025WDFFU-Mamba: A Wavelet-guided Dual-attention Feature Fusion Mamba for Breast Tumor Segmentation in Ultrasound Images19 Dec 2025
- 2025Meta-learners for few-shot weakly-supervised optic disc and cup segmentation on fundus images17 Dec 2025
- 2025Neurosymbolic Inference On Foundation Models For Remote Sensing Text-to-image Retrieval With Complex Queries16 Dec 2025
- 2025DualProtoSeg: Simple and Efficient Design with Text- and Image-Guided Prototype Learning for Weakly Supervised Histopathology Image Segmentation11 Dec 2025
- 2025R2MF-Net: A Recurrent Residual Multi-Path Fusion Network for Robust Multi-directional Spine X-ray Segmentation8 Dec 2025
50 newest of 659 All 659 (JSON)
- 2024UnlearnCanvas: Stylized Image Dataset for Enhanced Machine Unlearning Evaluation in Diffusion Modelscited by 47
- 2024Image Segmentation in Foundation Model Era: A Surveycited by 35
- 2022GLFF: Global and Local Feature Fusion for AI-synthesized Image Detectioncited by 25
- 2024A Simple Latent Diffusion Approach for Panoptic Segmentation and Mask Inpaintingcited by 18
- 2023Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classificationcited by 16
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentationcited by 2
- 2024PGDiffSeg: Prior-Guided Denoising Diffusion Model with Parameter-Shared Attention for Breast Cancer Segmentationcited by 1
- 2024Structure-Aware Stylized Image Synthesis for Robust Medical Image Segmentationcited by 0
- 2026RECITYGEN -- Interactive and Generative Participatory Urban Design Tool with Latent Diffusion and Segment Anythingcited by 0
- 20263D-LLDM: Label-Guided 3D Latent Diffusion Model for Improving High-Resolution Synthetic MR Imaging in Hepatic Structure Segmentation25 Mar 2026
- 2026RECITYGEN -- Interactive and Generative Participatory Urban Design Tool with Latent Diffusion and Segment Anything4 Feb 2026
- 2024Structure-Aware Stylized Image Synthesis for Robust Medical Image Segmentation5 Dec 2024
- 2024PGDiffSeg: Prior-Guided Denoising Diffusion Model with Parameter-Shared Attention for Breast Cancer Segmentation23 Oct 2024
- 2024Image Segmentation in Foundation Model Era: A Survey23 Aug 2024
- 2024UnlearnCanvas: Stylized Image Dataset for Enhanced Machine Unlearning Evaluation in Diffusion Models19 Feb 2024
- 2024A Simple Latent Diffusion Approach for Panoptic Segmentation and Mask Inpainting18 Jan 2024
- 2023Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification4 Feb 2023
- 2022GLFF: Global and Local Feature Fusion for AI-synthesized Image Detection16 Nov 2022
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 74
- 2023u-LLaVA: Unifying Multi-Modal Tasks via Large Language Modelcited by 24
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 18
- 2025PixFoundation: Are We Heading in the Right Direction with Pixel-level Vision Foundation Models?cited by 4
- 2025SurgMLLMBench: A Multimodal Large Language Model Benchmark Dataset for Surgical Scene Understandingcited by 2
- 2025Neurosymbolic Inference On Foundation Models For Remote Sensing Text-to-image Retrieval With Complex Queriescited by 1
- 2026Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Taskcited by 0
- 2026Disentangling Pictorial Cue Understanding from Language Bias in VLMs via Depth Ordering Task1 Jul 2026
- 2025Neurosymbolic Inference On Foundation Models For Remote Sensing Text-to-image Retrieval With Complex Queries16 Dec 2025
- 2025SurgMLLMBench: A Multimodal Large Language Model Benchmark Dataset for Surgical Scene Understanding26 Nov 2025
- 2025PixFoundation: Are We Heading in the Right Direction with Pixel-level Vision Foundation Models?6 Feb 2025
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey26 Nov 2024
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understanding25 Oct 2024
- 2023u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model9 Nov 2023
- 2021Membership Inference Attacks are Easier on Difficult Problemscited by 16
- 2021Membership Inference Attacks Against Temporally Correlated Data in Deep Reinforcement Learningcited by 3
- 2022Improving Performance of Semantic Segmentation CycleGANs by Noise Injection into the Latent Segmentation Spacecited by 2
- 2025THEMIS: Towards Practical Intellectual Property Protection for Post-Deployment On-Device Deep Learning Modelscited by 2
- 2023Mask and Restore: Blind Backdoor Defense at Test Time with Masked Autoencodercited by 1
- 2025THEMIS: Towards Practical Intellectual Property Protection for Post-Deployment On-Device Deep Learning Models31 Mar 2025
- 2023Mask and Restore: Blind Backdoor Defense at Test Time with Masked Autoencoder27 Mar 2023
- 2022Improving Performance of Semantic Segmentation CycleGANs by Noise Injection into the Latent Segmentation Space17 Jan 2022
- 2021Membership Inference Attacks Against Temporally Correlated Data in Deep Reinforcement Learning8 Sep 2021
- 2021Membership Inference Attacks are Easier on Difficult Problems15 Feb 2021
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
- 2024MSCrackMamba: Leveraging Vision Mamba for Crack Detection in Fused Multispectral Imagerycited by 0
- 2025FaRMamba: Frequency-based learning and Reconstruction aided Mamba for Medical Segmentationcited by 0
- 2025WDFFU-Mamba: A Wavelet-guided Dual-attention Feature Fusion Mamba for Breast Tumor Segmentation in Ultrasound Imagescited by 0
- 2026MambaMPD: A Mamba-Driven Segmentation Framework for Marine Pollution Detection from Remote Sensing Imagerycited by 0
- 2026MambaMPD: A Mamba-Driven Segmentation Framework for Marine Pollution Detection from Remote Sensing Imagery14 Sep 2026
- 2025WDFFU-Mamba: A Wavelet-guided Dual-attention Feature Fusion Mamba for Breast Tumor Segmentation in Ultrasound Images19 Dec 2025
- 2025FaRMamba: Frequency-based learning and Reconstruction aided Mamba for Medical Segmentation26 Jul 2025
- 2024MSCrackMamba: Leveraging Vision Mamba for Crack Detection in Fused Multispectral Imagery9 Dec 2024
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation9 Jan 2024
- 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matricescited by 37
- 2022A Review of Emerging Research Directions in Abstract Visual Reasoningcited by 33
- 2026DR2Seg: Decomposed Two-Stage Rollouts for Efficient Reasoning Segmentation in Multimodal Large Language Modelscited by 3
- 2026DR2Seg: Decomposed Two-Stage Rollouts for Efficient Reasoning Segmentation in Multimodal Large Language Models15 Jan 2026
- 2022A Review of Emerging Research Directions in Abstract Visual Reasoning21 Feb 2022
- 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matrices28 Jan 2022
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2022Language-driven Semantic Segmentationcited by 711
- 2023Segment Everything Everywhere All at Oncecited by 546
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023Segment Anything in Medical Imagescited by 226
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
- 2023A Simple Framework for Open-Vocabulary Segmentation and Detectioncited by 197
- 2021Learning Distilled Collaboration Graph for Multi-Agent Perceptioncited by 194
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
- 2022Medical Image Segmentation Review: The success of U-Netcited by 190
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 180
12 most cited of 624 All 624 (JSON)
- 2026Exploring Learning Models for Topological Relationship Recognition from Image Data28 Sep 2026
- 2026AHMAD: Adaptive Hybrid Multi-task Vision Learning with Assisted Distillation for Keypoint Detection28 Sep 2026
- 2026SomaNet: Weakly Supervised Learning for Instance Soma Segmentation in 3D Electron Microscopy with Partial Annotations19 Sep 2026
- 2026CoordFormer: Give Me Any Coordinates and I Will Give You Labels8 Sep 2026
- 2026MARS-CLIP: Multi-Resolution and Attention Refined Zero-Shot Image Segmentation8 Sep 2026
- 2026The Impact of CutMix on Reliability and Robustness in Semantic Segmentation19 Aug 2026
- 2026BASeg: Boundary-Aware Remote Sensing Segmentation with Structural Penalties16 Aug 2026
- 2026Weakly Supervised Polar Low Segmentation in Sentinel-1 SAR Imagery14 Aug 2026
- 2026ProBAG: Prototype-Guided Boundary-Aware Graph Diffusion for Weakly Supervised Histopathology Segmentation12 Aug 2026
- 2026ZMIS-SAM: Segment Anything Model Enhanced with Wavelet Transform for Zooplankton Microscopy Image Instance Segmentation30 Jul 2026
- 2026From Reconstruction to Interpretation: Zero-Setup Multi-Phase Segmentation of X-ray Tomography Data13 Jul 2026
- 2026Unsupervised Detection of Entry and Exit Regions from Vehicle Trajectories for Camera-Agnostic Turning Movement Counts12 Jul 2026
12 newest of 624 All 624 (JSON)