Modality specific U-Net variants for biomedical image segmentation: A survey
Not on the map. Why?
Abstract (arXiv)
With the advent of advancements in deep learning approaches, such as deep convolution neural network, residual neural network, adversarial network; U-Net architectures are most widely utilized in biomedical image segmentation to address the automation in identification and detection of the target regions or sub-regions. In recent studies, U-Net based approaches have illustrated state-of-the-art performance in different applications for the development of computer-aided diagnosis systems for early diagnosis and treatment of diseases such as brain tumor, lung cancer, alzheimer, breast cancer, etc., using various modalities. This article contributes in presenting the success of these approaches by describing the U-Net framework, followed by the comprehensive analysis of the U-Net variants by performing 1) inter-modality, and 2) intra-modality categorization to establish better insights into the associated challenges and solutions. Besides, this article also highlights the contribution of U-Net based frameworks in the ongoing pandemic, severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) also known as COVID-19. Finally, the strengths and similarities of these U-Net variants are analysed along with the challenges involved in biomedical image segmentation to uncover promising future research directions in this area.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 97 of its 233 references that are in the map. First posted on arXiv 9 Jul 2021.
Builds on
97 of 233 references.
References · 97
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2017Squeeze-and-Excitation Networkscited by 4,763
38 more
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2014Going Deeper with Convolutionscited by 4,231
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2017Deformable Convolutional Networkscited by 1,481
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
- 2020Image Segmentation Using Deep Learning: A Surveycited by 659
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
- 2021The Medical Segmentation Decathloncited by 620
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
- 2017Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classificationcited by 521
- 2018A Survey on Deep Transfer Learningcited by 417
- 2019Selective Kernel Networkscited by 401
- 2017A Survey of Model Compression and Acceleration for Deep Neural Networkscited by 298
- 2018A Probabilistic U-Net for Segmentation of Ambiguous Imagescited by 281
- 2020A Comprehensive Survey of Neural Architecture Search: Challenges and Solutionscited by 253
- 2018GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classificationcited by 242
- 2017Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?cited by 220
- 2019CE-Net: Context Encoder Network for 2D Medical Image Segmentationcited by 219
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
- 2019MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentationcited by 195
- 2020Inf-Net: Automatic COVID-19 Lung Infection Segmentation from CT Imagescited by 184
- 2018Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentationcited by 180
- 2017Understanding Convolution for Semantic Segmentationcited by 168
50 most cited of 97 All 97 (JSON)
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 2; 2024: 4; 2025: 2; 2026: 4.
20 papers.
Sort:
- 2023Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstructioncited by 42
- 2022A Survey on Training Challenges in Generative Adversarial Networks for Biomedical Image Analysiscited by 24
- 2021BT-Unet: A self-supervised learning framework for biomedical image segmentation using Barlow Twins with U-Net modelscited by 12
- 2021MAG-Net: Multi-task attention guided network for brain tumor segmentation and classificationcited by 4
- 2021Impact of Attention on Adversarial Robustness of Image Classification Modelscited by 4
- 2022Deep Learning Architecture Based Approach For 2D-Simulation of Microwave Plasma Interactioncited by 3
- 2022Hybrid Skip: A Biologically Inspired Skip Connection for the UNet Architecturecited by 3
- 2024Segmentation of Prostate Tumour Volumes from PET Images is a Different Ball Gamecited by 2
- 2024Biomedical Image Segmentation: A Systematic Literature Review of Deep Learning Based Object Detection Methodscited by 2
- 2022Temporal Saliency Detection Towards Explainable Transformer-based Timeseries Forecastingcited by 1
- 2022Impact of the composition of feature extraction and class sampling in medicare fraud detectioncited by 0
- 2023IODeep: an IOD for the introduction of deep learning in the DICOM standardcited by 0
8 more
- 2024Aortic root landmark localization with optimal transport loss for heatmap regressioncited by 0
- 2024Polyp segmentation in colonoscopy images using DeepLabV3++cited by 0
- 2025SYNAPSE-Net: A Unified Framework with Lesion-Aware Hierarchical Gating for Robust Segmentation of Heterogeneous Brain Lesionscited by 0
- 2025MedSAM-based lung masking for multi-label chest X-ray classificationcited by 0
- 2026An Intuitionistic Fuzzy Logic Driven UNet architecture: Application to Brain Image segmentationcited by 0
- 2026A Novel Framework using Intuitionistic Fuzzy Logic with U-Net and U-Net++ Architecture: A case Study of MRI Bain Image Segmentationcited by 0
- 2026An Uncertainty-Aware Loss Function Incorporating Fuzzy Logic: Application to MRI Brain Image Segmentationcited by 0
- 2026Compute-Optimal Network Design for Echocardiography Myocardial Segmentation and Perfusion Quantification using Neural Scaling Lawscited by 0
- 2026Compute-Optimal Network Design for Echocardiography Myocardial Segmentation and Perfusion Quantification using Neural Scaling Laws4 Jun 2026
- 2026An Uncertainty-Aware Loss Function Incorporating Fuzzy Logic: Application to MRI Brain Image Segmentation13 Apr 2026
- 2026A Novel Framework using Intuitionistic Fuzzy Logic with U-Net and U-Net++ Architecture: A case Study of MRI Bain Image Segmentation15 Mar 2026
- 2026An Intuitionistic Fuzzy Logic Driven UNet architecture: Application to Brain Image segmentation4 Feb 2026
- 2025MedSAM-based lung masking for multi-label chest X-ray classification28 Dec 2025
- 2025SYNAPSE-Net: A Unified Framework with Lesion-Aware Hierarchical Gating for Robust Segmentation of Heterogeneous Brain Lesions30 Oct 2025
- 2024Biomedical Image Segmentation: A Systematic Literature Review of Deep Learning Based Object Detection Methods6 Aug 2024
- 2024Polyp segmentation in colonoscopy images using DeepLabV3++27 Jul 2024
- 2024Segmentation of Prostate Tumour Volumes from PET Images is a Different Ball Game15 Jul 2024
- 2024Aortic root landmark localization with optimal transport loss for heatmap regression6 Jul 2024
- 2023IODeep: an IOD for the introduction of deep learning in the DICOM standard10 Nov 2023
- 2023Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstruction12 Mar 2023
8 more
- 2022Temporal Saliency Detection Towards Explainable Transformer-based Timeseries Forecasting15 Dec 2022
- 2022Hybrid Skip: A Biologically Inspired Skip Connection for the UNet Architecture11 Jul 2022
- 2022Impact of the composition of feature extraction and class sampling in medicare fraud detection3 Jun 2022
- 2022Deep Learning Architecture Based Approach For 2D-Simulation of Microwave Plasma Interaction2 Jun 2022
- 2022A Survey on Training Challenges in Generative Adversarial Networks for Biomedical Image Analysis19 Jan 2022
- 2021BT-Unet: A self-supervised learning framework for biomedical image segmentation using Barlow Twins with U-Net models7 Dec 2021
- 2021Impact of Attention on Adversarial Robustness of Image Classification Models2 Sep 2021
- 2021MAG-Net: Multi-task attention guided network for brain tumor segmentation and classification26 Jul 2021
- 2023Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstructioncited by 42
- 2022A Survey on Training Challenges in Generative Adversarial Networks for Biomedical Image Analysiscited by 24
- 2021BT-Unet: A self-supervised learning framework for biomedical image segmentation using Barlow Twins with U-Net modelscited by 12
- 2021MAG-Net: Multi-task attention guided network for brain tumor segmentation and classificationcited by 4
- 2021Impact of Attention on Adversarial Robustness of Image Classification Modelscited by 4
- 2022Deep Learning Architecture Based Approach For 2D-Simulation of Microwave Plasma Interactioncited by 3
- 2022Hybrid Skip: A Biologically Inspired Skip Connection for the UNet Architecturecited by 3
- 2024Segmentation of Prostate Tumour Volumes from PET Images is a Different Ball Gamecited by 2
- 2024Biomedical Image Segmentation: A Systematic Literature Review of Deep Learning Based Object Detection Methodscited by 2
- 2022Temporal Saliency Detection Towards Explainable Transformer-based Timeseries Forecastingcited by 1
- 2022Impact of the composition of feature extraction and class sampling in medicare fraud detectioncited by 0
- 2023IODeep: an IOD for the introduction of deep learning in the DICOM standardcited by 0
12 most cited of 20 All 20 (JSON)
- 2026Compute-Optimal Network Design for Echocardiography Myocardial Segmentation and Perfusion Quantification using Neural Scaling Laws4 Jun 2026
- 2026An Uncertainty-Aware Loss Function Incorporating Fuzzy Logic: Application to MRI Brain Image Segmentation13 Apr 2026
- 2026A Novel Framework using Intuitionistic Fuzzy Logic with U-Net and U-Net++ Architecture: A case Study of MRI Bain Image Segmentation15 Mar 2026
- 2026An Intuitionistic Fuzzy Logic Driven UNet architecture: Application to Brain Image segmentation4 Feb 2026
- 2025MedSAM-based lung masking for multi-label chest X-ray classification28 Dec 2025
- 2025SYNAPSE-Net: A Unified Framework with Lesion-Aware Hierarchical Gating for Robust Segmentation of Heterogeneous Brain Lesions30 Oct 2025
- 2024Biomedical Image Segmentation: A Systematic Literature Review of Deep Learning Based Object Detection Methods6 Aug 2024
- 2024Polyp segmentation in colonoscopy images using DeepLabV3++27 Jul 2024
- 2024Segmentation of Prostate Tumour Volumes from PET Images is a Different Ball Game15 Jul 2024
- 2024Aortic root landmark localization with optimal transport loss for heatmap regression6 Jul 2024
- 2023IODeep: an IOD for the introduction of deep learning in the DICOM standard10 Nov 2023
- 2023Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstruction12 Mar 2023
12 newest of 20 All 20 (JSON)