mlsanityData to 7 Oct 2026

Modality specific U-Net variants for biomedical image segmentation: A survey

arXiv 2107.04537 ↗First posted 9 Jul 2021eess.IV cs.CVcited by 20

Not on the map. Why?

Abstract (arXiv)

With the advent of advancements in deep learning approaches, such as deep convolution neural network, residual neural network, adversarial network; U-Net architectures are most widely utilized in biomedical image segmentation to address the automation in identification and detection of the target regions or sub-regions. In recent studies, U-Net based approaches have illustrated state-of-the-art performance in different applications for the development of computer-aided diagnosis systems for early diagnosis and treatment of diseases such as brain tumor, lung cancer, alzheimer, breast cancer, etc., using various modalities. This article contributes in presenting the success of these approaches by describing the U-Net framework, followed by the comprehensive analysis of the U-Net variants by performing 1) inter-modality, and 2) intra-modality categorization to establish better insights into the associated challenges and solutions. Besides, this article also highlights the contribution of U-Net based frameworks in the ongoing pandemic, severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) also known as COVID-19. Finally, the strengths and similarities of these U-Net variants are analysed along with the challenges involved in biomedical image segmentation to uncover promising future research directions in this area.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 97 of its 233 references that are in the map. First posted on arXiv 9 Jul 2021.

Builds on

97 of 233 references.

References · 97

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  7. 2017Mask R-CNNcited by 7,259
  8. 2016Densely Connected Convolutional Networkscited by 6,691
  9. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  10. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  11. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  12. 2017Squeeze-and-Excitation Networkscited by 4,763
38 more
  1. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  2. 2014Going Deeper with Convolutionscited by 4,231
  3. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  4. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  5. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  6. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  7. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  8. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  9. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  10. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  11. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
  12. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  13. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  14. 2017Deformable Convolutional Networkscited by 1,481
  15. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  16. 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
  17. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
  18. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
  19. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
  20. 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
  21. 2020Image Segmentation Using Deep Learning: A Surveycited by 659
  22. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 656
  23. 2021The Medical Segmentation Decathloncited by 620
  24. 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
  25. 2017Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classificationcited by 521
  26. 2018A Survey on Deep Transfer Learningcited by 417
  27. 2019Selective Kernel Networkscited by 401
  28. 2017A Survey of Model Compression and Acceleration for Deep Neural Networkscited by 298
  29. 2018A Probabilistic U-Net for Segmentation of Ambiguous Imagescited by 281
  30. 2020A Comprehensive Survey of Neural Architecture Search: Challenges and Solutionscited by 253
  31. 2018GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classificationcited by 242
  32. 2017Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?cited by 220
  33. 2019CE-Net: Context Encoder Network for 2D Medical Image Segmentationcited by 219
  34. 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
  35. 2019MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentationcited by 195
  36. 2020Inf-Net: Automatic COVID-19 Lung Infection Segmentation from CT Imagescited by 184
  37. 2018Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentationcited by 180
  38. 2017Understanding Convolution for Semantic Segmentationcited by 168

50 most cited of 97 All 97 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 5; 2023: 2; 2024: 4; 2025: 2; 2026: 4.

20 papers.

Sort:

  1. 2023Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstructioncited by 42
  2. 2022A Survey on Training Challenges in Generative Adversarial Networks for Biomedical Image Analysiscited by 24
  3. 2021BT-Unet: A self-supervised learning framework for biomedical image segmentation using Barlow Twins with U-Net modelscited by 12
  4. 2021MAG-Net: Multi-task attention guided network for brain tumor segmentation and classificationcited by 4
  5. 2021Impact of Attention on Adversarial Robustness of Image Classification Modelscited by 4
  6. 2022Deep Learning Architecture Based Approach For 2D-Simulation of Microwave Plasma Interactioncited by 3
  7. 2022Hybrid Skip: A Biologically Inspired Skip Connection for the UNet Architecturecited by 3
  8. 2024Segmentation of Prostate Tumour Volumes from PET Images is a Different Ball Gamecited by 2
  9. 2024Biomedical Image Segmentation: A Systematic Literature Review of Deep Learning Based Object Detection Methodscited by 2
  10. 2022Temporal Saliency Detection Towards Explainable Transformer-based Timeseries Forecastingcited by 1
  11. 2022Impact of the composition of feature extraction and class sampling in medicare fraud detectioncited by 0
  12. 2023IODeep: an IOD for the introduction of deep learning in the DICOM standardcited by 0
8 more
  1. 2024Aortic root landmark localization with optimal transport loss for heatmap regressioncited by 0
  2. 2024Polyp segmentation in colonoscopy images using DeepLabV3++cited by 0
  3. 2025SYNAPSE-Net: A Unified Framework with Lesion-Aware Hierarchical Gating for Robust Segmentation of Heterogeneous Brain Lesionscited by 0
  4. 2025MedSAM-based lung masking for multi-label chest X-ray classificationcited by 0
  5. 2026An Intuitionistic Fuzzy Logic Driven UNet architecture: Application to Brain Image segmentationcited by 0
  6. 2026A Novel Framework using Intuitionistic Fuzzy Logic with U-Net and U-Net++ Architecture: A case Study of MRI Bain Image Segmentationcited by 0
  7. 2026An Uncertainty-Aware Loss Function Incorporating Fuzzy Logic: Application to MRI Brain Image Segmentationcited by 0
  8. 2026Compute-Optimal Network Design for Echocardiography Myocardial Segmentation and Perfusion Quantification using Neural Scaling Lawscited by 0