Towards more precise automatic analysis: a comprehensive survey of deep learning-based multi-organ segmentation
Not on the map. Why?
Abstract (arXiv)
Accurate segmentation of multiple organs of the head, neck, chest, and abdomen from medical images is an essential step in computer-aided diagnosis, surgical navigation, and radiation therapy. In the past few years, with a data-driven feature extraction approach and end-to-end training, automatic deep learning-based multi-organ segmentation method has far outperformed traditional methods and become a new research topic. This review systematically summarizes the latest research in this field. For the first time, from the perspective of full and imperfect annotation, we comprehensively compile 161 studies on deep learning-based multi-organ segmentation in multiple regions such as the head and neck, chest, and abdomen, containing a total of 214 related references. The method based on full annotation summarizes the existing methods from four aspects: network architecture, network dimension, network dedicated modules, and network loss function. The method based on imperfect annotation summarizes the existing methods from two aspects: weak annotation-based methods and semi annotation-based methods. We also summarize frequently used datasets for multi-organ segmentation and discuss new challenges and new research trends in this field.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 94 of its 217 references that are in the map. First posted on arXiv 1 Mar 2023.
Builds on
94 of 217 references.
References · 94
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2022Generative Adversarial Networkscited by 5,627
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
38 more
- 2017Deformable Convolutional Networkscited by 1,488
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
- 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 509
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 373
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 309
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 288
- 2019Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentationcited by 260
- 2021TransFuse: Fusing Transformers and CNNs for Medical Image Segmentationcited by 258
- 2017Tversky loss function for image segmentation using 3D fully convolutional deep networkscited by 228
- 2021CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentationcited by 227
- 2020AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?cited by 224
- 2020A survey of loss functions for semantic segmentationcited by 217
- 2021UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformercited by 197
- 2018A Novel Focal Tversky loss function with improved Attention U-Net for lesion segmentationcited by 172
- 2019The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomescited by 172
- 2020Medical Image Segmentation Using Deep Learning: A Surveycited by 164
- 2015DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentationcited by 159
- 2021UTNet: A Hybrid Transformer Architecture for Medical Image Segmentationcited by 116
- 2020Strip Pooling: Rethinking Spatial Pooling for Scene Parsingcited by 114
- 2017Anatomically Constrained Neural Networks (ACNN): Application to Cardiac Image Enhancement and Segmentationcited by 109
- 2021Mutual Consistency Learning for Semi-supervised Medical Image Segmentationcited by 108
- 2021LambdaNetworks: Modeling Long-Range Interactions Without Attentioncited by 107
- 2020nnU-Net for Brain Tumor Segmentationcited by 103
- 2021MISSFormer: An Effective Medical Image Segmentation Transformercited by 103
- 2020Efficient Semi-Supervised Gross Target Volume of Nasopharyngeal Carcinoma Segmentation via Uncertainty Rectified Pyramid Consistencycited by 102
- 2021Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformercited by 100
- 2019Deep Learning in Medical Image Registration: A Reviewcited by 98
- 2021Mixed Transformer U-Net For Medical Image Segmentationcited by 95
- 2020DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasetscited by 94
- 2019Prior-aware Neural Network for Partially-Supervised Multi-Organ Segmentationcited by 88
- 2021LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentationcited by 85
- 2020Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptationcited by 81
- 2022Learning with Limited Annotations: A Survey on Deep Semi-Supervised Learning for Medical Image Segmentationcited by 76
- 2020Multi-organ Segmentation over Partially Labeled Datasets with Multi-scale Feature Abstractioncited by 70
50 most cited of 94 All 94 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.
- 2024Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentationcited by 2
- 2025MOSAIC: A Multi-View 2.5D Organ Slice Selector with Cross-Attentional Reasoning for Anatomically-Aware CT Localization in Medical Organ Segmentationcited by 1
- 2026Leveraging Transfer Learning with Class-Specific Decoders for Laparoscopic Segmentationcited by 0
- 2026Leveraging Transfer Learning with Class-Specific Decoders for Laparoscopic Segmentation31 Jul 2026
- 2025MOSAIC: A Multi-View 2.5D Organ Slice Selector with Cross-Attentional Reasoning for Anatomically-Aware CT Localization in Medical Organ Segmentation15 May 2025
- 2024Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentation17 Jul 2024