Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy
Not on the map. Why?
Abstract (arXiv)
Over half a million individuals are diagnosed with head and neck cancer each year worldwide. Radiotherapy is an important curative treatment for this disease, but it requires manual time consuming delineation of radio-sensitive organs at risk (OARs). This planning process can delay treatment, while also introducing inter-operator variability with resulting downstream radiation dose differences. While auto-segmentation algorithms offer a potentially time-saving solution, the challenges in defining, quantifying and achieving expert performance remain. Adopting a deep learning approach, we demonstrate a 3D U-Net architecture that achieves expert-level performance in delineating 21 distinct head and neck OARs commonly segmented in clinical practice. The model was trained on a dataset of 663 deidentified computed tomography (CT) scans acquired in routine clinical practice and with both segmentations taken from clinical practice and segmentations created by experienced radiographers as part of this research, all in accordance with consensus OAR definitions. We demonstrate the model's clinical applicability by assessing its performance on a test set of 21 CT scans from clinical practice, each with the 21 OARs segmented by two independent experts. We also introduce surface Dice similarity coefficient (surface DSC), a new metric for the comparison of organ delineation, to quantify deviation between OAR surface contours rather than volumes, better reflecting the clinical task of correcting errors in the automated organ segmentations. The model's generalisability is then demonstrated on two distinct open source datasets, reflecting different centres and countries to model training. With appropriate validation studies and regulatory approvals, this system could improve the efficiency, consistency, and safety of radiotherapy pathways.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 15; 2023: 11; 2024: 10; 2025: 11; 2026: 7.
76 papers.
Sort:
- 2021The Medical Segmentation Decathloncited by 620
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 347
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2022Medical Image Segmentation Review: The success of U-Netcited by 190
- 2023The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CTcited by 101
- 2022A Data-scalable Transformer for Medical Image Segmentation: Architecture, Model Efficiency, and Benchmarkcited by 45
- 2021Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotationscited by 31
- 2021Are we using appropriate segmentation metrics? Identifying correlates of human expert perception for CNN training beyond rolling the DICE coefficientcited by 26
- 2022Medical Image Registration via Neural Fieldscited by 19
- 2023AutoProSAM: Automated Prompting SAM for 3D Multi-Organ Segmentationcited by 19
- 2024CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Datacited by 15
38 more
- 2021Do We Really Need Dice? The Hidden Region-Size Biases of Segmentation Lossescited by 12
- 2024Comparative Benchmarking of Failure Detection Methods in Medical Image Segmentation: Unveiling the Role of Confidence Aggregationcited by 12
- 2025CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentationcited by 12
- 2022RibSeg v2: A Large-scale Benchmark for Rib Labeling and Anatomical Centerline Extractioncited by 10
- 2021Automatic Segmentation of Organs-at-Risk from Head-and-Neck CT using Separable Convolutional Neural Network with Hard-Region-Weighted Losscited by 9
- 2021Anatomy of Domain Shift Impact on U-Net Layers in MRI Segmentationcited by 9
- 2021Assessing YOLACT++ for real time and robust instance segmentation of medical instruments in endoscopic procedurescited by 6
- 2022Tackling the Class Imbalance Problem of Deep Learning Based Head and Neck Organ Segmentationcited by 6
- 2024Primitive Geometry Segment Pre-training for 3D Medical Image Segmentationcited by 6
- 2024Explainable Convolutional Neural Networks for Retinal Fundus Classification and Cutting-Edge Segmentation Models for Retinal Blood Vessels from Fundus Imagescited by 6
- 2022Neural Annotation Refinement: Development of a New 3D Dataset for Adrenal Gland Analysiscited by 5
- 2022Feather-Light Fourier Domain Adaptation in Magnetic Resonance Imagingcited by 5
- 2022Recurrence-free Survival Prediction under the Guidance of Automatic Gross Tumor Volume Segmentation for Head and Neck Cancerscited by 4
- 2024Anatomical feature-prioritized loss for enhanced MR to CT translationcited by 4
- 2021Learning Fuzzy Clustering for SPECT/CT Segmentation via Convolutional Neural Networkscited by 3
- 2022Automatic identification of segmentation errors for radiotherapy using geometric learningcited by 3
- 2022USE-Evaluator: Performance Metrics for Medical Image Segmentation Models with Uncertain, Small or Empty Reference Annotationscited by 3
- 2023Scale-aware Test-time Click Adaptation for Pulmonary Nodule and Mass Segmentationcited by 3
- 2025Federated nnU-Net for Privacy-Preserving Medical Image Segmentationcited by 3
- 2021Unpaired cross-modality educed distillation (CMEDL) for medical image segmentationcited by 2
- 2021Leveraging Clinical Characteristics for Improved Deep Learning-Based Kidney Tumor Segmentation on CTcited by 2
- 2021Multi-institutional Validation of Two-Streamed Deep Learning Method for Automated Delineation of Esophageal Gross Tumor Volume using planning-CT and FDG-PETCTcited by 2
- 2024MOSformer: Momentum encoder-based inter-slice fusion transformer for medical image segmentationcited by 2
- 2025Pixel-wise Modulated Dice Loss for Medical Image Segmentationcited by 2
- 2025VELVET-Med: Vision and Efficient Language Pre-training for Volumetric Imaging Tasks in Medicinecited by 2
- 20213D U-Net for segmentation of COVID-19 associated pulmonary infiltrates using transfer learning: State-of-the-art results on affordable hardwarecited by 1
- 2021Deep cross-modality (MR-CT) educed distillation learning for cone beam CT lung tumor segmentationcited by 1
- 2021Hoechst Is All You Need: Lymphocyte Classification with Deep Learningcited by 1
- 2021A Proof-of-Concept Study of Artificial Intelligence Assisted Contour Revisioncited by 1
- 2021Systematic Clinical Evaluation of A Deep Learning Method for Medical Image Segmentation: Radiosurgery Applicationcited by 1
- 2021Comprehensive and Clinically Accurate Head and Neck Organs at Risk Delineation via Stratified Deep Learning: A Large-scale Multi-Institutional Studycited by 1
- 2022Mixed-Block Neural Architecture Search for Medical Image Segmentationcited by 1
- 2022Data variation-aware medical image segmentationcited by 1
- 2022Contour Dice loss for structures with Fuzzy and Complex Boundaries in Fetal MRIcited by 1
- 2022Non-inferiority of Deep Learning Acute Ischemic Stroke Segmentation on Non-Contrast CT Compared to Expert Neuroradiologistscited by 1
- 2023Multi-Modal Evaluation Approach for Medical Image Segmentationcited by 1
- 2023The impact of training dataset size and ensemble inference strategies on head and neck auto-segmentationcited by 1
- 2023Unsupervised correspondence with combined geometric learning and imaging for radiotherapy applicationscited by 1
50 most cited of 76 All 76 (JSON)
- 2026Sparse cubical complexes for efficient topology-preservation in image data29 Sep 2026
- 2026MedPlex: Deep Vision-Language Co-Adaptation for Clinically Grounded Medical Segmentation13 Aug 2026
- 2026BrainNext: A General-Purpose Self-Supervised Foundation Model for Brain MRI Analysis20 Jul 2026
- 2026Towards Voxel Spacing Consistency for Medical Image Segmentation30 Jun 2026
- 2026ARIADNE: A Perception-Reasoning Synergy Framework for Trustworthy Coronary Angiography Analysis19 Mar 2026
- 2026Cut to the Mix: Simple Data Augmentation Outperforms Elaborate Ones in Limited Organ Segmentation Datasets3 Feb 2026
- 2026DTC: A Deformable Transposed Convolution Module for Medical Image Segmentation25 Jan 2026
- 2025TopoSculpt: Betti-Steered Topological Sculpting of 3D Fine-grained Tubular Shapes4 Sep 2025
- 2025VELVET-Med: Vision and Efficient Language Pre-training for Volumetric Imaging Tasks in Medicine16 Aug 2025
- 2025CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentation29 Jun 2025
- 2025Pixel-wise Modulated Dice Loss for Medical Image Segmentation17 Jun 2025
- 2025Template-Guided Reconstruction of Pulmonary Segments with Neural Implicit Functions13 May 2025
38 more
- 2025AI-Assisted Decision-Making for Clinical Assessment of Auto-Segmented Contour Quality1 May 2025
- 2025BiPVL-Seg: Bidirectional Progressive Vision-Language Fusion with Global-Local Alignment for Medical Image Segmentation30 Mar 2025
- 2025Federated nnU-Net for Privacy-Preserving Medical Image Segmentation4 Mar 2025
- 2025Comprehensive Evaluation of OCT-based Automated Segmentation of Retinal Layer, Fluid and Hyper-Reflective Foci: Impact on Clinical Assessment of Diabetic Retinopathy Severity3 Mar 2025
- 2025An anatomically-informed correspondence initialisation method to improve learning-based registration for radiotherapy26 Feb 2025
- 2025Multimodal HIE Lesion Segmentation in Neonates: A Comparative Study of Loss Functions13 Feb 2025
- 2024Enhancing the automatic segmentation and analysis of 3D liver vasculature models24 Nov 2024
- 2024Anatomical feature-prioritized loss for enhanced MR to CT translation14 Oct 2024
- 2024Beyond Skip Connection: Pooling and Unpooling Design for Elimination Singularities20 Sep 2024
- 2024GASA-UNet: Global Axial Self-Attention U-Net for 3D Medical Image Segmentation20 Sep 2024
- 2024Comparative Benchmarking of Failure Detection Methods in Medical Image Segmentation: Unveiling the Role of Confidence Aggregation5 Jun 2024
- 2024Explainable Convolutional Neural Networks for Retinal Fundus Classification and Cutting-Edge Segmentation Models for Retinal Blood Vessels from Fundus Images12 May 2024
- 2024CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Data7 Apr 2024
- 2024DeepATLAS: One-Shot Localization for Biomedical Data14 Feb 2024
- 2024MOSformer: Momentum encoder-based inter-slice fusion transformer for medical image segmentation22 Jan 2024
- 2024Primitive Geometry Segment Pre-training for 3D Medical Image Segmentation8 Jan 2024
- 2023PnPNet: Pull-and-Push Networks for Volumetric Segmentation with Boundary Confusion13 Dec 2023
- 2023ReshapeIT: Reliable Shape Interaction with Implicit Template for Anatomical Structure Reconstruction11 Dec 2023
- 2023Unsupervised correspondence with combined geometric learning and imaging for radiotherapy applications25 Sep 2023
- 2023AutoProSAM: Automated Prompting SAM for 3D Multi-Organ Segmentation28 Aug 2023
- 2023Improving Lesion Volume Measurements on Digital Mammograms28 Aug 2023
- 2023Scale-aware Test-time Click Adaptation for Pulmonary Nodule and Mass Segmentation28 Jul 2023
- 2023Spatiotemporal Modeling Encounters 3D Medical Image Analysis: Slice-Shift UNet with Multi-View Fusion24 Jul 2023
- 2023The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CT5 Jul 2023
- 2023The impact of training dataset size and ensemble inference strategies on head and neck auto-segmentation30 Mar 2023
- 2023Multi-Modal Evaluation Approach for Medical Image Segmentation8 Feb 2023
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection2 Jan 2023
- 2022Medical Image Segmentation Review: The success of U-Net27 Nov 2022
- 2022Non-inferiority of Deep Learning Acute Ischemic Stroke Segmentation on Non-Contrast CT Compared to Expert Neuroradiologists24 Nov 2022
- 2022RibSeg v2: A Large-scale Benchmark for Rib Labeling and Anatomical Centerline Extraction18 Oct 2022
- 2022USE-Evaluator: Performance Metrics for Medical Image Segmentation Models with Uncertain, Small or Empty Reference Annotations26 Sep 2022
- 2022Contour Dice loss for structures with Fuzzy and Complex Boundaries in Fetal MRI25 Sep 2022
- 2022Recurrence-free Survival Prediction under the Guidance of Automatic Gross Tumor Volume Segmentation for Head and Neck Cancers22 Sep 2022
- 2022Feather-Light Fourier Domain Adaptation in Magnetic Resonance Imaging31 Jul 2022
- 2022Neural Annotation Refinement: Development of a New 3D Dataset for Adrenal Gland Analysis30 Jun 2022
- 2022Automatic identification of segmentation errors for radiotherapy using geometric learning27 Jun 2022
- 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentation16 Jun 2022
- 2022Medical Image Registration via Neural Fields7 Jun 2022
50 newest of 76 All 76 (JSON)
- 2021The Medical Segmentation Decathloncited by 620
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 347
- 2023CLIP-Driven Universal Model for Organ Segmentation and Tumor Detectioncited by 224
- 2022Medical Image Segmentation Review: The success of U-Netcited by 190
- 2023The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CTcited by 101
- 2022A Data-scalable Transformer for Medical Image Segmentation: Architecture, Model Efficiency, and Benchmarkcited by 45
- 2021Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotationscited by 31
- 2021Are we using appropriate segmentation metrics? Identifying correlates of human expert perception for CNN training beyond rolling the DICE coefficientcited by 26
- 2022Medical Image Registration via Neural Fieldscited by 19
- 2023AutoProSAM: Automated Prompting SAM for 3D Multi-Organ Segmentationcited by 19
- 2024CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Datacited by 15
12 most cited of 76 All 76 (JSON)
- 2026Sparse cubical complexes for efficient topology-preservation in image data29 Sep 2026
- 2026MedPlex: Deep Vision-Language Co-Adaptation for Clinically Grounded Medical Segmentation13 Aug 2026
- 2026BrainNext: A General-Purpose Self-Supervised Foundation Model for Brain MRI Analysis20 Jul 2026
- 2026Towards Voxel Spacing Consistency for Medical Image Segmentation30 Jun 2026
- 2026ARIADNE: A Perception-Reasoning Synergy Framework for Trustworthy Coronary Angiography Analysis19 Mar 2026
- 2026Cut to the Mix: Simple Data Augmentation Outperforms Elaborate Ones in Limited Organ Segmentation Datasets3 Feb 2026
- 2026DTC: A Deformable Transposed Convolution Module for Medical Image Segmentation25 Jan 2026
- 2025TopoSculpt: Betti-Steered Topological Sculpting of 3D Fine-grained Tubular Shapes4 Sep 2025
- 2025VELVET-Med: Vision and Efficient Language Pre-training for Volumetric Imaging Tasks in Medicine16 Aug 2025
- 2025CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentation29 Jun 2025
- 2025Pixel-wise Modulated Dice Loss for Medical Image Segmentation17 Jun 2025
- 2025Template-Guided Reconstruction of Pulmonary Segments with Neural Implicit Functions13 May 2025
12 newest of 76 All 76 (JSON)