Rethinking Barely-Supervised Volumetric Medical Image Segmentation from an Unsupervised Domain Adaptation Perspective
Not on the map. Why?
Abstract (arXiv)
This paper investigates an extremely challenging problem: barely-supervised volumetric medical image segmentation (BSS). A BSS training dataset consists of two parts: 1) a barely-annotated labeled set, where each labeled image contains only a single-slice annotation, and 2) an unlabeled set comprising numerous unlabeled volumetric images. State-of-the-art BSS methods employ a registration-based paradigm, which uses inter-slice image registration to propagate single-slice annotations into volumetric pseudo labels, constructing a completely annotated labeled set, to which a semi-supervised segmentation scheme can be applied. However, the paradigm has a critical limitation: the pseudo-labels generated by image registration are unreliable and noisy. Motivated by this, we propose a new perspective: instead of solving BSS within a semi-supervised learning scheme, this work formulates BSS as an unsupervised domain adaptation problem. To this end, we propose a novel BSS framework, Barely-supervised learning via unsupervised domain Adaptation (BvA), as an alternative to the dominant registration paradigm. Specifically, we first design a novel noise-free labeled data construction algorithm (NFC) for slice-to-volume labeled data synthesis. Then, we introduce a frequency and spatial Mix-Up strategy (FSX) to mitigate the domain shifts. Extensive experiments demonstrate that our method provides a promising alternative for BSS. Remarkably, the proposed method, trained on the left atrial segmentation dataset with only one barely-labeled image, achieves a Dice score of 81.20%, outperforming the state-of-the-art by 61.71%. The code is available at https://github.com/Senyh/BvA.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 42 references that are in the map. First posted on arXiv 16 May 2024.
Builds on
30 of 42 references.
References · 30
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 600
- 2020FDA: Fourier Domain Adaptation for Semantic Segmentationcited by 541
- 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 511
- 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 463
- 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 379
- 2021A Fourier-based Framework for Domain Generalizationcited by 290
- 2020Semi-supervised Medical Image Segmentation through Dual-task Consistencycited by 216
18 more
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 178
- 2021FSDR: Frequency Space Domain Randomization for Domain Generalizationcited by 164
- 2020Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentationcited by 134
- 2019Synergistic Image and Feature Adaptation: Towards Cross-Modality Domain Adaptation for Medical Image Segmentationcited by 121
- 2023Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentationcited by 116
- 2021Mutual Consistency Learning for Semi-supervised Medical Image Segmentationcited by 108
- 2021Semi-supervised Left Atrium Segmentation with Mutual Consistency Trainingcited by 104
- 2020Efficient Semi-Supervised Gross Target Volume of Nasopharyngeal Carcinoma Segmentation via Uncertainty Rectified Pyramid Consistencycited by 102
- 2022CycleMix: A Holistic Strategy for Medical Image Segmentation from Scribble Supervisioncited by 64
- 2020Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Imagescited by 55
- 2022LE-UDA: Label-efficient unsupervised domain adaptation for medical image segmentationcited by 27
- 2022ShapePU: A New PU Learning Framework Regularized by Global Consistency for Scribble Supervised Cardiac Segmentationcited by 26
- 2023Co-training with High-Confidence Pseudo Labels for Semi-supervised Medical Image Segmentationcited by 25
- 2023WeakPolyp: You Only Look Bounding Box for Polyp Segmentationcited by 21
- 2021Barely-Supervised Learning: Semi-Supervised Learning with very few labeled imagescited by 17
- 2022Nuclei Segmentation with Point Annotations from Pathology Images via Self-Supervised Learning and Co-Trainingcited by 16
- 2023Orthogonal Annotation Benefits Barely-supervised Medical Image Segmentationcited by 15
- 2018Deep Learning Based Instance Segmentation in 3D Biomedical Images Using Weak Annotationcited by 11
Built on by
Not cited yet.