Harmonizing Generalization and Specialization: Uncertainty-Informed Collaborative Learning for Semi-supervised Medical Image Segmentation
Not on the map. Why?
Abstract (arXiv)
Vision foundation models have demonstrated strong generalization in medical image segmentation by leveraging large-scale, heterogeneous pretraining. However, they often struggle to generalize to specialized clinical tasks under limited annotations or rare pathological variations, due to a mismatch between general priors and task-specific requirements. To address this, we propose Uncertainty-informed Collaborative Learning (UnCoL), a dual-teacher framework that harmonizes generalization and specialization in semi-supervised medical image segmentation. Specifically, UnCoL distills both visual and semantic representations from a frozen foundation model to transfer general knowledge, while concurrently maintaining a progressively adapting teacher to capture fine-grained and task-specific representations. To balance guidance from both teachers, pseudo-label learning in UnCoL is adaptively regulated by predictive uncertainty, which selectively suppresses unreliable supervision and stabilizes learning in ambiguous regions. Experiments on diverse 2D and 3D segmentation benchmarks show that UnCoL consistently outperforms state-of-the-art semi-supervised methods and foundation model baselines. Moreover, our model delivers near fully supervised performance with markedly reduced annotation requirements.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 46 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
30 of 46 references.
References · 30
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2023Segment Anythingcited by 8,234
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
- 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 379
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
- 2019A Comprehensive Overhaul of Feature Distillationcited by 348
- 2019Variational Information Distillation for Knowledge Transfercited by 324
- 2021Knowledge distillation: A good teacher is patient and consistentcited by 259
- 2020AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?cited by 224
18 more
- 2019Addressing Failure Prediction by Learning Model Confidencecited by 186
- 2020Medical Image Segmentation Using Deep Learning: A Surveycited by 164
- 2015DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentationcited by 159
- 2023Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentationcited by 116
- 2021Mutual Consistency Learning for Semi-supervised Medical Image Segmentationcited by 108
- 2023SAM-Med3D: Towards General-purpose Segmentation Models for Volumetric Medical Imagescited by 107
- 2023SegVol: Universal and Interactive Volumetric Medical Image Segmentationcited by 87
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
- 2022CrossMoDA 2021 challenge: Benchmark of Cross-Modality Domain Adaptation techniques for Vestibular Schwannoma and Cochlea Segmentationcited by 58
- 2024Unleashing the Potential of SAM for Medical Adaptation via Hierarchical Decodingcited by 48
- 2022Robust and Efficient Medical Imaging with Self-Supervisioncited by 40
- 2023A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentationcited by 33
- 2024How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Modelcited by 32
- 2024Adaptive Bidirectional Displacement for Semi-Supervised Medical Image Segmentationcited by 30
- 2023SemiSAM: Enhancing Semi-Supervised Medical Image Segmentation via SAM-Assisted Consistency Regularizationcited by 19
- 2024Cross Prompting Consistency with Segment Anything Model for Semi-supervised Medical Image Segmentationcited by 16
- 2021ImageTBAD: A 3D Computed Tomography Angiography Image Dataset for Automatic Segmentation of Type-B Aortic Dissectioncited by 14
- 2025Steady Progress Beats Stagnation: Mutual Aid of Foundation and Conventional Models in Mixed Domain Semi-Supervised Medical Image Segmentationcited by 7
Built on by
Not cited yet.