Semi-Supervised Biomedical Image Segmentation via Diffusion Models and Teacher-Student Co-Training
On the map: Diffusion models → Medical imaging and segmentation
also in 1 more
Abstract (arXiv)
Supervised deep learning achieves strong performance in biomedical image segmentation but relies on costly pixel-wise annotations, motivating semi-supervised approaches that exploit unlabeled data. We introduce a diffusion-based teacher--student framework in which segmentation predictions are used to condition image denoising, encouraging the production of more informative pseudo-labels. The teacher is first pretrained through an unsupervised reconstruction task using diffusion-style corruption, timestep conditioning, and denoising. Starting from a corrupted empty mask, the model predicts an intermediate segmentation that conditions image denoising, encouraging the predicted mask to capture structural information useful for recovering the original image. The resulting teacher is then co-trained with a student using supervised segmentation on labeled samples and cross pseudo-supervision on unlabeled data. We further introduce a multi-round extension during co-training, in which the teacher generates multiple stochastic image reconstructions and corresponding segmentation predictions, providing additional reconstruction and alignment signals to improve its pseudo-labels. We evaluate the proposed framework on three public 2D biomedical segmentation datasets and a 3D left atrial segmentation benchmark. Across several labeling regimes, our method achieves competitive or superior performance compared with state-of-the-art semi-supervised approaches, with the largest gains observed under severe label scarcity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 35 of its 62 references that are in the map. First posted on arXiv 2 Apr 2025.
Builds on
35 of 62 references.
Closest ancestors · 4
Same direction, newest first
- 2023BerDiff: Conditional Bernoulli Diffusion Model for Medical Image Segmentation10 Apr
- 2023MedSegDiff-V2: Diffusion based Medical Image Segmentation with Transformer19 Jan
- 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey14 Nov
- 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Model1 Nov
Other references · 31
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,380
19 more
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
- 2018ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentationcited by 623
- 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 510
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
- 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 463
- 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 379
- 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 376
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
- 2019Label Propagation for Deep Semi-supervised Learningcited by 289
- 2021CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentationcited by 227
- 2020Semi-supervised Medical Image Segmentation through Dual-task Consistencycited by 216
- 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
- 2024Exploring scalable medical image encoders beyond text supervisioncited by 132
- 2020Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotationcited by 128
- 2020KiU-Net: Overcomplete Convolutional Architectures for Biomedical Image and Volumetric Segmentationcited by 32
- 2016Augmenting Supervised Neural Networks with Unsupervised Objectives for Large-scale Image Classificationcited by 18
- 2022MFSNet: A Multi Focus Segmentation Network for Skin Lesion Segmentationcited by 10
- 2024Biologically-inspired Semi-supervised Semantic Segmentation for Biomedical Imagingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Diff-CL: A Novel Cross Pseudo-Supervision Method for Semi-supervised Medical Image Segmentation
- 2025Robust Noisy Pseudo-label Learning for Semi-supervised Medical Image Segmentation Using Diffusion Model
- 2023Robust semi-supervised segmentation with timestep ensembling diffusion models
- 2023A Recycling Training Strategy for Medical Image Segmentation with Diffusion Denoising Models
- 2025Dual Teacher-Student Learning for Semi-supervised Medical Image Segmentation
- 2025A Unified Framework for Semi-Supervised Image Segmentation and Registration
- 2024Hybrid diffusion models: combining supervised and generative pretraining for label-efficient fine-tuning of segmentation models
- 2024Analysing Diffusion Segmentation for Medical Images