Learning Semi-Supervised Medical Image Segmentation from Spatial Registration
Not on the map. Why?
Abstract (arXiv)
Semi-supervised medical image segmentation has shown promise in training models with limited labeled data and abundant unlabeled data. However, state-of-the-art methods ignore a potentially valuable source of unsupervised semantic information -- spatial registration transforms between image volumes. To address this, we propose CCT-R, a contrastive cross-teaching framework incorporating registration information. To leverage the semantic information available in registrations between volume pairs, CCT-R incorporates two proposed modules: Registration Supervision Loss (RSL) and Registration-Enhanced Positive Sampling (REPS). The RSL leverages segmentation knowledge derived from transforms between labeled and unlabeled volume pairs, providing an additional source of pseudo-labels. REPS enhances contrastive learning by identifying anatomically-corresponding positives across volumes using registration transforms. Experimental results on two challenging medical segmentation benchmarks demonstrate the effectiveness and superiority of CCT-R across various semi-supervised settings, with as few as one labeled case. Our code is available at https://github.com/kathyliu579/ContrastiveCross-teachingWithRegistration.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 84 references that are in the map. First posted on arXiv 16 Sep 2024.
Builds on
47 of 84 references.
References · 47
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Supervised Contrastive Learningcited by 2,803
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
35 more
- 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 462
- 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 378
- 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 375
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
- 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
- 2021Understanding self-supervised Learning Dynamics without Contrastive Pairscited by 254
- 2019Interpolation Consistency Training for Semi-Supervised Learningcited by 248
- 2020ClassMix: Segmentation-Based Data Augmentation for Semi-Supervised Learningcited by 209
- 2018Deep Co-Training for Semi-Supervised Image Recognitioncited by 145
- 2019Deep learning for cardiac image segmentation: A reviewcited by 131
- 2023Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentationcited by 115
- 2021Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentationcited by 101
- 2021Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformercited by 99
- 2018Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registrationcited by 90
- 2021Bootstrapping Semantic Segmentation with Regional Contrastcited by 80
- 2019Semi-Supervised Medical Image Segmentation via Learning Consistency under Transformationscited by 71
- 2023Contrastive Semi-supervised Learning for Underwater Image Restoration via Reliable Bankcited by 68
- 2019DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentationcited by 66
- 2022Class-Aware Contrastive Semi-Supervised Learningcited by 62
- 2019Deep Co-Training for Semi-Supervised Image Segmentationcited by 58
- 2021Semi-supervised Contrastive Learning for Label-efficient Medical Image Segmentationcited by 52
- 2022UCC: Uncertainty guided Cross-head Co-training for Semi-Supervised Semantic Segmentationcited by 45
- 2021Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentationcited by 43
- 2023RCPS: Rectified Contrastive Pseudo Supervision for Semi-Supervised Medical Image Segmentationcited by 27
- 2020Contrastive Registration for Unsupervised Medical Image Segmentationcited by 19
- 2022BATFormer: Towards Boundary-Aware Lightweight Transformer for Efficient Medical Image Segmentationcited by 14
- 2022Prototypical few-shot segmentation for cross-institution male pelvic structures with spatial registrationcited by 14
- 2023Deep-Learning-based Fast and Accurate 3D CT Deformable Image Registration in Lung Cancercited by 10
- 2021Joint Registration and Segmentation via Multi-Task Learning for Adaptive Radiotherapy of Prostate Cancercited by 8
- 2020A Cross-Stitch Architecture for Joint Registration and Segmentation in Adaptive Radiotherapycited by 7
- 2023Aligning Multi-Sequence CMR Towards Fully Automated Myocardial Pathology Segmentationcited by 7
- 2023Multi-Scale Cross Contrastive Learning for Semi-Supervised Medical Image Segmentationcited by 4
- 2023Co-Learning Semantic-aware Unsupervised Segmentation for Pathological Image Registrationcited by 2
- 2023Elucidating and Overcoming the Challenges of Label Noise in Supervised Contrastive Learningcited by 2
- 2024StyleSeg V2: Towards Robust One-shot Segmentation of Brain Tissue via Optimization-free Registration Error Perceptioncited by 1
Built on by
Not cited yet.