HDC: Hierarchical Distillation for Multi-level Noisy Consistency in Semi-Supervised Fetal Ultrasound Segmentation
Not on the map. Why?
Abstract (arXiv)
Transvaginal ultrasound is a critical imaging modality for evaluating cervical anatomy and detecting physiological changes. However, accurate segmentation of cervical structures remains challenging due to low contrast, shadow artifacts, and indistinct boundaries. While convolutional neural networks (CNNs) have demonstrated efficacy in medical image segmentation, their reliance on large-scale annotated datasets presents a significant limitation in clinical ultrasound imaging. Semi-supervised learning (SSL) offers a potential solution by utilizing unlabeled data, yet existing teacher-student frameworks often encounter confirmation bias and high computational costs. In this paper, a novel semi-supervised segmentation framework, called HDC, is proposed incorporating adaptive consistency learning with a single-teacher architecture. The framework introduces a hierarchical distillation mechanism with two objectives: Correlation Guidance Loss for aligning feature representations and Mutual Information Loss for stabilizing noisy student learning. The proposed approach reduces model complexity while enhancing generalization. Experiments on fetal ultrasound datasets, FUGC and PSFH, demonstrate competitive performance with reduced computational overhead compared to multi-teacher models.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 31 of its 53 references that are in the map. First posted on arXiv 14 Apr 2025.
Builds on
31 of 53 references.
References · 31
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
- 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 463
- 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 379
- 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 376
- 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
- 2021Distilling Knowledge via Knowledge Reviewcited by 288
- 2019Interpolation Consistency Training for Semi-Supervised Learningcited by 251
- 2022Knowledge Distillation from A Stronger Teachercited by 208
19 more
- 2018Deep Co-Training for Semi-Supervised Image Recognitioncited by 147
- 2022Knowledge Distillation with the Reused Teacher Classifiercited by 141
- 2021Perturbed and Strict Mean Teachers for Semi-supervised Semantic Segmentationcited by 113
- 2021Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformercited by 100
- 2018Knowledge Transfer with Jacobian Matchingcited by 76
- 2023Class Attention Transfer Based Knowledge Distillationcited by 61
- 2023Conflict-Based Cross-View Consistency for Semi-Supervised Semantic Segmentationcited by 35
- 2023Logic-induced Diagnostic Reasoning for Semi-supervised Semantic Segmentationcited by 29
- 2024VkD: Improving Knowledge Distillation using Orthogonal Projectionscited by 26
- 2015Decoupled Deep Neural Network for Semi-supervised Semantic Segmentationcited by 23
- 2023Switching Temporary Teachers for Semi-Supervised Semantic Segmentationcited by 23
- 2023Alternate Diverse Teaching for Semi-supervised Medical Image Segmentationcited by 22
- 2021Information Theoretic Representation Distillationcited by 19
- 2024Improving Generalization in Visual Reasoning via Self-Ensemblecited by 15
- 2022When CNN Meet with ViT: Towards Semi-Supervised Learning for Multi-Class Medical Image Semantic Segmentationcited by 13
- 2024Dual Mean-Teacher: An Unbiased Semi-Supervised Framework for Audio-Visual Source Localizationcited by 10
- 2024Intrapartum Ultrasound Image Segmentation of Pubic Symphysis and Fetal Head Using Dual Student-Teacher Framework with CNN-ViT Collaborative Learningcited by 9
- 2024Blurry-Consistency Segmentation Framework with Selective Stacking on Differential Interference Contrast 3D Breast Cancer Spheroidcited by 2
- 2024Semi-Supervised Semantic Segmentation using Redesigned Self-Training for White Blood Cellscited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025Learning Disentangled Stain and Structural Representations for Semi-Supervised Histopathology Segmentationcited by 4
- 2026ESC: Emotional Self-Correction for Reliable Vision-Language Modelscited by 1
- 2025Graph-Theoretic Consistency for Robust and Topology-Aware Semi-Supervised Histopathology Segmentationcited by 0
- 2026ESC: Emotional Self-Correction for Reliable Vision-Language Models1 Jul 2026
- 2025Graph-Theoretic Consistency for Robust and Topology-Aware Semi-Supervised Histopathology Segmentation19 Sep 2025
- 2025Learning Disentangled Stain and Structural Representations for Semi-Supervised Histopathology Segmentation5 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2023Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Model
- 2026A Semi-Supervised Framework for Breast Ultrasound Segmentation with Training-Free Pseudo-Label Generation and Label Refinement
- 2024MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentation
- 2026Multiscale Switch for Semi-Supervised and Contrastive Learning in Medical Ultrasound Image Segmentation
- 2026FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model
- 2022Knowledge Distillation from Cross Teaching Teachers for Efficient Semi-Supervised Abdominal Organ Segmentation in CT
- 2025FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysis
- 2025Cross-pyramid consistency regularization for semi-supervised medical image segmentation