mlsanityData to 14 Oct 2026

HDC: Hierarchical Distillation for Multi-level Noisy Consistency in Semi-Supervised Fetal Ultrasound Segmentation

arXiv 2504.09876 ↗First posted 14 Apr 2025cs.CV cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Transvaginal ultrasound is a critical imaging modality for evaluating cervical anatomy and detecting physiological changes. However, accurate segmentation of cervical structures remains challenging due to low contrast, shadow artifacts, and indistinct boundaries. While convolutional neural networks (CNNs) have demonstrated efficacy in medical image segmentation, their reliance on large-scale annotated datasets presents a significant limitation in clinical ultrasound imaging. Semi-supervised learning (SSL) offers a potential solution by utilizing unlabeled data, yet existing teacher-student frameworks often encounter confirmation bias and high computational costs. In this paper, a novel semi-supervised segmentation framework, called HDC, is proposed incorporating adaptive consistency learning with a single-teacher architecture. The framework introduces a hierarchical distillation mechanism with two objectives: Correlation Guidance Loss for aligning feature representations and Mutual Information Loss for stabilizing noisy student learning. The proposed approach reduces model complexity while enhancing generalization. Experiments on fetal ultrasound datasets, FUGC and PSFH, demonstrate competitive performance with reduced computational overhead compared to multi-teacher models.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 31 of its 53 references that are in the map. First posted on arXiv 14 Apr 2025.

Builds on

31 of 53 references.

References · 31

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
  3. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
  4. 2020Knowledge Distillation: A Surveycited by 1,603
  5. 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
  6. 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 463
  7. 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 379
  8. 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 376
  9. 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
  10. 2021Distilling Knowledge via Knowledge Reviewcited by 288
  11. 2019Interpolation Consistency Training for Semi-Supervised Learningcited by 251
  12. 2022Knowledge Distillation from A Stronger Teachercited by 208
19 more
  1. 2018Deep Co-Training for Semi-Supervised Image Recognitioncited by 147
  2. 2022Knowledge Distillation with the Reused Teacher Classifiercited by 141
  3. 2021Perturbed and Strict Mean Teachers for Semi-supervised Semantic Segmentationcited by 113
  4. 2021Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformercited by 100
  5. 2018Knowledge Transfer with Jacobian Matchingcited by 76
  6. 2023Class Attention Transfer Based Knowledge Distillationcited by 61
  7. 2023Conflict-Based Cross-View Consistency for Semi-Supervised Semantic Segmentationcited by 35
  8. 2023Logic-induced Diagnostic Reasoning for Semi-supervised Semantic Segmentationcited by 29
  9. 2024VkD: Improving Knowledge Distillation using Orthogonal Projectionscited by 26
  10. 2015Decoupled Deep Neural Network for Semi-supervised Semantic Segmentationcited by 23
  11. 2023Switching Temporary Teachers for Semi-Supervised Semantic Segmentationcited by 23
  12. 2023Alternate Diverse Teaching for Semi-supervised Medical Image Segmentationcited by 22
  13. 2021Information Theoretic Representation Distillationcited by 19
  14. 2024Improving Generalization in Visual Reasoning via Self-Ensemblecited by 15
  15. 2022When CNN Meet with ViT: Towards Semi-Supervised Learning for Multi-Class Medical Image Semantic Segmentationcited by 13
  16. 2024Dual Mean-Teacher: An Unbiased Semi-Supervised Framework for Audio-Visual Source Localizationcited by 10
  17. 2024Intrapartum Ultrasound Image Segmentation of Pubic Symphysis and Fetal Head Using Dual Student-Teacher Framework with CNN-ViT Collaborative Learningcited by 9
  18. 2024Blurry-Consistency Segmentation Framework with Selective Stacking on Differential Interference Contrast 3D Breast Cancer Spheroidcited by 2
  19. 2024Semi-Supervised Semantic Segmentation using Redesigned Self-Training for White Blood Cellscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Model
  2. 2026A Semi-Supervised Framework for Breast Ultrasound Segmentation with Training-Free Pseudo-Label Generation and Label Refinement
  3. 2024MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentation
  4. 2026Multiscale Switch for Semi-Supervised and Contrastive Learning in Medical Ultrasound Image Segmentation
  5. 2026FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model
  6. 2022Knowledge Distillation from Cross Teaching Teachers for Efficient Semi-Supervised Abdominal Organ Segmentation in CT
  7. 2025FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysis
  8. 2025Cross-pyramid consistency regularization for semi-supervised medical image segmentation