mlsanityData to 14 Oct 2026

Knowledge Distillation Approach for SOS Fusion Staging: Towards Fully Automated Skeletal Maturity Assessment

arXiv 2505.21561 ↗First posted 27 May 2025cs.CV cs.LGcited by 0

On the map: Knowledge distillation → Distillation for medical imaging

Abstract (arXiv)

We introduce a novel deep learning framework for the automated staging of spheno-occipital synchondrosis (SOS) fusion, a critical diagnostic marker in both orthodontics and forensic anthropology. Our approach leverages a dual-model architecture wherein a teacher model, trained on manually cropped images, transfers its precise spatial understanding to a student model that operates on full, uncropped images. This knowledge distillation is facilitated by a newly formulated loss function that aligns spatial logits as well as incorporates gradient-based attention spatial mapping, ensuring that the student model internalizes the anatomically relevant features without relying on external cropping or YOLO-based segmentation. By leveraging expert-curated data and feedback at each step, our framework attains robust diagnostic accuracy, culminating in a clinically viable end-to-end pipeline. This streamlined approach obviates the need for additional pre-processing tools and accelerates deployment, thereby enhancing both the efficiency and consistency of skeletal maturation assessment in diverse clinical settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 6 of its 41 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

6 of 41 references.

References · 6

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  6. 2022A ConvNet for the 2020scited by 3,579

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Structure-aware Knowledge-guided Heterogeneous Mamba for Zygomaticomaxillary Suture Assessment
  2. 2025Rapid Bone Scintigraphy Enhancement via Semantic Prior Distillation from Segment Anything Model
  3. 2025Real-Time Reconstruction of 3D Bone Models via Very-Low-Dose Protocols
  4. 2026Weighted Knowledge Distillation for Semi-Supervised Segmentation of Maxillary Sinus in Panoramic X-ray Images
  5. 2025ArchMap: Arch-Flattening and Knowledge-Guided Vision Language Model for Tooth Counting and Structured Dental Understanding
  6. 2026Zero-shot large vision-language model prompting for automated bone identification in paleoradiology x-ray archives
  7. 2026MATHENA: Mamba-based Architectural Tooth Hierarchical Estimator and Holistic Evaluation Network for Anatomy
  8. 2023Self-Knowledge Distillation for Surgical Phase Recognition