Weighted Knowledge Distillation for Semi-Supervised Segmentation of Maxillary Sinus in Panoramic X-ray Images
Not on the map. Why?
Abstract (arXiv)
Accurate segmentation of maxillary sinus in panoramic X-ray images is essential for dental diagnosis and surgical planning; however, this task remains relatively underexplored in dental imaging research. Structural overlap, ambiguous anatomical boundaries inherent to two-dimensional panoramic projections, and the limited availability of large scale clinical datasets with reliable pixel-level annotations make the development and evaluation of segmentation models challenging. To address these challenges, we propose a semi-supervised segmentation framework that effectively leverages both labeled and unlabeled panoramic radiographs, where knowledge distillation is utilized to train a student model with reliable structural information distilled from a teacher model. Specifically, we introduce a weighted knowledge distillation loss to suppress unreliable distillation signals caused by structural discrepancies between teacher and student predictions. To further enhance the quality of pseudo labels generated by the teacher network, we introduce SinusCycle-GAN which is a refinement network based on unpaired image-to-image translation. This refinement process improves the precision of boundaries and reduces noise propagation when learning from unlabeled data during semi-supervised training. To evaluate the proposed method, we collected clinical panoramic X-ray images from 2,511 patients, and experimental results demonstrate that the proposed method outperforms state-of-the-art segmentation models, achieving the Dice score of 96.35% while reducing boundary error. The results indicate that the proposed semi-supervised framework provides robust and anatomically consistent segmentation performance under limited labeled data conditions, highlighting its potential for broader dental image analysis applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 33 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
13 of 33 references.
References · 13
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2022Cross-Image Relational Knowledge Distillation for Semantic Segmentationcited by 117
- 2019Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognitioncited by 95
- 2021Knowledge distillation from multi-modal to mono-modal segmentation networkscited by 68
- 2023BPKD: Boundary Privileged Knowledge Distillation For Semantic Segmentationcited by 15
- 2024Shape-intensity knowledge distillation for robust medical image segmentationcited by 4
1 more
Built on by
Not cited yet.