JDCNet: Confidence-Gated Privileged-Modality Distillation for Cost-Preserving X-ray Inference
Not on the map. Why?
Abstract (arXiv)
We study a systems-level visual inference problem: using an expensive privileged modality during training while preserving a fixed-cost, single-modality deployment path. We present JDCNet, a confidence-gated CT-to-X-ray distillation framework in which the CT teacher supplies an auxiliary hard or temperature-scaled target only on training samples whose teacher confidence exceeds a threshold; at deployment the student takes X-ray input alone and matches the parameter, MAC, and latency profile of the supervised X-ray baseline. On a 510-patient same-patient paired BIMCV cohort with patient-level 5-fold cross-validation, two JDCNet configurations clear a fixed transfer gate against the supervised ResNet-18 baseline: 3-slice soft-KL supervision yields DeltaBA=+0.035 (95% CI [+0.011,+0.057]) and mid-slice hard supervision yields +0.033 ([+0.007,+0.058]). Under the same splits and gate, logit distillation, gated logit distillation, contrastive alignment, attention transfer, feature hints, BiomedCLIP fine-tuning, and a module-augmented variant do not pass. Confidence-gated auxiliary targets are therefore a more transferable channel than uniformly softened CT logits; the evidence is bounded to one paired cohort, so external paired-cohort replication is required before any deployment claim.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
27 of 36 references.
References · 27
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2019Contrastive Representation Distillationcited by 734
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 374
- 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 366
15 more
- 2015Unifying distillation and privileged informationcited by 218
- 2019Hidden Stratification Causes Clinically Meaningful Failures in Machine Learning for Medical Imagingcited by 215
- 2015Cross Modal Distillation for Supervision Transfercited by 173
- 2020Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scanscited by 158
- 2018Why rankings of biomedical image analysis competitions should be interpreted with carecited by 90
- 2021Soft-Label Anonymous Gastric X-ray Image Distillationcited by 51
- 2021How I failed machine learning in medical imaging -- shortcomings and recommendationscited by 37
- 2022XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learningcited by 30
- 2021COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer modelscited by 27
- 2023Quantifying the Knowledge in GNNs for Reliable Distillation into MLPscited by 25
- 2024Multi-modal Vision Pre-training for Medical Image Analysiscited by 22
- 2021Variational Knowledge Distillation for Disease Classification in Chest X-Rayscited by 9
- 2022BD-KD: Balancing the Divergences for Online Knowledge Distillationcited by 7
- 2025MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillationcited by 5
- 2025Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentationcited by 4
Built on by
Not cited yet.