mlsanityData to 7 Oct 2026

JDCNet: Confidence-Gated Privileged-Modality Distillation for Cost-Preserving X-ray Inference

arXiv 2603.29167 ↗First posted 31 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We study a systems-level visual inference problem: using an expensive privileged modality during training while preserving a fixed-cost, single-modality deployment path. We present JDCNet, a confidence-gated CT-to-X-ray distillation framework in which the CT teacher supplies an auxiliary hard or temperature-scaled target only on training samples whose teacher confidence exceeds a threshold; at deployment the student takes X-ray input alone and matches the parameter, MAC, and latency profile of the supervised X-ray baseline. On a 510-patient same-patient paired BIMCV cohort with patient-level 5-fold cross-validation, two JDCNet configurations clear a fixed transfer gate against the supervised ResNet-18 baseline: 3-slice soft-KL supervision yields DeltaBA=+0.035 (95% CI [+0.011,+0.057]) and mid-slice hard supervision yields +0.033 ([+0.007,+0.058]). Under the same splits and gate, logit distillation, gated logit distillation, contrastive alignment, attention transfer, feature hints, BiomedCLIP fine-tuning, and a module-augmented variant do not pass. Confidence-gated auxiliary targets are therefore a more transferable channel than uniformly softened CT logits; the evidence is bounded to one paired cohort, so external paired-cohort replication is required before any deployment claim.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

27 of 36 references.

References · 27

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  4. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  5. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  6. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  7. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  8. 2019Contrastive Representation Distillationcited by 734
  9. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  10. 2017CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learningcited by 459
  11. 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 374
  12. 2019Transfusion: Understanding Transfer Learning for Medical Imagingcited by 366
15 more
  1. 2015Unifying distillation and privileged informationcited by 218
  2. 2019Hidden Stratification Causes Clinically Meaningful Failures in Machine Learning for Medical Imagingcited by 215
  3. 2015Cross Modal Distillation for Supervision Transfercited by 173
  4. 2020Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scanscited by 158
  5. 2018Why rankings of biomedical image analysis competitions should be interpreted with carecited by 90
  6. 2021Soft-Label Anonymous Gastric X-ray Image Distillationcited by 51
  7. 2021How I failed machine learning in medical imaging -- shortcomings and recommendationscited by 37
  8. 2022XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learningcited by 30
  9. 2021COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer modelscited by 27
  10. 2023Quantifying the Knowledge in GNNs for Reliable Distillation into MLPscited by 25
  11. 2024Multi-modal Vision Pre-training for Medical Image Analysiscited by 22
  12. 2021Variational Knowledge Distillation for Disease Classification in Chest X-Rayscited by 9
  13. 2022BD-KD: Balancing the Divergences for Online Knowledge Distillationcited by 7
  14. 2025MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillationcited by 5
  15. 2025Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentationcited by 4

Built on by

Not cited yet.