mlsanityData to 14 Oct 2026

REACT-KD: Region-Aware Cross-modal Topological Knowledge Distillation for Interpretable Medical Image Classification

arXiv 2508.02104 ↗First posted 4 Aug 2025eess.IV cs.CVcited by 0

On the map: Knowledge distillation → Distillation for medical imaging

Abstract (arXiv)

Reliable and interpretable tumor classification from clinical imaging remains a core challenge. The main difficulties arise from heterogeneous modality quality, limited annotations, and the absence of structured anatomical guidance. We present REACT-KD, a Region-Aware Cross-modal Topological Knowledge Distillation framework that transfers supervision from high-fidelity multi-modal sources into a lightweight CT-based student model. The framework employs a dual teacher design. One branch captures structure-function relationships through dual-tracer PET/CT, while the other models dose-aware features using synthetically degraded low-dose CT. These branches jointly guide the student model through two complementary objectives. The first achieves semantic alignment through logits distillation, and the second models anatomical topology through region graph distillation. A shared CBAM3D module ensures consistent attention across modalities. To improve reliability in deployment, REACT-KD introduces modality dropout during training, which enables robust inference under partial or noisy inputs. As a case study, we applied REACT-KD to hepatocellular carcinoma staging. The framework achieved an average AUC of 93.5% on an internal PET/CT cohort and maintained 76.6% to 81.5% AUC across varying levels of dose degradation in external CT testing. Decision curve analysis further shows that REACT-KD consistently provides the highest net clinical benefit across all thresholds, confirming its value in real-world diagnostic practice. Code is available at: https://github.com/Kinetics-JOJO/REACT-KD

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Distillation for medical imaging, one of 12 directions in Knowledge distillation. Builds on 18 of its 35 references that are in the map. First posted on arXiv 4 Aug 2025.

Builds on

18 of 35 references.

References · 18

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  3. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
  4. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
  5. 2019Contrastive Representation Distillationcited by 748
  6. 2019The Liver Tumor Segmentation Benchmark (LiTS)cited by 509
  7. 2022Decoupled Knowledge Distillationcited by 388
  8. 20183D MRI brain tumor segmentation using autoencoder regularizationcited by 328
  9. 2020A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promisescited by 231
  10. 2020Channel-wise Knowledge Distillation for Dense Predictioncited by 163
  11. 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 163
  12. 2019Gromov-Wasserstein Learning for Graph Matching and Node Embeddingcited by 126
6 more
  1. 2022Cross-Image Relational Knowledge Distillation for Semantic Segmentationcited by 118
  2. 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 49
  3. 2023Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modalitycited by 45
  4. 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directionscited by 10
  5. 2023Graph-based Knowledge Distillation: A survey and experimental evaluationcited by 6
  6. 2025MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillationcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026UnDA: Unpaired Domain Alignment for Cross-Modal Knowledge Transfer in Medical Imaging
  2. 2026ReCo-KD: Region- and Context-Aware Knowledge Distillation for Efficient 3D Medical Image Segmentation
  3. 2024Unsupervised Tumor-Aware Distillation for Multi-Modal Brain Image Translation
  4. 2023Prototype Knowledge Distillation for Medical Segmentation with Missing Modality
  5. 2025WeCKD: Weakly-supervised Chained Distillation Network for Efficient Multimodal Medical Imaging
  6. 2026Shared Semantic Codebook Distillation for Unpaired Cross-Modal Medical Classification
  7. 2021Knowledge distillation from multi-modal to mono-modal segmentation networks
  8. 2023Rethinking Intermediate Layers design in Knowledge Distillation for Kidney and Liver Tumor Segmentation