mlsanityData to 7 Oct 2026

Pathway-Structured Privileged Distillation for Deployable Computational Pathology

arXiv 2606.02877 ↗First posted 1 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Integrating transcriptomics and histopathology can improve cancer risk modelling, yet practical use is constrained by the limited availability of RNA profiling in routine settings. Here we introduce Mixture of Pathway Experts (MoPE), a knowledge-distillation framework that reframes multimodal learning as privileged distillation for histology-only inference. MoPE is motivated by the partial observability between RNA profiles and whole-slide images: histology can capture morphology-linked consequences of certain molecular programmes, but cannot be expected to reconstruct the full transcriptomic state. MoPE encodes RNA-derived pathways and transfers the molecular supervision to pathway-indexed pathology experts through memory-usage alignment. Across diverse public benchmarks and two independent breast cancer cohorts, MoPE consistently improved WSI-only inference performance relative to baseline methods. Pathway-usage analyses and human-audited visual inspection provide bounded inspection of model behaviour and candidate morphology-linked readouts. These results support pathway-structured privileged distillation as a promising route to using molecular information during training while preserving RNA-free inference.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 54 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

17 of 54 references.

References · 17

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2018Sanity Checks for Saliency Mapscited by 1,149
  3. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  4. 2019Attention is not Explanationcited by 916
  5. 2017Self-Normalizing Neural Networkscited by 591
  6. 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
  7. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
  8. 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 254
  9. 2019Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosiscited by 165
  10. 2023Multimodal Optimal Transport-based Co-Attention Transformer with Global Structure Consistency for Survival Predictioncited by 86
  11. 2024Dynamic Graph Representation with Knowledge-aware Attention for Histopathology Whole Slide Image Analysiscited by 66
  12. 2025Accelerating Data Processing and Benchmarking of AI Models for Pathologycited by 58
5 more
  1. 2024Multimodal Prototyping for cancer survival predictioncited by 47
  2. 2026Momentum Memory for Knowledge Distillation in Computational Pathologycited by 4
  3. 2026Mixture of Mini Experts: Overcoming the Linear Layer Bottleneck in Multiple Instance Learningcited by 3
  4. 2025Disentangled Multi-modal Learning of Histology and Transcriptomics for Cancer Characterizationcited by 2
  5. 2025Multi-modal Knowledge Decomposition based Online Distillation for Biomarker Prediction in Breast Cancer Histopathologycited by 2

Built on by

Not cited yet.