mlsanityData to 14 Oct 2026

Streamline pathology foundation model by cross-magnification distillation

arXiv 2509.23097 ↗First posted 27 Sep 2025cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Foundation models (FM) have transformed computational pathology but remain computationally prohibitive for clinical deployment due to their massive parameter counts and high-magnification processing requirements. Here, we introduce XMAG, a lightweight FM developed through corss-magnification distillation that transfers knowledge from state-of-the-art 20x magnification teacher to an efficient 5x magnification student architecture. XMAG employs a compact backbone and operates entirely at 5x, requiring 11.3 times fewer patches per whole slide image (WSI) compared to existing approaches. Our Novel distillation framework incorporates dual-level knowledge transfer, aligning both global image representations and local spatial token mapping. We trained XMAG on 3.49 million images curated from publicly available datasets and evaluated performance across six clinically relevant histopathology analysis tasks spanning multiple cancer types. XMAG achieved diagnostic accuracy within 1% of substantially larger foundation models while delivering 30-fold processing acceleration, reaching 8.8 WSIs per minute processing speed. Our cross-institutional validation confirmed robust generalization. Further, we developed an end-to-end training strategy to further boost our model's performance to approach the larger FMs' performance. These results establish cross-magnification distillation as a viable approach for deploying FM capabilities in resource-constrained clinical environments, potentially enabling real-time pathology AI integration.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 18 of its 38 references that are in the map. First posted on arXiv 27 Sep 2025.

Builds on

18 of 38 references.

References · 18

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2020Knowledge Distillation: A Surveycited by 1,603
  5. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  6. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
  7. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
  8. 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 256
  9. 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
  10. 2023Artificial Intelligence for Digital and Computational Pathologycited by 108
  11. 2024Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillationcited by 31
  12. 2020Development and Evaluation of a Deep Neural Network for Histologic Classification of Renal Cell Carcinoma on Biopsy and Surgical Resection Slidescited by 24
6 more
  1. 2025LEMON: A Large Endoscopic MONocular Dataset and Foundation Model for Perception in Surgical Settingscited by 20
  2. 2024PrPSeg: Universal Proposition Learning for Panoramic Renal Pathology Segmentationcited by 14
  3. 2025SPIDER: A Comprehensive Multi-Organ Supervised Pathology Dataset and Baseline Modelscited by 13
  4. 2023A Simple Recipe for Competitive Low-compute Self supervised Vision Modelscited by 10
  5. 2024Computational Pathology for Accurate Prediction of Breast Cancer Recurrence: Development and Validation of a Deep Learning-based Toolcited by 6
  6. 2023Cross-attention-based saliency inference for predicting cancer metastasis on whole slide imagescited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.