Transfer Learning Strategies for Pathological Foundation Models: A Systematic Evaluation in Brain Tumor Classification
Not on the map. Why?
Abstract (arXiv)
Foundation models pretrained on large-scale pathology datasets have shown promising results across various diagnostic tasks. Here, we present a systematic evaluation of transfer learning strategies for brain tumor classification using these models. We analyzed 254 cases comprising five major tumor types: glioblastoma, astrocytoma, oligodendroglioma, primary central nervous system lymphoma, and metastatic tumors. Comparing state-of-the-art foundation models with conventional approaches, we found that foundation models demonstrated robust classification performance with as few as 10 patches per case, despite the traditional assumption that extensive per-case image sampling is necessary. Furthermore, our evaluation revealed that simple transfer learning strategies like linear probing were sufficient, while fine-tuning often degraded model performance. These findings suggest a paradigm shift from "training encoders on extensive pathological data" to "querying pre-trained encoders with labeled datasets", providing practical implications for implementing AI-assisted diagnosis in clinical pathology.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 51 references that are in the map. First posted on arXiv 19 Jan 2025.
Builds on
13 of 51 references.
References · 13
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
- 2018Albumentations: fast and flexible image augmentationscited by 558
- 2019Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathologycited by 172
- 2021Revisiting ResNets: Improved Training and Scaling Strategiescited by 158
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 144
- 2024Benchmarking Pathology Foundation Models: Adaptation Strategies and Scenarioscited by 16
Built on by
Not cited yet.