Can We Simplify Slide-level Fine-tuning of Pathology Foundation Models?
Not on the map. Why?
Abstract (arXiv)
The emergence of foundation models in computational pathology has transformed histopathological image analysis, with whole slide imaging (WSI) diagnosis being a core application. Traditionally, weakly supervised fine-tuning via multiple instance learning (MIL) has been the primary method for adapting foundation models to WSIs. However, in this work we present a key experimental finding: a simple nonlinear mapping strategy combining mean pooling and a multilayer perceptron, called SiMLP, can effectively adapt patch-level foundation models to slide-level tasks without complex MIL-based learning. Through extensive experiments across diverse downstream tasks, we demonstrate the superior performance of SiMLP with state-of-the-art methods. For instance, on a large-scale pan-cancer classification task, SiMLP surpasses popular MIL-based methods by 3.52%. Furthermore, SiMLP shows strong learning ability in few-shot classification and remaining highly competitive with slide-level foundation models pretrained on tens of thousands of slides. Finally, SiMLP exhibits remarkable robustness and transferability in lung cancer subtyping. Overall, our findings challenge the conventional MIL-based fine-tuning paradigm, demonstrating that a task-agnostic representation strategy alone can effectively adapt foundation models to WSI analysis. These insights offer a unique and meaningful perspective for future research in digital pathology, paving the way for more efficient and broadly applicable methodologies.
Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 28 Feb 2025.
Builds on
25 of 40 references.
References · 25
- 2018Attention-based Deep Multiple Instance Learningcited by 1,083
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 739
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 551
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 474
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
- 2022DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classificationcited by 255
- 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 192
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 157
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 130
- 2023Artificial Intelligence for Digital and Computational Pathologycited by 107
- 2022A graph-transformer for whole slide image classificationcited by 84
13 more
- 2024Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathologycited by 70
- 2024Feature Re-Embedding: Towards Foundation Model-Level Performance in Computational Pathologycited by 66
- 2024Dynamic Graph Representation with Knowledge-aware Attention for Histopathology Whole Slide Image Analysiscited by 66
- 2023Attention-Challenging Multiple Instance Learning for Whole Slide Image Classificationcited by 61
- 2025Molecular-driven Foundation Model for Oncologic Pathologycited by 53
- 2024Multistain Pretraining for Slide Representation Learning in Pathologycited by 28
- 2024HMIL: Hierarchical Multi-Instance Learning for Fine-Grained Whole Slide Image Classificationcited by 13
- 2023Shapley Values-enabled Progressive Pseudo Bag Augmentation for Whole Slide Image Classificationcited by 12
- 2024Agent Aggregator with Mask Denoise Mechanism for Histopathology Whole Slide Image Analysiscited by 11
- 2021HEROHE Challenge: assessing HER2 status in breast cancer without immunohistochemistry or in situ hybridizationcited by 8
- 2024RetMIL: Retentive Multiple Instance Learning for Histopathological Whole Slide Image Classificationcited by 7
- 2024Diagnostic Text-guided Representation Learning in Hierarchical Classification for Pathological Whole Slide Imagecited by 4
- 2024Towards a Comprehensive Benchmark for Pathological Lymph Node Metastasis in Breast Cancer Sectionscited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025G2L:From Giga-Scale to Cancer-Specific Large-Scale Pathology Foundation Models via Knowledge Distillationcited by 2
- 2026Clinically-Informed Modeling for Pediatric Brain Tumor Classification from Whole-Slide Histopathology Imagescited by 1
- 2025StainNet: Scaling Self-Supervised Foundation Models on Immunohistochemistry and Special Stains for Computational Pathologycited by 0
- 2026Clinically-Informed Modeling for Pediatric Brain Tumor Classification from Whole-Slide Histopathology Images22 Apr 2026
- 2025StainNet: Scaling Self-Supervised Foundation Models on Immunohistochemistry and Special Stains for Computational Pathology11 Dec 2025
- 2025G2L:From Giga-Scale to Cancer-Specific Large-Scale Pathology Foundation Models via Knowledge Distillation13 Oct 2025