Beyond the Failures: Rethinking Foundation Models in Pathology
Not on the map. Why?
Abstract (arXiv)
Despite their successes in vision and language, foundation models have stumbled in pathology, revealing low accuracy, instability, and heavy computational demands. These shortcomings stem not from tuning problems but from deeper conceptual mismatches: dense embeddings cannot represent the combinatorial richness of tissue, and current architectures inherit flaws in self-supervision, patch design, and noise-fragile pretraining. Biological complexity and limited domain innovation further widen the gap. The evidence is clear-pathology requires models explicitly designed for biological images rather than adaptations of large-scale natural-image methods whose assumptions do not hold for tissue.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
12 of 20 references.
References · 12
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 156
- 2025On the Theoretical Limitations of Embedding-Based Retrievalcited by 98
- 2025Current Pathology Foundation Models are unrobust to Medical Center Differencescited by 37
- 2025Foundation Models in Computational Pathology: A Review of Challenges, Opportunities, and Impactcited by 22
- 2023Rotation-Agnostic Image Representation Learning for Digital Pathologycited by 15
- 2025A Survey on Computational Pathology Foundation Models: Datasets, Adaptation Strategies, and Evaluation Taskscited by 15
- 2025A Survey of Pathology Foundation Model: Progress and Future Directionscited by 14
- 2025Foundation Models -- A Panacea for Artificial Intelligence in Pathology?cited by 10
- 2022Learning Binary and Sparse Permutation-Invariant Representations for Fast and Memory Efficient Whole Slide Image Searchcited by 9
- 2024Are the Latent Representations of Foundation Models for Pathology Invariant to Rotation?cited by 4
- 2025Universal and Transferable Attacks on Pathology Foundation Modelscited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Do Pathology Foundation Models Encode Disease Progression? A Pseudotime Analysis of Visual Representationscited by 0
- 2026Epistemic Compression: The Case for Deliberate Ignorance in High-Stakes AIcited by 0
- 2026SIMPLER: H&E-Informed Representation Learning for Structured Illumination Microscopycited by 0
- 2026Validation of Whole-Slide Foundation Models for Image Retrieval in TCGA Datacited by 0
- 2026MorphologyFM: A Foundation Model for Morphology-Aware Representation Learning from ECG and Pulse Oximetry Waveformscited by 0
- 2026Robustifying pathology foundation models via fine-tuningcited by 0
- 2026Robustifying pathology foundation models via fine-tuning24 Jul 2026
- 2026MorphologyFM: A Foundation Model for Morphology-Aware Representation Learning from ECG and Pulse Oximetry Waveforms3 Jul 2026
- 2026Validation of Whole-Slide Foundation Models for Image Retrieval in TCGA Data28 Apr 2026
- 2026SIMPLER: H&E-Informed Representation Learning for Structured Illumination Microscopy11 Apr 2026
- 2026Epistemic Compression: The Case for Deliberate Ignorance in High-Stakes AI26 Mar 2026
- 2026Do Pathology Foundation Models Encode Disease Progression? A Pseudotime Analysis of Visual Representations29 Jan 2026