PathOrchestra: A Comprehensive Foundation Model for Computational Pathology with Over 100 Diverse Clinical-Grade Tasks
Not on the map. Why?
Abstract (arXiv)
The complexity and variability inherent in high-resolution pathological images present significant challenges in computational pathology. While pathology foundation models leveraging AI have catalyzed transformative advancements, their development demands large-scale datasets, considerable storage capacity, and substantial computational resources. Furthermore, ensuring their clinical applicability and generalizability requires rigorous validation across a broad spectrum of clinical tasks. Here, we present PathOrchestra, a versatile pathology foundation model trained via self-supervised learning on a dataset comprising 300K pathological slides from 20 tissue and organ types across multiple centers. The model was rigorously evaluated on 112 clinical tasks using a combination of 61 private and 51 public datasets. These tasks encompass digital slide preprocessing, pan-cancer classification, lesion identification, multi-cancer subtype classification, biomarker assessment, gene expression prediction, and the generation of structured reports. PathOrchestra demonstrated exceptional performance across 27,755 WSIs and 9,415,729 ROIs, achieving over 0.950 accuracy in 47 tasks, including pan-cancer classification across various organs, lymphoma subtype diagnosis, and bladder cancer screening. Notably, it is the first model to generate structured reports for high-incidence colorectal cancer and diagnostically complex lymphoma-areas that are infrequently addressed by foundational models but hold immense clinical potential. Overall, PathOrchestra exemplifies the feasibility and efficacy of a large-scale, self-supervised pathology foundation model, validated across a broad range of clinical-grade tasks. Its high accuracy and reduced reliance on extensive data annotation underline its potential for clinical integration, offering a pathway toward more efficient and high-quality medical services.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 26 of its 62 references that are in the map. First posted on arXiv 31 Mar 2025.
Builds on
26 of 62 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
14 more
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2018Rotation Equivariant CNNs for Digital Pathologycited by 420
- 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 387
- 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
- 2018BACH: Grand Challenge on Breast Cancer Histology Imagescited by 131
- 2020PanNuke Dataset Extension, Insights and Baselinescited by 113
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 104
- 2019Lung and Colon Cancer Histopathological Image Dataset (LC25000)cited by 86
- 2021Hard Sample Aware Noise Robust Learning for Histopathology Image Classificationcited by 48
- 2022WSSS4LUAD: Grand Challenge on Weakly-supervised Tissue Semantic Segmentation for Lung Adenocarcinomacited by 32
- 2020Interpretable Survival Prediction for Colorectal Cancer using Deep Learningcited by 30
- 2018Encoding Visual Sensitivity by MaxPol Convolution Filters for Image Sharpness Assessmentcited by 7
- 2024Domain-stratified Training for Cross-organ and Cross-scanner Adenocarcinoma Segmentation in the COSAS 2024 Challengecited by 1
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncologycited by 6
- 2025Hypergraph Mamba for Efficient Whole Slide Image Understandingcited by 1
- 2025A Unified Low-level Foundation Model for Enhancing Pathology Image Qualitycited by 1
- 2026Beyond ViT Tokens: Masked-Diffusion Pretrained Convolutional Pathology Foundation Model for Cell-Level Dense Predictioncited by 1
- 2025StainNet: Scaling Self-Supervised Foundation Models on Immunohistochemistry and Special Stains for Computational Pathologycited by 0
- 2026Enhanced Diagnostic Performance via Large-Resolution Inference Optimization for Pathology Foundation Modelscited by 0
- 2026Efficient Special Stain Classificationcited by 0
- 2026TAP-Path: Task-Adaptive Structural and Token Pruning for Efficient and Trustworthy Pathology Foundation Modelscited by 0
- 2026TAP-Path: Task-Adaptive Structural and Token Pruning for Efficient and Trustworthy Pathology Foundation Models3 Sep 2026
- 2026Beyond ViT Tokens: Masked-Diffusion Pretrained Convolutional Pathology Foundation Model for Cell-Level Dense Prediction8 May 2026
- 2026Efficient Special Stain Classification10 Feb 2026
- 2026Enhanced Diagnostic Performance via Large-Resolution Inference Optimization for Pathology Foundation Models17 Jan 2026
- 2025StainNet: Scaling Self-Supervised Foundation Models on Immunohistochemistry and Special Stains for Computational Pathology11 Dec 2025
- 2025MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncology25 Nov 2025
- 2025A Unified Low-level Foundation Model for Enhancing Pathology Image Quality1 Sep 2025
- 2025Hypergraph Mamba for Efficient Whole Slide Image Understanding23 May 2025