Learning the Language of Histopathology Images reveals Prognostic Subgroups in Invasive Lung Adenocarcinoma Patients
Not on the map. Why?
Abstract (arXiv)
Recurrence remains a major clinical challenge in surgically resected invasive lung adenocarcinoma, where existing grading and staging systems fail to capture the cellular complexity that underlies tumor aggressiveness. We present PathRosetta, a novel AI model that conceptualizes histopathology as a language, where cells serve as words, spatial neighborhoods form syntactic structures, and tissue architecture composes sentences. By learning this language of histopathology, PathRosetta predicts five-year recurrence directly from hematoxylin-and-eosin (H&E) slides, treating them as documents representing the state of the disease. In a multi-cohort dataset of 289 patients (600 slides), PathRosetta achieved an area under the curve (AUC) of 0.78 +- 0.04 on the internal cohort, significantly outperforming IASLC grading (AUC:0.71), AJCC staging (AUC:0.64), and other state-of-the-art AI models (AUC:0.62-0.67). It yielded a hazard ratio of 9.54 and a concordance index of 0.70, generalized robustly to external TCGA (AUC:0.75) and CPTAC (AUC:0.76) cohorts, and performed consistently across demographic and clinical subgroups. Beyond whole-slide prediction, PathRosetta uncovered prognostic subgroups within individual cell types, revealing that even within benign epithelial, stromal, or other cells, distinct morpho-spatial phenotypes correspond to divergent outcomes. Moreover, because the model explicitly understands what it is looking at, including cell types, cellular neighborhoods, and higher-order tissue morphology, it is inherently interpretable and can articulate the rationale behind its predictions. These findings establish that representing histopathology as a language enables interpretable and generalizable prognostication from routine histology.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 49 references that are in the map. First posted on arXiv 22 Aug 2025.
Builds on
15 of 49 references.
References · 15
- 2023Segment Anythingcited by 8,234
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 555
- 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
- 2024Phikon-v2, A large and public feature extractor for biomarker predictioncited by 74
- 2025Accelerating Data Processing and Benchmarking of AI Models for Pathologycited by 65
- 2025Molecular-driven Foundation Model for Oncologic Pathologycited by 55
- 2025CellViT++: Energy-Efficient and Adaptive Cell Segmentation and Classification Using Foundation Modelscited by 21
- 2025Multi-Modal Foundation Models for Computational Pathology: A Surveycited by 9
- 2024Computational Pathology for Accurate Prediction of Breast Cancer Recurrence: Development and Validation of a Deep Learning-based Toolcited by 6
3 more
- 2023Attention2Minority: A salient instance inference-based multiple instance learning for classifying small lesions in whole slide imagescited by 5
- 2023Cross-attention-based saliency inference for predicting cancer metastasis on whole slide imagescited by 5
- 2024Zero-Shot Whole Slide Image Retrieval in Histopathology Using Embeddings of Foundation Modelscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.