Atlas H&E-TME: Scalable AI-Based Tissue Profiling at Expert Pathologist-Level Accuracy
Not on the map. Why?
Abstract (arXiv)
Hematoxylin and eosin (H&E) staining is the cornerstone of histopathology, yet scalable, quantitative analysis of H&E whole-slide images (WSIs) remains a central challenge in computational pathology. We present Atlas H&E-TME, an AI-based system built on the Atlas family of pathology foundation models that predicts tissue quality, tissue region, and cell type labels across multiple cancer types, yielding over 4,500 quantitative readouts per slide at cell-level resolution. A key challenge to validating such systems is overcoming morphological ambiguity inherent to H&E-only ground truth and the limited scalability of more informed references drawing on modalities such as immunohistochemistry (IHC). We address this with a dual validation framework combining biologically grounded depth with technical and morphological breadth. For depth, we propose an IHC-informed multi-pathologist consensus protocol that substantially improves inter-rater agreement over conventional H&E-only annotation. This yields a molecularly grounded reference against which we compare Atlas H&E-TME and pathologists working from H&E alone. For breadth, we benchmark Atlas H&E-TME on over 200,000 high-confidence H&E-only pathologist annotations across 1,500+ cases spanning eight cancer types and their most common metastatic sites, with subtypes covering >90% of clinical cases per cancer type, drawn from 25+ sources and 8+ scanner models. Benchmarked against the IHC-informed consensus, Atlas H&E-TME matches or exceeds pathologist H&E-only performance and generalizes consistently and robustly across this broad morphological and technical scope. In doing so, Atlas H&E-TME turns the H&E slide -- the most ubiquitous data in pathology -- into a scalable, quantitative window into the tumor and its microenvironment, laying a foundation for the next generation of tissue-based biomarkers in translational and clinical research.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 44 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
19 of 44 references.
References · 19
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2025DINOv3cited by 1,414
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 388
- 2018Cell Detection with Star-convex Polygonscited by 183
- 2020PanNuke Dataset Extension, Insights and Baselinescited by 114
- 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
- 2021Lizard: A Large-Scale Dataset for Colonic Nuclear Instance Segmentation and Classificationcited by 89
- 2024RudolfV: A Foundation Model by Pathologists for Pathologistscited by 41
- 2021NuCLS: A scalable crowdsourcing, deep learning approach and dataset for nucleus classification, localization and segmentationcited by 34
- 2018Epithelium segmentation using deep learning in H&E-stained prostate specimens with immunohistochemistry as reference standardcited by 25
7 more
- 2021Multi-Class Cell Detection Using Spatial Context Representationcited by 24
- 2025CellViT++: Energy-Efficient and Adaptive Cell Segmentation and Classification Using Foundation Modelscited by 21
- 2025Atlas: A Novel Pathology Foundation Model by Mayo Clinic, Charit'e, and Aignosticscited by 11
- 2026Atlas 2 -- Foundation models for clinical deploymentcited by 7
- 2022Variability Matters : Evaluating inter-rater variability in histopathology for robust cell detectioncited by 3
- 2026OpenTME: An Open Dataset of AI-powered H&E Tumor Microenvironment Profiles from TCGAcited by 2
- 2025PhenoBench: A Comprehensive Benchmark for Cell Phenotypingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.