HERO: Histology Encoder for Robust Representation in Oncology
Not on the map. Why?
Abstract (arXiv)
Foundation models trained on large pathology image corpora now provide strong, transferable representations for computational pathology. Over the past few years a series of such models has been released, each trained on more slides than the last; on standard classification and segmentation benchmarks, the leading models are now separated by small margins. In clinical use, however, the foundation model is applied to images from hospitals, scanners, and staining protocols outside its training data. Encoders generally embed these acquisition factors alongside biological information, which may introduce downstream errors and hinder safe clinical adoption. A pathology foundation model should therefore be robust to acquisition shift without giving up representation quality, yet robustness is seldom the axis along which models are compared. In this report, we introduce HERO (Histology Encoder for Robust Representation in Oncology), a ViT-G/14 pathology foundation model trained with the DINO and iBOT objectives and refined with high-resolution Gram anchoring on a morphology-balanced corpus of 500 million tiles from approximately 575,000 clinical whole-slide images. Across the evaluated public benchmarks, HERO shows the strongest robustness to center, scanner, and stain variation among the compared state-of-the-art foundation models, performs comparably on tile-level classification, segmentation, and gene-expression prediction, ranks first on average across 39 evaluated slide-level clinical tasks, and, under an equal-weighted framework-level analysis, has the best average rank across the six benchmark frameworks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 55 of its 100 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
55 of 100 references.
References · 55
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2025DINOv3cited by 1,414
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2023Vision Transformers Need Registerscited by 871
- 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 528
- 2018Rotation Equivariant CNNs for Digital Pathologycited by 422
38 more
- 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 388
- 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 365
- 2023SemDeDup: Data-efficient learning at web-scale through semantic deduplicationcited by 303
- 2023Demystifying CLIP Datacited by 270
- 2019Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathologycited by 173
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
- 2020Self supervised contrastive learning for digital histopathologycited by 146
- 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 132
- 2020PanNuke Dataset Extension, Insights and Baselinescited by 114
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
- 2022On the SDEs and Scaling Rules for Adaptive Gradient Algorithmscited by 104
- 2024PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathologycited by 85
- 2024Phikon-v2, A large and public feature extractor for biomarker predictioncited by 74
- 2025Accelerating Data Processing and Benchmarking of AI Models for Pathologycited by 65
- 2021A Petri Dish for Histopathology Image Analysiscited by 64
- 2024A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Modelcited by 59
- 2018Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networkscited by 57
- 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 57
- 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 50
- 2024RudolfV: A Foundation Model by Pathologists for Pathologistscited by 41
- 2025Current Pathology Foundation Models are unrobust to Medical Center Differencescited by 39
- 2025Distilling foundation models for robust and efficient models in digital pathologycited by 36
- 2022RandStainNA: Learning Stain-Agnostic Features from Histology Slides by Bridging Stain Augmentation and Normalizationcited by 32
- 2023Computational Pathology at Health System Scale -- Self-Supervised Foundation Models from Three Billion Imagescited by 31
- 2023OCELOT: Overlapped Cell on Tissue Dataset for Histopathologycited by 29
- 2024The Clever Hans Effect in Unsupervised Learningcited by 24
- 2025Training state-of-the-art pathology foundation models with orders of magnitude less datacited by 21
- 2024Do Histopathological Foundation Models Eliminate Batch Effects? A Comparative Studycited by 18
- 2024PLUTO: Pathology-Universal Transformercited by 17
- 2025SPIDER: A Comprehensive Multi-Organ Supervised Pathology Dataset and Baseline Modelscited by 13
- 2023An interpretable machine learning system for colorectal cancer diagnosis from pathology slidescited by 9
- 2024Evaluating Computational Pathology Foundation Models for Prostate Cancer Grading under Distribution Shiftscited by 9
- 2025THUNDER: Tile-level Histopathology image UNDERstanding benchmarkcited by 9
- 2024AI-based Anomaly Detection for Clinical-Grade Histopathological Diagnosticscited by 8
- 2025SurGen: 1020 H&E-stained Whole Slide Images With Survival and Genetic Markerscited by 8
- 2025MeDi: Metadata-Guided Diffusion Models for Mitigating Biases in Tumor Classificationcited by 7
- 2025Pathology Foundation Models are Scanner Sensitive: Benchmark and Mitigation with Contrastive ScanGen Losscited by 7
50 most cited of 55 All 55 (JSON)
Built on by
Not cited yet.