ALICE: Learning a General-Purpose Pathology Foundation Model from Vision, Vision-Language, and Slide-Level Experts
Not on the map. Why?
Abstract (arXiv)
Foundation models are reshaping computational pathology, yet their capabilities remain shaped by pretraining objectives, data sources, and spatial scales, fragmenting complementary expertise across separate backbones. Here we present ALICE, a unified foundation model trained through multi-stage agglomerative distillation that sequentially distills eight vision-only, vision-language, and slide-level teacher models into dedicated modules of a single backbone. ALICE is pretrained on 24,985,184 tile-level pathology images and 155,604 high-resolution images, and evaluated across 21 task scenarios, 96 downstream tasks, and 48 data sources, spanning region-of-interest tissue analysis, vision-language multimodal evaluation, and whole-slide clinical assessment. In all three evaluation settings, ALICE achieved the best average rank among task-matched pathology foundation models. These results demonstrate that agglomerative distillation can consolidate complementary capabilities from specialized models into a unified backbone for broad computational pathology applications. The model is available at https://github.com/WonderLandxD/ALICE.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 77 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
8 of 77 references.
References · 8
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
- 2021Conditional Positional Encodings for Vision Transformerscited by 406
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
- 2019Lung and Colon Cancer Histopathological Image Dataset (LC25000)cited by 89
- 2022WSSS4LUAD: Grand Challenge on Weakly-supervised Tissue Semantic Segmentation for Lung Adenocarcinomacited by 36
- 2025HISTAI: An Open-Source, Large-Scale Whole Slide Image Dataset for Computational Pathologycited by 14
- 2026Efficient Universal Perception Encodercited by 10
Built on by
Not cited yet.