VISTA-PATH: An interactive foundation model for pathology image segmentation and quantitative analysis in computational pathology
Not on the map. Why?
Abstract (arXiv)
Accurate semantic segmentation for histopathology image is crucial for quantitative tissue analysis and downstream clinical modeling. Recent segmentation foundation models have improved generalization through large-scale pretraining, yet remain poorly aligned with pathology because they treat segmentation as a static visual prediction task. Here we present VISTA-PATH, an interactive, class-aware pathology segmentation foundation model designed to resolve heterogeneous structures, incorporate expert feedback, and produce pixel-level segmentation that are directly meaningful for clinical interpretation. VISTA-PATH jointly conditions segmentation on visual context, semantic tissue descriptions, and optional expert-provided spatial prompts, enabling precise multi-class segmentation across heterogeneous pathology images. To support this paradigm, we curate VISTA-PATH Data, a large-scale pathology segmentation corpus comprising over 1.6 million image-mask-text triplets spanning 9 organs and 93 tissue classes. Across extensive held-out and external benchmarks, VISTA-PATH consistently outperforms existing segmentation foundation models. Importantly, VISTA-PATH supports dynamic human-in-the-loop refinement by propagating sparse, patch-level bounding-box annotation feedback into whole-slide segmentation. Finally, we show that the high-fidelity, class-aware segmentation produced by VISTA-PATH is a preferred model for computational pathology. It improve tissue microenvironment analysis through proposed Tumor Interaction Score (TIS), which exhibits strong and significant associations with patient survival. Together, these results establish VISTA-PATH as a foundation model that elevates pathology image segmentation from a static prediction to an interactive and clinically grounded representation for digital pathology. Source code and demo can be found at https://github.com/zhihuanglab/VISTA-PATH.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 58 references that are in the map. First posted on arXiv 23 Jan 2026.
Builds on
23 of 58 references.
References · 23
- 2017Attention Is All You Needcited by 59,932
- 2023Segment Anythingcited by 8,158
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
- 2019Res2Net: A New Multi-scale Backbone Architecturecited by 468
- 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 387
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 206
- 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 156
11 more
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
- 2019Star-convex Polyhedra for 3D Object Detection and Segmentation in Microscopycited by 45
- 2021Multi-Layer Pseudo-Supervision for Histopathology Tissue Semantic Segmentation using Patch-level Classification Labelscited by 43
- 2021Predicting Axillary Lymph Node Metastasis in Early Breast Cancer Using Deep Learning on Primary Tumor Biopsy Slidescited by 43
- 2019Signet Ring Cell Detection With a Semi-supervised Learning Frameworkcited by 27
- 2023SAM-Path: A Segment Anything Model for Semantic Segmentation in Digital Pathologycited by 26
- 2025A co-evolving agentic AI system for medical imaging analysiscited by 16
- 2020Deep Learning Methods for Lung Cancer Segmentation in Whole-slide Histopathology Images -- the ACDC@LungHP Challenge 2019cited by 11
- 2025KPIs 2024 Challenge: Advancing Glomerular Segmentation from Patch- to Slide-Levelcited by 7
- 2025Segment Anything in Pathology Images with Natural Languagecited by 7
- 2023Hematoxylin and eosin stained oral squamous cell carcinoma histological images datasetcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.