VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathology
Not on the map. Why?
Abstract (arXiv)
Pathology vision-language models are advancing rapidly, yet existing benchmarks remain focused on human tissue, particularly oncology, leaving non-human pathology largely unaddressed. This gap is especially important in toxicologic pathology, where microscopic tissue examination of laboratory animals is a core component of preclinical drug safety assessment. To address it, we introduce VIPER, the first expert-curated benchmark for vision-language model evaluation in toxicologic pathology. VIPER contains 1,251 questions associated with 419 H&E-stained rat histology images across seven organ systems, covering multiple-choice, KPrim, and free-text formats. All questions were curated and validated by board-certified veterinary pathologists. In total, we benchmarked 16 models, including two newly introduced veterinary-pathology models, seven human pathology-specialized models, and seven general-purpose frontier models. The results identify a substantial domain gap between veterinary and human pathology, expose the risk of over-diagnosis of normal tissue in frontier models, and show that domain-specific training remains critical for visually grounded predictions. VIPER data and evaluation code are available at https://github.com/mahmoodlab/viper.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 59 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
16 of 59 references.
References · 16
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
- 2025MedGemma Technical Reportcited by 398
- 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 387
- 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 192
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 104
- 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 86
- 2023Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videoscited by 84
- 2019Automated Gleason Grading of Prostate Biopsies using Deep Learningcited by 69
- 2026MIRAGE: The Illusion of Visual Understandingcited by 57
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathologycited by 43
4 more
- 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasonercited by 38
- 2024PathGen-1.6M: 1.6 Million Pathology Image-text Pairs Generation through Multi-agent Collaborationcited by 28
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathologycited by 26
- 2022Pan-tumor CAnine cuTaneous Cancer Histology (CATCH) datasetcited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PathView-Bench: Can Multimodal Large Language Models Achieve Fine-grained Multiscale Understanding of Pathology Images?
- 2025Investigating Zero-Shot Diagnostic Pathology in Vision-Language Models with Efficient Prompt Design
- 2025Multi-Modal Foundation Models for Computational Pathology: A Survey
- 2025How Good is my Histopathology Vision-Language Foundation Model? A Holistic Benchmark
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Models
- 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models
- 2026Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation
- 2024Boosting Vision-Language Models for Histopathology Classification: Predict all at once