TaxoMIL: Taxonomy-Constrained Learning for Hierarchical Whole Slide Image Analysis
Not on the map. Why?
Abstract (arXiv)
Whole slide image (WSI) analysis is central to computational pathology, with multiple instance learning (MIL) emerging as the standard pipeline for slide-level diagnosis. However, conventional approaches formulate WSI diagnosis as a flat classification task over discrete labels, contradicting the inherently hierarchical, coarse-to-fine nature of clinical reasoning. Although recent hierarchical classifiers and vision-language models (VLMs) have sought to address this structural gap, they either fail to capture semantic continuity between related diagnoses or suffer from unconstrained text generation that produces taxonomic hallucinations and parent-child label violations. To address these limitations, we propose TaxoMIL, a taxonomy-constrained framework that reformulates WSI diagnosis as a multi-granularity text generation task. TaxoMIL utilizes a dual-head Transformer decoder to generate coarse- and fine-level diagnostic text, and introduces taxonomy-guided objectives that explicitly structure the label embedding space and strictly ground slide-level visual representations within the clinical taxonomy. Extensive experiments across three diverse WSI datasets demonstrate that TaxoMIL consistently outperforms state-of-the-art MIL classifiers and VLM-based generative methods, yielding accurate and hierarchy-aware diagnostic predictions. The code is released at https://github.com/QuIIL/TaxoMIL
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 16 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
12 of 16 references.
References · 12
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
- 2021BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Imagescited by 132
- 2024MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathologycited by 88
- 2024SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understandingcited by 57
- 2023Structured State Space Models for Multiple Instance Learning in Digital Pathologycited by 41
- 2024WSI-VQA: Interpreting Whole Slide Images by Generative Visual Question Answeringcited by 34
- 2025ViLa-MIL: Dual-scale Vision-Language Multiple Instance Learning for Whole Slide Image Classificationcited by 28
- 2024HMIL: Hierarchical Multi-Instance Learning for Fine-Grained Whole Slide Image Classificationcited by 13
- 2024CAMP: Continuous and Adaptive Learning Model in Pathologycited by 4
- 2026Hierarchical Classification for Improved Histopathology Image Analysiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Decomposing Whole Slide Image Report Generation with Graph-Constrained Multiple Instance Learning Workflows
- 2026Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation
- 2025Dual-stream attention-guided learning for weakly supervised whole slide image classification
- 2026SlideMix: Enhancing Whole Slide Image Analysis via Multimodal Shuffling
- 2025LadderMIL: Multiple Instance Learning with Coarse-to-Fine Self-Distillation
- 2026Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation
- 2026MLLM-HWSI: A Multimodal Large Language Model for Hierarchical Whole Slide Image Understanding
- 2025SemaMIL: Semantic-Aware Multiple Instance Learning with Retrieval-Guided State Space Modeling for Whole Slide Images