Decomposing Whole Slide Image Report Generation with Graph-Constrained Multiple Instance Learning Workflows
Not on the map. Why?
Abstract (arXiv)
Whole-slide image (WSI) report generation requires recognizing spatially distributed pathological features and organizing them into a coherent diagnostic narrative. Although direct vision-to-text models can yield fluent reports, they obscure the contributions and failure modes of visual recognition, structured reasoning, and language generation. We propose a decomposed framework in which frozen Virchow2 tile embeddings are aggregated by multiple-instance learning (MIL) classification heads that answer organ-specific diagnostic questions. An organ-conditioned graph constrains the assembly of these answers into a structured reasoning chain, which a language model realizes as a pathology report. On the REG2026 held-out set of 2,028 slides, the proposed workflow achieved a chain-Jaccard score of 0.702. Performance fell to 0.420 without graph-based chain construction, 0.398 when the organ-specific graphs were replaced by a single organ-agnostic graph, and 0.371 when the language model constructed the chain freely from MIL predictions. Using the same report generator, graph-structured chains improved the report score from 0.330 to 0.495. On 350 external TCGA WSIs spanning the seven REG organs without fine-tuning, the expected organ graph was selected in 64.0% of cases and ranked among the top three in 86.6%. Providing the correct organ graph increased agreement with coarse TCGA primary-diagnosis labels from 61.8% to 92.6%, identifying organ routing as a main bottleneck under domain shift. Overall, organ-conditioned, graph-constrained chain assembly improves structured reasoning and report generation while enabling stage-specific error localization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 11 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
6 of 11 references.
References · 6
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
- 2019Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generationcited by 102
- 2023WsiCaption: Multiple Instance Generation of Pathology Reports for Gigapixel Whole-Slide Imagescited by 31
- 2025Automated Structured Radiology Report Generationcited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation
- 2024Clinical-grade Multi-Organ Pathology Report Generation for Multi-scale Whole Slide Images via a Semantically Guided Medical Text Foundation Model
- 2024PathAlign: A vision-language model for whole slide images in histopathology
- 2026Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation
- 2025MPath: Multimodal Pathology Report Generation from Whole Slide Images
- 2025PolyPath: Adapting a Large Multimodal Model for Multi-slide Pathology Report Generation
- 2026TaxoMIL: Taxonomy-Constrained Learning for Hierarchical Whole Slide Image Analysis
- 2026MLLM-HWSI: A Multimodal Large Language Model for Hierarchical Whole Slide Image Understanding