DiagR1: A Vision-Language Model Trained via Reinforcement Learning for Digestive Pathology Diagnosis
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
Abstract (arXiv)
Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise and incomplete annotations in public datasets predispose vision language models to factual hallucinations when generating diagnostic text, while the absence of explicit intermediate reasoning chains renders the outputs difficult to audit and thus less trustworthy in clinical practice. To address these issues, we construct a large scale gastrointestinal pathology dataset containing both microscopic descriptions and diagnostic conclusions, and propose a prompt argumentation strategy that incorporates lesion classification and anatomical site information. This design guides the model to better capture image specific features and maintain semantic consistency in generation. Furthermore, we employ a post training pipeline that combines supervised fine tuning with Group Relative Policy Optimization (GRPO) to improve reasoning quality and output structure. Experimental results on real world pathology report generation tasks demonstrate that our approach significantly outperforms state of the art open source and proprietary baselines in terms of generation quality, structural completeness, and clinical relevance. Our solution outperforms state of the art models with 18.7% higher clinical relevance, 32.4% improved structural completeness, and 41.2% fewer diagnostic errors, demonstrating superior accuracy and clinical utility compared to existing solutions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 20 of its 49 references that are in the map. First posted on arXiv 24 Jul 2025.
Builds on
20 of 49 references.
Closest ancestors · 2
Same direction, newest first
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar
- 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathology24 May
Other references · 18
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Visual Instruction Tuningcited by 7,869
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 147
6 more
- 2023Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videoscited by 86
- 2024A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Modelcited by 59
- 2024HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interactioncited by 43
- 2024Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillationcited by 31
- 2023Dual Attention Model with Reinforcement Learning for Classification of Histology Whole-Slide Imagescited by 5
- 2024HistoGym: A Reinforcement Learning Environment for Histopathological Image Analysiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025DL3M: A Vision-to-Language Framework for Expert-Level Medical Reasoning through Deep Learning and Large Language Models
- 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner
- 2025Investigating Zero-Shot Diagnostic Pathology in Vision-Language Models with Efficient Prompt Design
- 2025PathVLM-R1: A Reinforcement Learning-Driven Reasoning Model for Pathology Visual-Language Tasks
- 2026Analogical Reasoning as a Doctor: A Foundation Model for Gastrointestinal Endoscopy Diagnosis
- 2026See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathology
- 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimization
- 2025Discovering Pathology Rationale and Token Allocation for Efficient Multimodal Pathology Reasoning