Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner
On the map: LLM reasoning → Clinical and biomedical applications
also in 2 more
Abstract (arXiv)
Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both diagnostic accuracy and reasoning plausibility. Such shortcomings are largely attributable to the nature of current pathology datasets, which are primarily composed of image description pairs that lack the depth and structured diagnostic paradigms employed by real world pathologists. In this study, we leverage pathology textbooks and real world pathology experts to construct high-quality, reasoning-oriented datasets. Building on this, we introduce Patho-R1, a multimodal RL-based pathology Reasoner, trained through a three-stage pipeline: (1) continued pretraining on 3.5 million image-text pairs for knowledge infusion; (2) supervised fine-tuning on 500k high-quality Chain-of-Thought samples for reasoning incentivizing; (3) reinforcement learning using Group Relative Policy Optimization and Decoupled Clip and Dynamic sAmpling Policy Optimization strategies for multimodal reasoning quality refinement. To further assess the alignment quality of our dataset, we propose Patho-CLIP, trained on the same figure-caption corpus used for continued pretraining. Comprehensive experimental results demonstrate that both Patho-CLIP and Patho-R1 achieve robust performance across a wide range of pathology-related tasks, including zero-shot classification, cross-modal retrieval, Visual Question Answering, and Multiple Choice Question. Our project is available at the Patho-R1 repository: https://github.com/Wenchuan-Zhang/Patho-R1.
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 28 of its 61 references that are in the map. First posted on arXiv 16 May 2025.
Builds on
28 of 61 references.
Closest ancestors · 2
Same direction, newest first
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb
Other references · 26
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024OpenAI o1 System Cardcited by 1,244
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2023Textbooks Are All You Needcited by 569
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
14 more
- 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 179
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 147
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learningcited by 120
- 2019Lung and Colon Cancer Histopathological Image Dataset (LC25000)cited by 89
- 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learningcited by 83
- 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 82
- 2024MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicinecited by 81
- 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Modelscited by 72
- 2023Adapting Large Language Models to Domains via Reading Comprehensioncited by 50
- 2024UniMed-CLIP: Towards a Unified Image-Text Pretraining Paradigm for Diverse Medical Imaging Modalitiescited by 46
- 2022WSSS4LUAD: Grand Challenge on Weakly-supervised Tissue Semantic Segmentation for Lung Adenocarcinomacited by 36
- 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathologycited by 34
- 2025Triad: Vision Foundation Model for 3D Magnetic Resonance Imagingcited by 24
Built on by
Citing papers per year: 2025: 12; 2026: 28.
40 papers.
Sort:
By area:
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathologycited by 27
- 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoningcited by 19
- 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learningcited by 13
- 2025A Versatile Pathology Co-pilot via Reasoning Enhanced Multimodal Large Language Modelcited by 12
- 2025OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoningcited by 10
- 2025Navigating Gigapixel Pathology Images with Large Multimodal Modelscited by 7
- 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimizationcited by 7
- 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQAcited by 7
- 2025Bridging the Gap in Ophthalmic AI: MM-Retinal-Reason Dataset and OphthaReason Model toward Dynamic Multimodal Reasoningcited by 6
- 2025TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilotscited by 5
- 2025Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype Controlcited by 4
- 2026QCAgent: An agentic framework for quality-controllable pathology report generation from whole slide imagecited by 4
28 more
- 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learningcited by 3
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosiscited by 3
- 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gainscited by 3
- 2026Enhancing Pathological VLMs with Cross-scale Reasoningcited by 3
- 2026PulseMind: A Multi-Modal Medical Model for Real-World Clinical Diagnosiscited by 2
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysiscited by 2
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detectioncited by 2
- 2026Regulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography Analysiscited by 2
- 2026Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoningcited by 2
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
- 2025Anatomy-R1: Enhancing Anatomy Reasoning in Multimodal Large Language Models via Anatomical Similarity Curriculum and Group Diversity Augmentationcited by 1
- 2026Hepato-LLaVA: An Expert MLLM with Sparse Topo-Pack Attention for Hepatocellular Pathology Analysis on Whole Slide Imagescited by 1
- 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoningcited by 1
- 2026Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarkscited by 1
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perceptioncited by 1
- 2026SlideBank: A Persistent Hierarchical Evidence Bank for Consistent Whole-Slide Reasoningcited by 1
- 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathologycited by 0
- 2026Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learningcited by 0
- 2026PathScale-R1: Cross-scale Reasoning for Pathological Image Analysiscited by 0
- 2026Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessmentcited by 0
- 2026Spatial Message Passing in Language Space for Pathology Image Interpretationcited by 0
- 2026PathoArgus: Advancing Evidence-Grounded Long-Context Visual Reasoning across Gigapixel Whole-Slide and Multi-Slide Case Contextscited by 0
- 2026VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathologycited by 0
- 2026Learning from Hard Prompts: Difficulty-aware Advantage Amplification in Dynamic Samplingcited by 0
- 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Modelscited by 0
- 2026See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathologycited by 0
- 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysiscited by 0
- 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoningcited by 0
- 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoning13 Oct 2026
- 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysis12 Oct 2026
- 2026See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathology28 Sep 2026
- 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models26 Sep 2026
- 2026SlideBank: A Persistent Hierarchical Evidence Bank for Consistent Whole-Slide Reasoning31 Aug 2026
- 2026Learning from Hard Prompts: Difficulty-aware Advantage Amplification in Dynamic Sampling28 Aug 2026
- 2026VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathology26 Aug 2026
- 2026PathoArgus: Advancing Evidence-Grounded Long-Context Visual Reasoning across Gigapixel Whole-Slide and Multi-Slide Case Contexts18 Aug 2026
- 2026Spatial Message Passing in Language Space for Pathology Image Interpretation14 Aug 2026
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perception9 Aug 2026
- 2026Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment28 Jul 2026
- 2026PathScale-R1: Cross-scale Reasoning for Pathological Image Analysis26 Jul 2026
28 more
- 2026Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarks14 Jul 2026
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy13 Jul 2026
- 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning8 Jul 2026
- 2026Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning30 Jun 2026
- 2026Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning30 Jun 2026
- 2026Enhancing Pathological VLMs with Cross-scale Reasoning16 Jun 2026
- 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathology10 Jun 2026
- 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA22 May 2026
- 2026Regulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography Analysis19 May 2026
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detection7 Mar 2026
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysis2 Mar 2026
- 2026QCAgent: An agentic framework for quality-controllable pathology report generation from whole slide image2 Mar 2026
- 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gains1 Mar 2026
- 2026Hepato-LLaVA: An Expert MLLM with Sparse Topo-Pack Attention for Hepatocellular Pathology Analysis on Whole Slide Images23 Feb 2026
- 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimization29 Jan 2026
- 2026PulseMind: A Multi-Modal Medical Model for Real-World Clinical Diagnosis12 Jan 2026
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis29 Dec 2025
- 2025Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype Control24 Dec 2025
- 2025Anatomy-R1: Enhancing Anatomy Reasoning in Multimodal Large Language Models via Anatomical Similarity Curriculum and Group Diversity Augmentation22 Dec 2025
- 2025OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoning28 Nov 2025
- 2025Navigating Gigapixel Pathology Images with Large Multimodal Models24 Nov 2025
- 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoning21 Nov 2025
- 2025TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilots20 Nov 2025
- 2025Bridging the Gap in Ophthalmic AI: MM-Retinal-Reason Dataset and OphthaReason Model toward Dynamic Multimodal Reasoning22 Aug 2025
- 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learning4 Aug 2025
- 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learning31 Jul 2025
- 2025A Versatile Pathology Co-pilot via Reasoning Enhanced Multimodal Large Language Model23 Jul 2025
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathology26 Jun 2025
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathologycited by 27
- 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoningcited by 19
- 2025A Versatile Pathology Co-pilot via Reasoning Enhanced Multimodal Large Language Modelcited by 12
- 2025OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoningcited by 10
- 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimizationcited by 7
- 2025Bridging the Gap in Ophthalmic AI: MM-Retinal-Reason Dataset and OphthaReason Model toward Dynamic Multimodal Reasoningcited by 6
- 2025TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilotscited by 5
- 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learningcited by 3
- 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gainscited by 3
- 2026Enhancing Pathological VLMs with Cross-scale Reasoningcited by 3
- 2026Regulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography Analysiscited by 2
- 2026Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoningcited by 2
12 most cited of 20 All 20 (JSON)
- 2026See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathology28 Sep 2026
- 2026Learning from Hard Prompts: Difficulty-aware Advantage Amplification in Dynamic Sampling28 Aug 2026
- 2026PathoArgus: Advancing Evidence-Grounded Long-Context Visual Reasoning across Gigapixel Whole-Slide and Multi-Slide Case Contexts18 Aug 2026
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perception9 Aug 2026
- 2026PathScale-R1: Cross-scale Reasoning for Pathological Image Analysis26 Jul 2026
- 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning8 Jul 2026
- 2026Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning30 Jun 2026
- 2026Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning30 Jun 2026
- 2026Enhancing Pathological VLMs with Cross-scale Reasoning16 Jun 2026
- 2026Regulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography Analysis19 May 2026
- 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gains1 Mar 2026
- 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimization29 Jan 2026
12 newest of 20 All 20 (JSON)
- 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learningcited by 13
- 2025Navigating Gigapixel Pathology Images with Large Multimodal Modelscited by 7
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosiscited by 3
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
- 2026Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarkscited by 1
- 2026Spatial Message Passing in Language Space for Pathology Image Interpretationcited by 0
- 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Modelscited by 0
- 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models26 Sep 2026
- 2026Spatial Message Passing in Language Space for Pathology Image Interpretation14 Aug 2026
- 2026Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarks14 Jul 2026
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy13 Jul 2026
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis29 Dec 2025
- 2025Navigating Gigapixel Pathology Images with Large Multimodal Models24 Nov 2025
- 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learning4 Aug 2025
- 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQAcited by 7
- 2025Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype Controlcited by 4
- 2026PulseMind: A Multi-Modal Medical Model for Real-World Clinical Diagnosiscited by 2
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysiscited by 2
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detectioncited by 2
- 2026Hepato-LLaVA: An Expert MLLM with Sparse Topo-Pack Attention for Hepatocellular Pathology Analysis on Whole Slide Imagescited by 1
- 2026SlideBank: A Persistent Hierarchical Evidence Bank for Consistent Whole-Slide Reasoningcited by 1
- 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathologycited by 0
- 2026Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessmentcited by 0
- 2026VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathologycited by 0
- 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysiscited by 0
- 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoningcited by 0
- 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoning13 Oct 2026
- 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysis12 Oct 2026
- 2026SlideBank: A Persistent Hierarchical Evidence Bank for Consistent Whole-Slide Reasoning31 Aug 2026
- 2026VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathology26 Aug 2026
- 2026Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment28 Jul 2026
- 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathology10 Jun 2026
- 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA22 May 2026
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detection7 Mar 2026
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysis2 Mar 2026
- 2026Hepato-LLaVA: An Expert MLLM with Sparse Topo-Pack Attention for Hepatocellular Pathology Analysis on Whole Slide Images23 Feb 2026
- 2026PulseMind: A Multi-Modal Medical Model for Real-World Clinical Diagnosis12 Jan 2026
- 2025Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype Control24 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025PathVLM-R1: A Reinforcement Learning-Driven Reasoning Model for Pathology Visual-Language Tasks
- 2026ReinPath: A Multimodal Reinforcement Learning Approach for Pathology
- 2025Discovering Pathology Rationale and Token Allocation for Efficient Multimodal Pathology Reasoning
- 2025PathoHR: Hierarchical Reasoning for Vision-Language Models in Pathology
- 2025PathMR: Multimodal Visual Reasoning for Interpretable Pathology Diagnosis
- 2025DiagR1: A Vision-Language Model Trained via Reinforcement Learning for Digestive Pathology Diagnosis
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathology
- 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathology