mlsanityData to 14 Oct 2026

Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner

arXiv 2505.11404 ↗First posted 16 May 2025cs.CV cs.AIcited by 40

On the map: LLM reasoning → Clinical and biomedical applications

also in 2 more
Abstract (arXiv)

Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both diagnostic accuracy and reasoning plausibility. Such shortcomings are largely attributable to the nature of current pathology datasets, which are primarily composed of image description pairs that lack the depth and structured diagnostic paradigms employed by real world pathologists. In this study, we leverage pathology textbooks and real world pathology experts to construct high-quality, reasoning-oriented datasets. Building on this, we introduce Patho-R1, a multimodal RL-based pathology Reasoner, trained through a three-stage pipeline: (1) continued pretraining on 3.5 million image-text pairs for knowledge infusion; (2) supervised fine-tuning on 500k high-quality Chain-of-Thought samples for reasoning incentivizing; (3) reinforcement learning using Group Relative Policy Optimization and Decoupled Clip and Dynamic sAmpling Policy Optimization strategies for multimodal reasoning quality refinement. To further assess the alignment quality of our dataset, we propose Patho-CLIP, trained on the same figure-caption corpus used for continued pretraining. Comprehensive experimental results demonstrate that both Patho-CLIP and Patho-R1 achieve robust performance across a wide range of pathology-related tasks, including zero-shot classification, cross-modal retrieval, Visual Question Answering, and Multiple Choice Question. Our project is available at the Patho-R1 repository: https://github.com/Wenchuan-Zhang/Patho-R1.

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 28 of its 61 references that are in the map. First posted on arXiv 16 May 2025.

Builds on

28 of 61 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar
  2. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb

Other references · 26

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  2. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  3. 2024OpenAI o1 System Cardcited by 1,244
  4. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  5. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
  6. 2023Textbooks Are All You Needcited by 569
  7. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  8. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  9. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
  10. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
  11. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
  12. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
14 more
  1. 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 179
  2. 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
  3. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 147
  4. 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learningcited by 120
  5. 2019Lung and Colon Cancer Histopathological Image Dataset (LC25000)cited by 89
  6. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learningcited by 83
  7. 2024DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perceptioncited by 82
  8. 2024MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicinecited by 81
  9. 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Modelscited by 72
  10. 2023Adapting Large Language Models to Domains via Reading Comprehensioncited by 50
  11. 2024UniMed-CLIP: Towards a Unified Image-Text Pretraining Paradigm for Diverse Medical Imaging Modalitiescited by 46
  12. 2022WSSS4LUAD: Grand Challenge on Weakly-supervised Tissue Semantic Segmentation for Lung Adenocarcinomacited by 36
  13. 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathologycited by 34
  14. 2025Triad: Vision Foundation Model for 3D Magnetic Resonance Imagingcited by 24

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 12; 2026: 28.

40 papers.

Sort:

By area:

  1. 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathologycited by 27
  2. 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoningcited by 19
  3. 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learningcited by 13
  4. 2025A Versatile Pathology Co-pilot via Reasoning Enhanced Multimodal Large Language Modelcited by 12
  5. 2025OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoningcited by 10
  6. 2025Navigating Gigapixel Pathology Images with Large Multimodal Modelscited by 7
  7. 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimizationcited by 7
  8. 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQAcited by 7
  9. 2025Bridging the Gap in Ophthalmic AI: MM-Retinal-Reason Dataset and OphthaReason Model toward Dynamic Multimodal Reasoningcited by 6
  10. 2025TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilotscited by 5
  11. 2025Beyond Pixel Simulation: Pathology Image Generation via Diagnostic Semantic Tokens and Prototype Controlcited by 4
  12. 2026QCAgent: An agentic framework for quality-controllable pathology report generation from whole slide imagecited by 4
28 more
  1. 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learningcited by 3
  2. 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosiscited by 3
  3. 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gainscited by 3
  4. 2026Enhancing Pathological VLMs with Cross-scale Reasoningcited by 3
  5. 2026PulseMind: A Multi-Modal Medical Model for Real-World Clinical Diagnosiscited by 2
  6. 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysiscited by 2
  7. 2026NuNext: Reframing Nucleus Detection as Next-Point Detectioncited by 2
  8. 2026Regulating Anatomy-Aware Rewards via Trajectory-Integral Feedback for Volumetric Computed Tomography Analysiscited by 2
  9. 2026Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoningcited by 2
  10. 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
  11. 2025Anatomy-R1: Enhancing Anatomy Reasoning in Multimodal Large Language Models via Anatomical Similarity Curriculum and Group Diversity Augmentationcited by 1
  12. 2026Hepato-LLaVA: An Expert MLLM with Sparse Topo-Pack Attention for Hepatocellular Pathology Analysis on Whole Slide Imagescited by 1
  13. 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoningcited by 1
  14. 2026Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarkscited by 1
  15. 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perceptioncited by 1
  16. 2026SlideBank: A Persistent Hierarchical Evidence Bank for Consistent Whole-Slide Reasoningcited by 1
  17. 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathologycited by 0
  18. 2026Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learningcited by 0
  19. 2026PathScale-R1: Cross-scale Reasoning for Pathological Image Analysiscited by 0
  20. 2026Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessmentcited by 0
  21. 2026Spatial Message Passing in Language Space for Pathology Image Interpretationcited by 0
  22. 2026PathoArgus: Advancing Evidence-Grounded Long-Context Visual Reasoning across Gigapixel Whole-Slide and Multi-Slide Case Contextscited by 0
  23. 2026VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathologycited by 0
  24. 2026Learning from Hard Prompts: Difficulty-aware Advantage Amplification in Dynamic Samplingcited by 0
  25. 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Modelscited by 0
  26. 2026See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathologycited by 0
  27. 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysiscited by 0
  28. 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025PathVLM-R1: A Reinforcement Learning-Driven Reasoning Model for Pathology Visual-Language Tasks
  2. 2026ReinPath: A Multimodal Reinforcement Learning Approach for Pathology
  3. 2025Discovering Pathology Rationale and Token Allocation for Efficient Multimodal Pathology Reasoning
  4. 2025PathoHR: Hierarchical Reasoning for Vision-Language Models in Pathology
  5. 2025PathMR: Multimodal Visual Reasoning for Interpretable Pathology Diagnosis
  6. 2025DiagR1: A Vision-Language Model Trained via Reinforcement Learning for Digestive Pathology Diagnosis
  7. 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathology
  8. 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathology