mlsanityData to 7 Oct 2026

Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models

arXiv 2503.13939 ↗First posted 18 Mar 2025cs.CVcited by 144

On the map: LLM reasoning → Clinical and biomedical applications

also in 1 more
Abstract (arXiv)

Vision-language models (VLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored. Medical vision-language tasks demand precise understanding and clinically coherent answers, which are difficult to achieve due to the complexity of medical data and the scarcity of high-quality expert annotations. These challenges limit the effectiveness of conventional supervised fine-tuning (SFT) and Chain-of-Thought (CoT) strategies that work well in general domains. To address these challenges, we propose Med-R1, a reinforcement learning (RL)-enhanced vision-language model designed to improve generalization and reliability in medical reasoning. Built on the DeepSeek strategy, Med-R1 adopts Group Relative Policy Optimization (GRPO) to encourage reward-guided learning beyond static annotations. We comprehensively evaluate Med-R1 across eight distinct medical imaging modalities. Med-R1 achieves a 29.94% improvement in average accuracy over its base model Qwen2-VL-2B, and even outperforms Qwen2-VL-72B-a model with 36x more parameters. To assess cross-task generalization, we further evaluate Med-R1 on five question types. Med-R1 outperforms Qwen2-VL-2B by 32.06% in question-type generalization, also surpassing Qwen2-VL-72B. We further explore the thinking process in Med-R1, a crucial component for the success of Deepseek-R1. Our results show that omitting intermediate rationales (No-Thinking-Med-R1) not only improves in-domain and cross-domain generalization with less training, but also challenges the assumption that more reasoning always helps. These findings suggest that in medical VQA, it is not reasoning itself, but its quality and domain alignment, that determine effectiveness. Together, these results highlight that RL improves medical reasoning and generalization, enabling efficient and reliable VLMs for real-world deployment.

Key facts. Cited by 144 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 33 of its 46 references that are in the map. First posted on arXiv 18 Mar 2025.

Builds on

33 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2017Proximal Policy Optimization Algorithmscited by 14,441
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  8. 2023Visual Instruction Tuningcited by 7,792
  9. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  10. 2025Qwen2.5-VL Technical Reportcited by 5,418
  11. 2024GPT-4o System Cardcited by 4,467
  12. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
20 more
  1. 2017Deep reinforcement learning from human preferencescited by 3,846
  2. 2023Qwen Technical Reportcited by 3,273
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  4. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  5. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  6. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  7. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  8. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  9. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  10. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  11. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
  12. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  13. 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
  14. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
  15. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
  16. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 194
  17. 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 182
  18. 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptationcited by 112
  19. 2024AbdomenAtlas: A Large-Scale, Detailed-Annotated, & Multi-Center Dataset for Efficient Transfer Learning and Open Algorithmic Benchmarkingcited by 64
  20. 2025Towards Universal Text-driven CT Image Segmentationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 86; 2026: 58.

144 papers.

Sort:

By area:

  1. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  2. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 217
  3. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
  4. 2025The Invisible Leash: Why RLVR May or May Not Escape Its Origincited by 92
  5. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 89
  6. 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentationcited by 86
  7. 2025JudgeLRM: Large Reasoning Models as a Judgecited by 76
  8. 2025Training a Scientific Reasoning Model for Chemistrycited by 54
  9. 2025SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Rewardcited by 45
  10. 2025Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuningcited by 44
  11. 2025An Empirical Study on Reinforcement Learning for Reasoning-Search Interleaved LLM Agentscited by 43
  12. 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasonercited by 38
38 more
  1. 2025QoQ-Med: Building Multimodal Clinical Foundation Models with Domain-Aware GRPO Trainingcited by 38
  2. 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learningcited by 38
  3. 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzlescited by 36
  4. 2025On the Effect of Negative Gradient in Group Relative Deep Reinforcement Optimizationcited by 31
  5. 2025ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step Verificationcited by 30
  6. 2025X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domainscited by 30
  7. 2025Real-World Doctor Agent with Proactive Consultation through Multi-Agent Reinforcement Learningcited by 26
  8. 2025MedVLThinker: Simple Baselines for Multimodal Medical Reasoningcited by 26
  9. 2025MedAgentGym: A Scalable Agentic Training Environment for Code-Centric Reasoning in Biomedical Data Sciencecited by 22
  10. 2025SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sportscited by 17
  11. 2025Improving Medical Reasoning with Curriculum-Aware Reinforcement Learningcited by 16
  12. 2025Chiron-o1: Igniting Multimodal Large Language Models towards Generalizable Medical Reasoning via Mentor-Intern Collaborative Searchcited by 16
  13. 2025Training LLMs for EHR-Based Reasoning Tasks via Reinforcement Learningcited by 14
  14. 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Modelscited by 13
  15. 2025LLaDA-MedV: Exploring Large Language Diffusion Models for Biomedical Image Understandingcited by 12
  16. 2025Think Twice to See More: Iterative Visual Reasoning in Medical VLMscited by 12
  17. 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Imagescited by 12
  18. 2025DrVD-Bench: Do Vision-Language Models Reason Like Human Doctors in Medical Image Diagnosis?cited by 10
  19. 2025MedReasoner: Reinforcement Learning Drives Reasoning Grounding from Clinical Thought to Pixel-Level Precisioncited by 10
  20. 2025OralGPT-Omni: A Versatile Dental Multimodal Large Language Modelcited by 10
  21. 2025RARL: Improving Medical VLM Reasoning and Generalization with Reinforcement Learning and LoRA under Data and Hardware Constraintscited by 9
  22. 2025Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Reviewcited by 9
  23. 2025AVATAR: Reinforcement Learning to See, Hear, and Reason Over Videocited by 9
  24. 2025Fleming-R1: Toward Expert-Level Medical Reasoning via Reinforcement Learningcited by 9
  25. 2025Token Hidden Reward: Steering Exploration-Exploitation in Group Relative Deep Reinforcement Learningcited by 9
  26. 2026PhyCritic: Multimodal Critic Models for Physical AIcited by 9
  27. 2025PathVLM-R1: A Reinforcement Learning-Driven Reasoning Model for Pathology Visual-Language Taskscited by 8
  28. 2025GEMeX-RMCoT: An Enhanced Med-VQA Dataset for Region-Aware Multimodal Chain-of-Thought Reasoningcited by 8
  29. 2025MedGR2: Breaking the Data Barrier for Medical Reasoning via Generative Reward Learningcited by 8
  30. 2025Ophiuchus: Incentivizing Tool-augmented "Think with Images" for Joint Medical Segmentation, Understanding and Reasoningcited by 8
  31. 2025Open-Medical-R1: How to Choose Data for RLVR Training at Medicine Domaincited by 7
  32. 2025Reinforcement Learning for Out-of-Distribution Reasoning in LLMs: An Empirical Study on Diagnosis-Related Group Codingcited by 7
  33. 2025MedTVT-R1: A Multimodal LLM Empowering Medical Reasoning and Diagnosiscited by 7
  34. 2025SpeakRL: Synergizing Reasoning, Speaking, and Acting in Language Models with Reinforcement Learningcited by 7
  35. 2025Elicit and Enhance: Advancing Multimodal Reasoning in Medical Scenarioscited by 6
  36. 2025Bridging the Gap in Ophthalmic AI: MM-Retinal-Reason Dataset and OphthaReason Model toward Dynamic Multimodal Reasoningcited by 6
  37. 2025Video-R4: Reinforcing Text-Rich Video Reasoning with Visual Ruminationcited by 6
  38. 2026MDAgent2: Large Language Model for Code Generation and Knowledge Q&A in Molecular Dynamicscited by 6

50 most cited of 144 All 144 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Toward Effective Reinforcement Learning Fine-Tuning for Medical VQA in Vision-Language Models
  2. 2026MediX-R1: Open Ended Medical Reinforcement Learning
  3. 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gains
  4. 2025MedGround-R1: Advancing Medical Image Grounding via Spatial-Semantic Rewarded Group Relative Policy Optimization
  5. 2025GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoning
  6. 2025RL4Med-DDPO: Reinforcement Learning for Controlled Guidance Towards Diverse Medical Image Generation using Vision-Language Foundation Models
  7. 2025CAPO: Reinforcing Consistent Reasoning in Medical Decision-Making
  8. 2025MedFact-R1: Towards Factual Medical Reasoning via Pseudo-Label Augmentation