Med-R3: Enhancing Medical Retrieval-Augmented Reasoning of LLMs via Progressive Reinforcement Learning
On the map: LLM reasoning → Clinical and biomedical applications
also in 1 more
Abstract (arXiv)
In medical scenarios, effectively retrieving external knowledge and leveraging it for rigorous logical reasoning is of significant importance. Despite their potential, existing work has predominantly focused on enhancing either retrieval or reasoning capabilities of the models in isolation, with little attention given to their joint optimization, which leads to limited coordination between the two processes. Additionally, current methods rely heavily on supervised fine-tuning (SFT), which can cause models to memorize existing problem-solving pathways, thereby restricting their generalization ability when confronted with novel problem contexts. Furthermore, while some studies have explored to improve retrieval-augmented reasoning in general domains via reinforcement learning, their reward function designs do not adequately capture the specific demands of the medical domain. To address these challenges, we introduce **Med-R3**, a **Med**ical **R**etrieval-augmented **R**easoning framework driven by progressive **R**einforcement learning. In this framework, we first develop the model's ability to perform logical reasoning over medical problems. Subsequently, on the basis of this foundation, we adaptively optimize the retrieval capability to better align with the characteristics of knowledge corpus and external information utilization throughout the reasoning process. Finally, we conduct joint optimization of the model's retrieval and reasoning coordination. Extensive experiments indicate that **Med-R3** could achieve state-of-the-art performances, with Qwen3-8B + Med-R3 surpassing closed-sourced GPT-4o-mini by 12.22% at a comparable parameter scale, while Qwen2.5-14B augmented with ours shows a more substantial gain of 16.31%.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 26 of its 67 references that are in the map. First posted on arXiv 31 Jul 2025.
Builds on
26 of 67 references.
Closest ancestors · 5
Same direction, newest first
- 2025Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL23 May
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar
- 2025MedS3: Towards Medical Slow Thinking with Self-Evolved Soft Dual-sided Process Supervision21 Jan
- 2025Med-R2: Crafting Trustworthy LLM Physicians via Retrieval and Reasoning of Evidence-Based Medicine21 Jan
- 2024JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capability27 Feb
Other references · 21
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
- 2024OpenAI o1 System Cardcited by 1,244
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2024DeepSeek-V3 Technical Reportcited by 811
9 more
- 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
- 2023Making Retrieval-Augmented Language Models Robust to Irrelevant Contextcited by 369
- 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
- 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 274
- 2025ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learningcited by 161
- 2024Teaching Large Language Models to Reason with Reinforcement Learningcited by 160
- 2024Reliable, Adaptable, and Attributable Language Models with Retrievalcited by 73
- 2024SPLADE-v3: New baselines for SPLADEcited by 72
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Adaptive Reinforcement for Open-ended Medical Reasoning via Semantic-Guided Reward Collapse Mitigation
- 2025Improving Medical Reasoning with Curriculum-Aware Reinforcement Learning
- 2025Med-U1: Incentivizing Unified Medical Reasoning in LLMs via Large-scale Reinforcement Learning
- 2026Eliciting Medical Reasoning with Knowledge-enhanced Data Synthesis: A Semi-Supervised Reinforcement Learning Approach
- 2025Proactive Reasoning-with-Retrieval Framework for Medical Multimodal Large Language Models
- 2025GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoning
- 2025Med-RLVR: Emerging Medical Reasoning from a 3B base model via reinforcement Learning
- 2026Scaling Medical Reasoning Verification via Tool-Integrated Reinforcement Learning