mlsanityData to 14 Oct 2026

Fleming-R1: Toward Expert-Level Medical Reasoning via Reinforcement Learning

arXiv 2509.15279 ↗First posted 18 Sep 2025cs.LG cs.CLcited by 10

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

While large language models show promise in medical applications, achieving expert-level clinical reasoning remains challenging due to the need for both accurate answers and transparent reasoning processes. To address this challenge, we introduce Fleming-R1, a model designed for verifiable medical reasoning through three complementary innovations. First, our Reasoning-Oriented Data Strategy (RODS) combines curated medical QA datasets with knowledge-graph-guided synthesis to improve coverage of underrepresented diseases, drugs, and multi-hop reasoning chains. Second, we employ Chain-of-Thought (CoT) cold start to distill high-quality reasoning trajectories from teacher models, establishing robust inference priors. Third, we implement a two-stage Reinforcement Learning from Verifiable Rewards (RLVR) framework using Group Relative Policy Optimization, which consolidates core reasoning skills while targeting persistent failure modes through adaptive hard-sample mining. Across diverse medical benchmarks, Fleming-R1 delivers substantial parameter-efficient improvements: the 7B variant surpasses much larger baselines, while the 32B model achieves near-parity with GPT-4o and consistently outperforms strong open-source alternatives. These results demonstrate that structured data design, reasoning-oriented initialization, and verifiable reinforcement learning can advance clinical reasoning beyond simple accuracy optimization. We release Fleming-R1 publicly to promote transparent, reproducible, and auditable progress in medical AI, enabling safer deployment in high-stakes clinical environments.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 31 of its 42 references that are in the map. First posted on arXiv 18 Sep 2025.

Builds on

31 of 42 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Baichuan-M2: Scaling Medical Capability with Large Verifier System2 Sep
  2. 2025Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL23 May
  3. 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar
  4. 2025Med-RLVR: Emerging Medical Reasoning from a 3B base model via reinforcement Learning27 Feb
  5. 2025Citrus: Leveraging Expert Cognitive Pathways in a Medical Language Model for Advanced Medical Decision Support25 Feb
  6. 2024MedCoT: Medical Chain of Thought via Hierarchical Expert18 Dec

Other references · 25

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2025Qwen3 Technical Reportcited by 8,820
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  7. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  9. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  10. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  11. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  12. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
13 more
  1. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  2. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
  3. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
  4. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
  5. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
  6. 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 91
  7. 2024CultureLLM: Incorporating Cultural Differences into Large Language Modelscited by 50
  8. 2020Does Explainable Artificial Intelligence Improve Human Decision-Making?cited by 49
  9. 2025A Comprehensive Survey on the Trustworthiness of Large Language Models in Healthcarecited by 27
  10. 2021MedGPT: Medical Concept Prediction from Clinical Narrativescited by 24
  11. 2025Automatic Evaluation of Healthcare LLMs Beyond Question-Answeringcited by 20
  12. 2023Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Reliable Response Generation in Chinesecited by 18
  13. 2024Explainable Artificial Intelligence for Medical Applications: A Reviewcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 8.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Eliciting Medical Reasoning with Knowledge-enhanced Data Synthesis: A Semi-Supervised Reinforcement Learning Approach
  2. 2025GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoning
  3. 2025Gazal-R1: Achieving State-of-the-Art Medical Reasoning with Parameter-Efficient Two-Stage Training
  4. 2026Scaling Medical Reasoning Verification via Tool-Integrated Reinforcement Learning
  5. 2025Adaptive Reinforcement for Open-ended Medical Reasoning via Semantic-Guided Reward Collapse Mitigation
  6. 2025RPRO: Ranked Preference Reinforcement Optimization for Enhancing Medical QA and Diagnostic Reasoning
  7. 2025Med-U1: Incentivizing Unified Medical Reasoning in LLMs via Large-scale Reinforcement Learning
  8. 2026MAPLE: Elevating Medical Reasoning from Statistical Consensus to Process-Led Alignment