mlsanityData to 7 Oct 2026

ReasonMed: A 370K Multi-Agent Generated Dataset for Advancing Medical Reasoning

arXiv 2506.09513 ↗First posted 11 Jun 2025cs.CL cs.AI cs.MAcited by 26

On the map: LLM reasoning → Clinical and biomedical applications

also in 1 more
Abstract (arXiv)

Reasoning-based large language models have excelled in mathematics and programming, yet their potential in knowledge-intensive medical question answering remains underexplored and insufficiently validated in clinical contexts. To bridge this gap, we introduce ReasonMed, the largest medical reasoning dataset to date, comprising 370k high-quality examples distilled from 1.75 million initial reasoning paths generated by complementary LLMs and curated through a cost-efficient easy-medium-difficult (EMD) pipeline. ReasonMed is built through a multi-agent generation, verification, and refinement process, in which an Error Refiner improves reasoning paths by correcting error-prone steps identified by a verifier. Using ReasonMed, we investigate effective strategies for training medical reasoning models and find that integrating detailed CoT reasoning with concise answer summaries yields the most robust fine-tuning results. Models trained on ReasonMed set a new benchmark: ReasonMed-7B surpasses the prior best sub-10B models by 4.17% and even exceeds LLaMA3.1-70B on PubMedQA by 4.60%. When scaled to ReasonMed-14B, it remains highly competitive, underscoring consistent scaling potential. The codes and datasets are available at https://github.com/YuSun-Work/ReasonMed.

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 19 of its 36 references that are in the map. First posted on arXiv 11 Jun 2025.

Builds on

19 of 36 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
  2. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs25 Dec
  3. 2024Adaptive Reasoning and Acting in Medical Language Agents13 Oct
  4. 2022Can large language models reason about medical questions?17 Jul

Other references · 15

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  4. 2024A Survey on LLM-as-a-Judgecited by 1,384
  5. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  6. 2025s1: Simple test-time scalingcited by 1,311
  7. 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
  8. 2024O1 Replication Journey: A Strategic Progress Report -- Part 1cited by 140
  9. 2025Competitive Programming with Large Reasoning Modelscited by 115
  10. 2025Logical Reasoning in Large Language Models: A Surveycited by 52
  11. 2023AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisationcited by 31
  12. 2025BOLT: Bootstrap Long Chain-of-Thought in Language Models without Distillationcited by 23
3 more
  1. 2024Towards Leveraging Large Language Models for Automated Medical Q&A Evaluationcited by 14
  2. 2025Can Large Language Models Be Query Optimizer for Relational Databases?cited by 10
  3. 2025DialogueAgents: A Hybrid Agent-Based Speech Synthesis Framework for Multi-Party Dialoguecited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 14; 2026: 12.

26 papers.

Sort:

By area:

  1. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 175
  2. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 34
  3. 2025LegalDelta: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gaincited by 11
  4. 2025InfiMed-ORBIT: Aligning LLMs on Open-Ended Complex Tasks via Rubric-Based Incremental Trainingcited by 11
  5. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applicationscited by 10
  6. 2025S-Chain: Structured Visual Chain-of-Thought For Medicinecited by 10
  7. 2025OralGPT-Omni: A Versatile Dental Multimodal Large Language Modelcited by 10
  8. 2025OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoningcited by 10
  9. 2025ToolLibGen: Scalable Automatic Tool Creation and Aggregation for LLM Reasoningcited by 5
  10. 2026Optimsyn: Influence-Guided Rubrics Optimization for Synthetic Data Generationcited by 4
  11. 2026TumorChain: Interleaved Multimodal Chain-of-Thought Reasoning for Traceable Clinical Tumor Analysiscited by 3
  12. 2025Towards Efficient Medical Reasoning with Minimal Fine-Tuning Datacited by 2
14 more
  1. 2025Explore-Execute Chain: Towards an Efficient Structured Reasoning Paradigmcited by 2
  2. 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
  3. 2025Knowledge-Augmented Long-CoT Generation for Complex Biomolecular Reasoningcited by 2
  4. 2025Towards Trustworthy Dermatology MLLMs: A Benchmark and Multimodal Evaluator for Diagnostic Narrativescited by 2
  5. 2026Step-CoT: Stepwise Visual Chain-of-Thought for Medical Visual Question Answeringcited by 2
  6. 2026Can LLM Agents Generate Real-World Evidence? Evaluating Observational Studies in Medical Databasescited by 2
  7. 2026EHRBench: An Automated and Reliable EHR-based Benchmark for Clinical Decision Making with LLMscited by 2
  8. 2026Towards Next-Generation Healthcare: A Survey of Medical Embodied AI for Perception, Decision-Making, and Actioncited by 2
  9. 2026A Causal Language Modeling Detour Improves Encoder Continued Pretrainingcited by 1
  10. 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoningcited by 1
  11. 2026HiMed: Incentivizing Hindi Reasoning in Medical LLMscited by 0
  12. 2026eCREAM-MedCorpus A Large-Scale Corpus of Clinical Notes for Italiancited by 0
  13. 2026CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Modelscited by 0
  14. 2026InfiMed2: A Generalist Medical Multimodal Foundation Model from Contextual Evidence and Stability-Aware Supervisioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025MedicalAgentsBench for Complex Medical Reasoning: Comparing Internalized Reasoning Models versus Externalized Agent-based Frameworks
  2. 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs
  3. 2024LLM-MedQA: Enhancing Medical Question Answering through Case Studies in Large Language Models
  4. 2025Building a Human-Verified Clinical Reasoning Dataset via a Human LLM Hybrid Pipeline for Trustworthy Medical AI
  5. 2026A Multi-Agent Framework for Medical AI: Leveraging Fine-Tuned GPT, LLaMA, and DeepSeek R1 for Evidence-Based and Bias-Aware Clinical Query Processing
  6. 2025Disentangling Reasoning and Knowledge in Medical Large Language Models
  7. 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Models
  8. 2024Critique of Impure Reason: Unveiling the reasoning behaviour of medical Large Language Models