Medical Reasoning with Large Language Models: A Survey and MR-Bench
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical, context-dependent, and conducted under evolving evidence. In such situations, reliable LLM performance depends not on factual recall alone, but on robust medical reasoning. In this work, we present a comprehensive review of medical reasoning with LLMs. Grounded in cognitive theories of clinical reasoning, we conceptualize medical reasoning as an iterative process of abduction, deduction, and induction, and organize existing methods into seven major technical routes spanning training-based and training-free approaches. We further conduct a unified cross-benchmark evaluation of representative medical reasoning models under a consistent experimental setting, enabling a more systematic and comparable assessment of the empirical impact of existing methods. To better assess clinically grounded reasoning, we introduce MR-Bench, a benchmark derived from real-world hospital data. Evaluations on MR-Bench expose a pronounced gap between exam-level performance and accuracy on authentic clinical decision tasks. Overall, this survey provides a unified view of existing medical reasoning methods, benchmarks, and evaluation practices, and highlights key gaps between current model performance and the requirements of real-world clinical reasoning.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 44 of its 135 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
44 of 135 references.
Closest ancestors · 15
Same direction, newest first
- 2025EHR-R1: A Reasoning-Enhanced Foundational Language Model for Electronic Health Record Analysis29 Oct
- 2025AdaThink-Med: Optimizing Inference-Time Compute for Medical Reasoning via Uncertainty Quantification29 Sep
- 2025Baichuan-M2: Scaling Medical Capability with Large Verifier System2 Sep
- 2025End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoning21 Aug
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
- 2025MedAgentGym: A Scalable Agentic Training Environment for Code-Centric Reasoning in Biomedical Data Science4 Jun
- 2025Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL23 May
- 2025Disentangling Reasoning and Knowledge in Medical Large Language Models16 May
- 2025ClinicalGPT-R1: Pushing reasoning capability of generalist disease diagnosis with large language model13 Apr
- 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs1 Apr
- 2025m1: Unleash the Potential of Test-Time Scaling for Medical Reasoning with Large Language Models1 Apr
- 2025Citrus: Leveraging Expert Cognitive Pathways in a Medical Language Model for Advanced Medical Decision Support25 Feb
3 more
Other references · 29
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2025Gemma 3 Technical Reportcited by 1,686
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
- 2025Humanity's Last Examcited by 467
- 2025MedGemma Technical Reportcited by 398
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
17 more
- 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
- 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 256
- 2024Capabilities of Gemini Models in Medicinecited by 231
- 2024Med42-v2: A Suite of Clinical LLMscited by 89
- 2025No Free Labels: Limitations of LLM-as-a-Judge Without Human Groundingcited by 50
- 2025Reinforced Latent Reasoning for LLM-based Recommendationcited by 46
- 2025Baichuan-M1: Pushing the Medical Capability of Large Language Modelscited by 41
- 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generationcited by 29
- 2025MedResearcher-R1: Expert-Level Medical Deep Researcher via A Knowledge-Informed Trajectory Synthesis Frameworkcited by 22
- 2024Assessing and Enhancing Large Language Models in Rare Disease Question-answeringcited by 16
- 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Informationcited by 16
- 2025The Anatomy of a Personal Health Agentcited by 15
- 2025SteerX: Disentangled Steering for LLM Personalizationcited by 7
- 2025Fine-grained List-wise Alignment for Generative Medication Recommendationcited by 5
- 2025QuarkMed Medical Foundation Model Technical Reportcited by 5
- 2025CARL: Criticality-Aware Agentic Reinforcement Learningcited by 5
- 2025Fine-grained Alignment of Large Language Models for General Medication Recommendation without Overprescriptioncited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MDIA: A Multi-Agent Diagnostic Intelligence Pipeline on HealthBench Professionalcited by 0
- 2026Generalistic or Specific Embeddings, Which is Better? An Empirical Study on Search for Clinical Coding in Non-English Languagescited by 0
- 2026Beyond Endpoint Gains: A Weight-Delta Audit of Medical Specializationcited by 0
- 2026TRACE: Deployable Tree-Relational Structure Enhancement for Oncology LLMscited by 0
- 2026TRACE: Deployable Tree-Relational Structure Enhancement for Oncology LLMs20 Sep 2026
- 2026Beyond Endpoint Gains: A Weight-Delta Audit of Medical Specialization21 Aug 2026
- 2026Generalistic or Specific Embeddings, Which is Better? An Empirical Study on Search for Clinical Coding in Non-English Languages28 May 2026
- 2026MDIA: A Multi-Agent Diagnostic Intelligence Pipeline on HealthBench Professional23 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning
- 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Models
- 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
- 2024Critique of Impure Reason: Unveiling the reasoning behaviour of medical Large Language Models
- 2025Quantifying the Reasoning Abilities of LLMs on Real-world Clinical Cases
- 2025Limitations of Large Language Models in Clinical Problem-Solving Arising from Inflexible Reasoning
- 2026A rubric landscape for evaluating clinical reasoning in large language models: what exists, what is missing, and what needs to be combined
- 2025MedOmni-45deg: A Safety-Performance Benchmark for Reasoning-Oriented LLMs in Medicine