mlsanityData to 7 Oct 2026

Medical Reasoning with Large Language Models: A Survey and MR-Bench

arXiv 2604.08559 ↗First posted 17 Mar 2026cs.CL cs.AIcited by 4

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical, context-dependent, and conducted under evolving evidence. In such situations, reliable LLM performance depends not on factual recall alone, but on robust medical reasoning. In this work, we present a comprehensive review of medical reasoning with LLMs. Grounded in cognitive theories of clinical reasoning, we conceptualize medical reasoning as an iterative process of abduction, deduction, and induction, and organize existing methods into seven major technical routes spanning training-based and training-free approaches. We further conduct a unified cross-benchmark evaluation of representative medical reasoning models under a consistent experimental setting, enabling a more systematic and comparable assessment of the empirical impact of existing methods. To better assess clinically grounded reasoning, we introduce MR-Bench, a benchmark derived from real-world hospital data. Evaluations on MR-Bench expose a pronounced gap between exam-level performance and accuracy on authentic clinical decision tasks. Overall, this survey provides a unified view of existing medical reasoning methods, benchmarks, and evaluation practices, and highlights key gaps between current model performance and the requirements of real-world clinical reasoning.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 44 of its 135 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

44 of 135 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025EHR-R1: A Reasoning-Enhanced Foundational Language Model for Electronic Health Record Analysis29 Oct
  2. 2025AdaThink-Med: Optimizing Inference-Time Compute for Medical Reasoning via Uncertainty Quantification29 Sep
  3. 2025Baichuan-M2: Scaling Medical Capability with Large Verifier System2 Sep
  4. 2025End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoning21 Aug
  5. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
  6. 2025MedAgentGym: A Scalable Agentic Training Environment for Code-Centric Reasoning in Biomedical Data Science4 Jun
  7. 2025Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL23 May
  8. 2025Disentangling Reasoning and Knowledge in Medical Large Language Models16 May
  9. 2025ClinicalGPT-R1: Pushing reasoning capability of generalist disease diagnosis with large language model13 Apr
  10. 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs1 Apr
  11. 2025m1: Unleash the Potential of Test-Time Scaling for Medical Reasoning with Large Language Models1 Apr
  12. 2025Citrus: Leveraging Expert Cognitive Pathways in a Medical Language Model for Advanced Medical Decision Support25 Feb
3 more
  1. 2025MedS3: Towards Medical Slow Thinking with Self-Evolved Soft Dual-sided Process Supervision21 Jan
  2. 2025O1 Replication Journey -- Part 3: Inference-time Scaling for Medical Reasoning11 Jan
  3. 2023Large Language Models Perform Diagnostic Reasoning18 Jul

Other references · 29

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  6. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  7. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  8. 2025Gemma 3 Technical Reportcited by 1,686
  9. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
  10. 2025Humanity's Last Examcited by 467
  11. 2025MedGemma Technical Reportcited by 398
  12. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
17 more
  1. 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
  2. 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 256
  3. 2024Capabilities of Gemini Models in Medicinecited by 231
  4. 2024Med42-v2: A Suite of Clinical LLMscited by 89
  5. 2025No Free Labels: Limitations of LLM-as-a-Judge Without Human Groundingcited by 50
  6. 2025Reinforced Latent Reasoning for LLM-based Recommendationcited by 46
  7. 2025Baichuan-M1: Pushing the Medical Capability of Large Language Modelscited by 41
  8. 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generationcited by 29
  9. 2025MedResearcher-R1: Expert-Level Medical Deep Researcher via A Knowledge-Informed Trajectory Synthesis Frameworkcited by 22
  10. 2024Assessing and Enhancing Large Language Models in Rare Disease Question-answeringcited by 16
  11. 2025Explicit v.s. Implicit Memory: Exploring Multi-hop Complex Reasoning Over Personalized Informationcited by 16
  12. 2025The Anatomy of a Personal Health Agentcited by 15
  13. 2025SteerX: Disentangled Steering for LLM Personalizationcited by 7
  14. 2025Fine-grained List-wise Alignment for Generative Medication Recommendationcited by 5
  15. 2025QuarkMed Medical Foundation Model Technical Reportcited by 5
  16. 2025CARL: Criticality-Aware Agentic Reinforcement Learningcited by 5
  17. 2025Fine-grained Alignment of Large Language Models for General Medication Recommendation without Overprescriptioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning
  2. 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Models
  3. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
  4. 2024Critique of Impure Reason: Unveiling the reasoning behaviour of medical Large Language Models
  5. 2025Quantifying the Reasoning Abilities of LLMs on Real-world Clinical Cases
  6. 2025Limitations of Large Language Models in Clinical Problem-Solving Arising from Inflexible Reasoning
  7. 2026A rubric landscape for evaluating clinical reasoning in large language models: what exists, what is missing, and what needs to be combined
  8. 2025MedOmni-45deg: A Safety-Performance Benchmark for Reasoning-Oriented LLMs in Medicine