mlsanityData to 14 Oct 2026

Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications

arXiv 2508.00669 ↗First posted 1 Aug 2025cs.CL cs.AI cs.CVcited by 10

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning, a cornerstone of clinical practice. This has catalyzed a shift from single-step answer generation to the development of LLMs explicitly designed for medical reasoning. This paper provides the first systematic review of this emerging field. We propose a taxonomy of reasoning enhancement techniques, categorized into training-time strategies (e.g., supervised fine-tuning, reinforcement learning) and test-time mechanisms (e.g., prompt engineering, multi-agent systems). We analyze how these techniques are applied across different data modalities (text, image, code) and in key clinical applications such as diagnosis, education, and treatment planning. Furthermore, we survey the evolution of evaluation benchmarks from simple accuracy metrics to sophisticated assessments of reasoning quality and visual interpretability. Based on an analysis of 60 seminal studies from 2022-2025, we conclude by identifying critical challenges, including the faithfulness-plausibility gap and the need for native multimodal reasoning, and outlining future directions toward building efficient, robust, and sociotechnically responsible medical AI.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 58 of its 157 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

58 of 157 references.

Closest ancestors · 26

Same direction, newest first

  1. 2025MedGround-R1: Advancing Medical Image Grounding via Spatial-Semantic Rewarded Group Relative Policy Optimization1 Jul
  2. 2025GEMeX-RMCoT: An Enhanced Med-VQA Dataset for Region-Aware Multimodal Chain-of-Thought Reasoning22 Jun
  3. 2025PathCoT: Chain-of-Thought Prompting for Zero-shot Pathology Visual Reasoning18 Jun
  4. 2025Med-PRM: Medical Reasoning Models with Stepwise, Guideline-verified Process Rewards13 Jun
  5. 2025ReasonMed: A 370K Multi-Agent Generated Dataset for Advancing Medical Reasoning11 Jun
  6. 2025Elicit and Enhance: Advancing Multimodal Reasoning in Medical Scenarios29 May
  7. 2025ER-Reason: A Benchmark Dataset for LLM Clinical Reasoning in the Emergency Room28 May
  8. 2025CardioCoT: Hierarchical Reasoning for Multimodal Survival Analysis25 May
  9. 2025Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL23 May
  10. 2025PRS-Med: Position Reasoning Segmentation in Medical Imaging17 May
  11. 2025Disentangling Reasoning and Knowledge in Medical Large Language Models16 May
  12. 2025ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step Verification29 Apr
14 more
  1. 2025GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoning2 Apr
  2. 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs1 Apr
  3. 2025m1: Unleash the Potential of Test-Time Scaling for Medical Reasoning with Large Language Models1 Apr
  4. 2025MedicalAgentsBench for Complex Medical Reasoning: Comparing Internalized Reasoning Models versus Externalized Agent-based Frameworks10 Mar
  5. 2025Med-RLVR: Emerging Medical Reasoning from a 3B base model via reinforcement Learning27 Feb
  6. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb
  7. 2025Ask Patients with Patience: Enabling LLMs for Human-Centric Medical Dialogue with Grounded Reasoning11 Feb
  8. 2025FineMedLM-o1: Enhancing Medical Knowledge Reasoning Ability of LLM from Supervised Fine-Tuning to Test-Time Training16 Jan
  9. 2025O1 Replication Journey -- Part 3: Inference-time Scaling for Medical Reasoning11 Jan
  10. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs25 Dec
  11. 2024Knowledge-Augmented Multimodal Clinical Rationale Generation for Disease Diagnosis with Small Language Models12 Nov
  12. 2024Inquire, Interact, and Integrate: A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoning19 May
  13. 2024ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoning23 Apr
  14. 2024RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning19 Feb

Other references · 32

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  6. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  7. 2024OpenAI o1 System Cardcited by 1,244
  8. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  9. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
  10. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
  11. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
  12. 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 184
20 more
  1. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 124
  2. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 90
  3. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
  4. 2025Sequential Diagnosis with Language Modelscited by 60
  5. 2024DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaborationcited by 44
  6. 2025Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planningcited by 34
  7. 2024ClinicalLab: Aligning Agents for Multi-Departmental Clinical Diagnostics in the Real Worldcited by 28
  8. 2023On Diversified Preferences of Large Language Model Alignmentcited by 26
  9. 2025R2MED: A Benchmark for Reasoning-Driven Medical Retrievalcited by 22
  10. 2024MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integrationcited by 21
  11. 2024SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trialscited by 20
  12. 2025A Survey of Slow Thinking-based Reasoning LLMs using Reinforced Learning and Inference-time Scaling Lawcited by 19
  13. 2024Trustworthy and Practical AI for Healthcare: A Guided Deferral System with Large Language Modelscited by 16
  14. 2024Simulated patient systems powered by large language model-based AI agents offer potential for transforming medical educationcited by 13
  15. 2024Automated radiotherapy treatment planning guided by GPT-4Visioncited by 12
  16. 2024Professional Agents -- Evolving Large Language Models into Autonomous Experts with Human-Level Competenciescited by 9
  17. 2025AOR: Anatomical Ontology-Guided Reasoning for Medical Large Multimodal Model in Chest X-Ray Interpretationcited by 8
  18. 2024MEG: Medical Knowledge-Augmented Large Language Models for Question Answeringcited by 6
  19. 2025Federated Learning: A Survey on Privacy-Preserving Collaborative Intelligencecited by 4
  20. 2024Can Large Language Models Replace Data Scientists in Biomedical Research?cited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 8.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning LLMs in the Medical Domain: A Literature Survey
  2. 2026Medical Reasoning with Large Language Models: A Survey and MR-Bench
  3. 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning
  4. 2025Automating Expert-Level Medical Reasoning Evaluation of Large Language Models
  5. 2026Advances in LLM Reasoning Enable Flexibility in Clinical Problem-Solving
  6. 2026Medmarks: A Comprehensive Open-Source LLM Benchmark Suite for Medical Tasks
  7. 2024Critique of Impure Reason: Unveiling the reasoning behaviour of medical Large Language Models
  8. 2023Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review