mlsanityData to 7 Oct 2026

Baichuan-M2: Scaling Medical Capability with Large Verifier System

arXiv 2509.02208 ↗First posted 2 Sep 2025cs.LG cs.AIcited by 55

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

As large language models (LLMs) advance in conversational and reasoning capabilities, their practical application in healthcare has become a critical research focus. However, there is a notable gap between the performance of medical LLMs on static benchmarks such as USMLE and their utility in real-world clinical decision-making. This discrepancy arises because traditional exams fail to capture the dynamic, interactive nature of medical consultations. To address this challenge, we introduce a novel dynamic verification framework that moves beyond static answer verifier, establishing a large-scale, high-fidelity interactive reinforcement learning system. Our framework comprises two key components: a Patient Simulator that creates realistic clinical environments using de-identified medical records, and a Clinical Rubrics Generator that dynamically produces multi-dimensional evaluation metrics. Building on this foundation, we develop Baichuan-M2, a 32B-parameter medical augmented reasoning model trained through a multi-stage reinforcement learning strategy with an improved Group Relative Policy Optimization (GRPO) algorithm. Evaluated on HealthBench, Baichuan-M2 outperforms all other open-source models and most advanced closed-source counterparts, achieving a score above 32 on the challenging HealthBench Hard benchmark-previously exceeded only by GPT-5. Our work demonstrates that robust dynamic verifier system is essential for aligning LLM capabilities with practical clinical applications, establishing a new Pareto front in the performance-parameter trade-off for medical AI deployment.

Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 40 of its 52 references that are in the map. First posted on arXiv 2 Sep 2025.

Builds on

40 of 52 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
  2. 2025Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL23 May
  3. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs25 Dec

Other references · 37

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  8. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  9. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  10. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  11. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
  12. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
25 more
  1. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  2. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
  3. 2024QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMscited by 598
  4. 2025Kimi K2: Open Agentic Intelligencecited by 523
  5. 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 484
  6. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  7. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
  8. 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrationscited by 401
  9. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
  10. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 212
  11. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 210
  12. 2025When More is Less: Understanding Chain-of-Thought Length in LLMscited by 182
  13. 2023The Learnability of In-Context Learningcited by 126
  14. 2025Reinforcement Learning with Rubric Anchorscited by 108
  15. 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 95
  16. 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?cited by 84
  17. 2023AlignBench: Benchmarking Chinese Alignment of Large Language Modelscited by 68
  18. 2024CFBench: A Comprehensive Constraints-Following Benchmark for LLMscited by 65
  19. 2023Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMscited by 49
  20. 2025Baichuan-M1: Pushing the Medical Capability of Large Language Modelscited by 41
  21. 2025Fast on the Easy, Deep on the Hard: Efficient Reasoning via Powered Length Penaltycited by 15
  22. 2024QQQ: Quality Quattuor-Bit Quantization for Large Language Modelscited by 14
  23. 2024Baichuan4-Finance Technical Reportcited by 8
  24. 2025Exploring the Inquiry-Diagnosis Relationship with Advanced Patient Simulatorscited by 8
  25. 2024Baichuan Alignment Technical Reportcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 15; 2026: 40.

55 papers.

Sort:

By area:

  1. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 175
  2. 2025InfiMed-ORBIT: Aligning LLMs on Open-Ended Complex Tasks via Rubric-Based Incremental Trainingcited by 11
  3. 2025The Dialogue That Heals: A Comprehensive Evaluation of Doctor Agents' Inquiry Capabilitycited by 10
  4. 2025Beyond High-Entropy Exploration: Correctness-Aware Low-Entropy Segment-Based Advantage Shaping for Reasoning LLMscited by 10
  5. 2026Baichuan-M3: Modeling Clinical Inquiry for Reliable Medical Decision-Makingcited by 10
  6. 2025Fleming-R1: Toward Expert-Level Medical Reasoning via Reinforcement Learningcited by 9
  7. 2026LiveMedBench: A Contamination-Free Medical Benchmark for LLMs with Automated Rubric Evaluationcited by 9
  8. 2026MedVR: Annotation-Free Medical Visual Reasoning via Agentic Reinforcement Learningcited by 5
  9. 2025MMA-ASIA: A Multilingual and Multimodal Alignment Framework for Culturally-Grounded Evaluationcited by 4
  10. 2025Enhancing the Medical Context-Awareness Ability of LLMs via Multifaceted Self-Refinement Learningcited by 4
  11. 2025Multidimensional Rubric-oriented Reward Model Learning via Geometric Projection Reference Constraintscited by 4
  12. 2026LingxiDiagBench: A Multi-Agent Framework for Benchmarking LLMs in Chinese Psychiatric Consultation and Diagnosiscited by 4
38 more
  1. 2026Medical Reasoning with Large Language Models: A Survey and MR-Benchcited by 4
  2. 2025Generative AI for Healthcare: Fundamentals, Challenges, and Perspectivescited by 3
  3. 2026From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAGcited by 3
  4. 2026A Decade-Scale Benchmark Evaluating LLMs' Clinical Practice Guidelines Detection and Adherence in Multi-turn Conversationscited by 3
  5. 2025Patient-Zero: Scaling Synthetic Patient Agents to Real-World Distributions without Real Patient Datacited by 2
  6. 2025UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretationcited by 2
  7. 2026Quark Medical Alignment: A Holistic Multi-Dimensional Alignment and Collaborative Optimization Paradigmcited by 2
  8. 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 2
  9. 2025Overview of CHIP 2025 Shared Task 2: Discharge Medication Recommendation for Metabolic Diseases Based on Chinese Electronic Health Recordscited by 1
  10. 2026MLB: A Scenario-Driven Benchmark for Evaluating Large Language Models in Clinical Applicationscited by 1
  11. 2026MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosiscited by 1
  12. 2026MIND: Unified Inquiry and Diagnosis RL with Criteria Grounded Clinical Supports for Psychiatric Consultationcited by 1
  13. 2026Thinking Like a Clinician: A Cognitive AI Agent for Clinical Diagnosis via Panoramic Profiling and Adversarial Debatecited by 1
  14. 2026MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reportscited by 1
  15. 2026Baichuan-M4: A Clinical-Grade Medical Agent System for Continuous Carecited by 1
  16. 2026MentalHospital: A Virtual Environment for Evaluating Psychiatric Clinical Encounterscited by 1
  17. 2025Rethinking Explainable Disease Prediction: Synergizing Accuracy and Reliability via Reflective Cognitive Architecturecited by 0
  18. 2025MedCalc-Eval and MedCalc-Env: Advancing Medical Calculation Capabilities of Large Language Modelscited by 0
  19. 2025A benchmark dataset for evaluating Syndrome Differentiation and Treatment in large language modelscited by 0
  20. 2026From Evidence-Based Medicine to Knowledge Graph: Retrieval-Augmented Generation for Sports Rehabilitation and a Domain Benchmarkcited by 0
  21. 2026Dr. Assistant: Enhancing Clinical Diagnostic Inquiry via Structured Diagnostic Reasoning Data and Reinforcement Learningcited by 0
  22. 2026LingLanMiDian: Systematic Evaluation of LLMs on TCM Knowledge and Clinical Reasoningcited by 0
  23. 2026MicroVerse: A Preliminary Exploration Toward a Micro-World Simulationcited by 0
  24. 2026DongYuan: An LLM-Based Framework for Integrative Chinese and Western Medicine Spleen-Stomach Disorders Diagnosiscited by 0
  25. 2026TheraAgent: Self-Improving Therapeutic Agent for Precise and Comprehensive Treatment Planningcited by 0
  26. 2026C-MIG: Multi-view Information Gain-based Retrieval-Augmented Generation for Clinical Diagnosis Reasoningcited by 0
  27. 2026ClinicalMC: A Benchmark for Multi-Course Clinical Decision-Making with Large Language Modelscited by 0
  28. 2026Beyond Rubrics: Exploration-Guided Evaluation Skills for Reward Modelingcited by 0
  29. 2026Can the Environment Speak for Itself? T2-GRPO: A Turn-Trajectory Group Relative Policy Optimization for Caregiver Agentscited by 0
  30. 2026Lung-R1: A Knowledge Graph-Guided LLM for Pulmonary Diagnostic Reasoningcited by 0
  31. 2026A specialized reasoning large language model for accelerating rare disease diagnosis: a randomized AI physician assistance trialcited by 0
  32. 2026Latent-CURE for Breast Cancer Diagnosiscited by 0
  33. 2026Reinforcement Learning for Evidence-Seeking Diagnostic Reasoning with Large Language Modelscited by 0
  34. 2026MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultationcited by 0
  35. 2026Evaluating Counterfactual Sensitivity to Patient Information in Medication-Safety Reasoningcited by 0
  36. 2026One Score, Two Decisions: Selective Prediction on the Rare-Disease Tailcited by 0
  37. 2026Teaching LLMs How ICU Physicians Approach Clinical Reasoning Through OMOP-Aligned Retrieval Improves Reasoning Across Clinical Domainscited by 0
  38. 2026CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Modelscited by 0

50 most cited of 55 All 55 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Med-U1: Incentivizing Unified Medical Reasoning in LLMs via Large-scale Reinforcement Learning
  2. 2026Medmarks: A Comprehensive Open-Source LLM Benchmark Suite for Medical Tasks
  3. 2026CURE-Med: Curriculum-Informed Reinforcement Learning for Multilingual Medical Reasoning
  4. 2025Disentangling Reasoning and Knowledge in Medical Large Language Models
  5. 2025Reasoning LLMs in the Medical Domain: A Literature Survey
  6. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialogue
  7. 2026Scaling Medical Reasoning Verification via Tool-Integrated Reinforcement Learning
  8. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications