mlsanityData to 7 Oct 2026

FineMedLM-o1: Enhancing Medical Knowledge Reasoning Ability of LLM from Supervised Fine-Tuning to Test-Time Training

arXiv 2501.09213 ↗First posted 16 Jan 2025cs.CLcited by 19

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Recent advancements in large language models (LLMs) have shown promise in medical applications such as disease diagnosis and treatment planning. However, most existing medical LLMs struggle with the deep reasoning required for complex medical problems, such as differential diagnosis and medication recommendations. We propose FineMedLM-o1, which leverages high-quality medical synthetic data and long-form reasoning data for Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO), enabling advanced dialogue and deep reasoning capabilities. Additionally, we introduce Test-Time Training (TTT) in the medical domain for the first time, facilitating domain adaptation and ensuring reliable, accurate reasoning. Experimental results demonstrate that FineMedLM-o1 achieves a 23% average performance improvement over prior models on key medical benchmarks. Furthermore, the introduction of TTT provides an additional 14% performance boost, highlighting its effectiveness in enhancing medical reasoning capabilities. To support this process, we also propose a novel method for synthesizing medical dialogue. Compared to other open-source datasets, our dataset stands out as superior in both quality and complexity. The project and data will be released on GitHub.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 32 of its 54 references that are in the map. First posted on arXiv 16 Jan 2025.

Builds on

32 of 54 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs25 Dec

Other references · 31

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2024Qwen2.5 Technical Reportcited by 4,713
  7. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  8. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  9. 2024DeepSeek-V3 Technical Reportcited by 724
  10. 2024Phi-4 Technical Reportcited by 675
  11. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
  12. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 354
19 more
  1. 2023Physics of Language Models: Part 3.1, Knowledge Storage and Extractioncited by 264
  2. 2024MAmmoTH2: Scaling Instructions from the Webcited by 143
  3. 2023Physics of Language Models: Part 3.2, Knowledge Manipulationcited by 142
  4. 2024Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Lawscited by 137
  5. 2019On the Measure of Intelligencecited by 129
  6. 2024OpenCoder: The Open Cookbook for Top-Tier Code Large Language Modelscited by 127
  7. 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 113
  8. 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 91
  9. 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 90
  10. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 89
  11. 2024The Surprising Effectiveness of Test-Time Training for Few-Shot Learningcited by 88
  12. 2023Instruction Mining: Instruction Data Selection for Tuning Large Language Modelscited by 57
  13. 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferencescited by 43
  14. 2024Efficiently Learning at Test-Time: Active Fine-Tuning of LLMscited by 42
  15. 2024Aloe: A Family of Fine-tuned Open Healthcare LLMscited by 20
  16. 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluationscited by 16
  17. 2024Chain-of-Though (CoT) prompting strategies for medical error detection and correctioncited by 7
  18. 2024Aqulia-Med LLM: Pioneering Full-Process Open-Source Medical Language Modelscited by 4
  19. 2024A Medical Multimodal Large Language Model for Pediatric Pneumoniacited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 14; 2026: 5.

19 papers.

Sort:

By area:

  1. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 175
  2. 2025Nested Learning: The Illusion of Deep Learning Architecturescited by 69
  3. 2025DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Modelscited by 19
  4. 2025Improving Medical Reasoning with Curriculum-Aware Reinforcement Learningcited by 16
  5. 2025Doctor-R1: Mastering Clinical Inquiry with Experiential Agentic Reinforcement Learningcited by 11
  6. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applicationscited by 10
  7. 2025How Far Are We from Optimal Reasoning Efficiency?cited by 8
  8. 2025Med-U1: Incentivizing Unified Medical Reasoning in LLMs via Large-scale Reinforcement Learningcited by 8
  9. 2025MediQAl: A French Medical Question Answering Dataset for Knowledge and Reasoning Evaluationcited by 5
  10. 2025Pragyaan: Designing and Curating High-Quality Cultural Post-Training Datasets for Indian Languagescited by 3
  11. 2025Towards Efficient Medical Reasoning with Minimal Fine-Tuning Datacited by 2
  12. 2026Fundamental Reasoning Paradigms Induce Out-of-Domain Generalization in Language Modelscited by 2
7 more
  1. 2025CLARity: Reasoning Consistency Alone Can Teach Reinforced Expertscited by 1
  2. 2025Med-VRAgent: A Framework for Medical Visual Reasoning-Enhanced Agentscited by 1
  3. 2026Benchmarking Egocentric Clinical Intent Understanding Capability for Medical Multimodal Large Language Modelscited by 1
  4. 2025One Missing Piece for Open-Source Reasoning Models: A Dataset to Mitigate Cold-Starting Short CoT LLMs in RLcited by 0
  5. 2026MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Modelscited by 0
  6. 2026Reasoning4Sciences: Bridging Reasoning Language Models to All Scientific Branchescited by 0
  7. 2026Supervised Fine-tuning with Synthetic Rationale Data Hurts Real-World Disease Predictioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning LLMs in the Medical Domain: A Literature Survey
  2. 2025Dialogue is Better Than Monologue: Instructing Medical LLMs via Strategical Conversations
  3. 2025Stabilizing Reasoning in Medical LLMs with Continued Pretraining and Reasoning Preference Optimization
  4. 2025Disentangling Reasoning and Knowledge in Medical Large Language Models
  5. 2026Medmarks: A Comprehensive Open-Source LLM Benchmark Suite for Medical Tasks
  6. 2023From Beginner to Expert: Modeling Medical Knowledge into General LLMs
  7. 2025Generalization of Medical Large Language Models through Cross-Domain Weak Supervision
  8. 2025Resource-Efficient Fine-Tuning of LLaMA-3.2-3B for Medical Chain-of-Thought Reasoning