mlsanityData to 14 Oct 2026

MedEvo: Medical Reasoning Evolution through Knowledge Navigation

arXiv 2610.17690 ↗First posted 13 Oct 2026cs.AI cs.CV cs.LGcited by 0

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Medical multimodal reasoning models are typically trained on teacher-generated rationales, discarding the valid reasoning in students' own failed trajectories, while general-domain correction methods offer little guidance for errors in image reading, anatomical context, or differential diagnosis. We propose MedEvo, which uses medical knowledge, namely a tag taxonomy and error-type diagnosis, to navigate both trajectory repair and data selection. For each failed rollout, a gold-blind auditor locates the first consequential error and provides a minimal, answer-free hint; the same student retains the valid prefix and regenerates the erroneous suffix. After each round, MedEvo identifies capability gaps across medical tags on a held-out feedback set and prioritizes related questions for new rollouts and repairs. With supervised fine-tuning (SFT) alone, MedEvo raises Qwen3.5-9B mean accuracy across seven benchmarks from 65.57% to 69.12% (47.40% to 54.50% on the multimodal track of MedXpertQA (MedXpertQA-MM)), surpassing teacher-distillation SFT (66.93%). It also raises Qwen3.5-35B and Qwen3.5-397B mean accuracy from 67.91% to 73.04% and from 71.83% to 74.95%, respectively. Our analyses show that failed trajectories contain reasoning worth preserving, that repair success does not imply learning value, and that independent feedback is key to sustained improvement.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 64 of its 70 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

64 of 70 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026Better Accuracies, Worse Reasoning: A Step-Level Audit of Medical Chain-of-Thought Distillation27 May
  2. 2026Eliciting Medical Reasoning with Knowledge-enhanced Data Synthesis: A Semi-Supervised Reinforcement Learning Approach13 Apr
  3. 2026MedCoG: Maximizing LLM Inference Density in Medical Reasoning via Meta-Cognitive Regulation8 Feb
  4. 2026MedVerse: Efficient and Reliable Medical Reasoning via DAG-Structured Parallel Execution7 Feb
  5. 2025Fleming-R1: Toward Expert-Level Medical Reasoning via Reinforcement Learning18 Sep
  6. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
  7. 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning31 May
  8. 2025Disentangling Reasoning and Knowledge in Medical Large Language Models16 May
  9. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs25 Dec

Other references · 55

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  2. 2023Let's Verify Step by Stepcited by 3,789
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  6. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  7. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  8. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
  9. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  10. 2025MedGemma Technical Reportcited by 436
  11. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 426
  12. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
38 more
  1. 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 349
  2. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
  3. 2026Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipecited by 299
  4. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
  5. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
  6. 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 184
  7. 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptationcited by 114
  8. 2023Learning From Mistakes Makes LLM Better Reasonercited by 101
  9. 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 53
  10. 2026Purified OPSD: On-Policy Self-Distillation Without Losing How to Thinkcited by 31
  11. 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methodscited by 30
  12. 2026Rethinking On-Policy Distillation of Large Language Models II: One Training Examplecited by 24
  13. 2026RSIBench-Data: Benchmarking Data-Centric Research for Recursive Self-Improvementcited by 18
  14. 2026Dream-RSI: Recursive Self-Improvement through Evolving Worldscited by 18
  15. 2025Shape of Thought: When Distribution Matters More than Correctness in Reasoning Taskscited by 11
  16. 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvementcited by 11
  17. 2026ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratchcited by 10
  18. 2025Exploring Expert Failures Improves LLM Agent Tuningcited by 9
  19. 2026Project Aletheia: Verifier-Guided Distillation of Backtracking for Small Language Modelscited by 8
  20. 2026On-Policy Self-Evolution via Failure Trajectories for Agentic Safety Alignmentcited by 8
  21. 2026Backtracking When It Strays: Mitigating Dual Exposure Biases in LLM Reasoning Distillationcited by 8
  22. 2026What Matters in On-Policy Distillation? A Perspective on Data Efficiency and Data Selectioncited by 6
  23. 2026Hindsight Hint Distillation: Scaffolded Reasoning for SWE Agents from CoT-free Answerscited by 5
  24. 2026FLARE: A Failure-Aware Framework for Autonomous Correction and Recovery in Visual-Language Robotic Manipulationcited by 5
  25. 2026Learning from Your Own Mistakes: Constructing Learnable Micro-Reflective Trajectories for Self-Distillationcited by 4
  26. 2026RedFlow: Redirect Failure into Action-Level Corrections for Flow-matching VLA Policycited by 4
  27. 2026Beyond Rejection Sampling: Trajectory Fusion for Scaling Mathematical Reasoningcited by 3
  28. 2026MediSkill-Evo: Process-Constrained Self-Evolution for Evidence-Grounded Clinical Interactioncited by 3
  29. 2026ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoningcited by 2
  30. 2026FailForge: Distilling Procedural Competence from Persistent Failures into Code Agentscited by 2
  31. 2026BaT: Towards Self-Evolving Medical Research Agent with Stage Rubricscited by 2
  32. 2026Search, Fail, Recover: A Training Framework for Correction-Aware Reasoningcited by 1
  33. 2026EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimizationcited by 1
  34. 2026Test-Time Scaling via Error Localizationcited by 1
  35. 2026ChainPrune: Evaluating and Reducing Redundancy in Long Chain-of-Thought Reasoningcited by 1
  36. 2026Selective Regenerative Decoding: Trajectory-Level Intervention for Inference-Time Reasoningcited by 1
  37. 2026When Rubrics Fail: Hallucinations Reveal Blind Spots in Medical AI Evaluationcited by 1
  38. 2026NeMo Data Designer: An Extensible Framework for Multimodal Synthetic Data Generationcited by 1

50 most cited of 55 All 55 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MedVLThinker: Simple Baselines for Multimodal Medical Reasoning
  2. 2026Constructing and Evaluating Clinical Reasoning Trajectories for Medical Agent
  3. 2026MedQA-MM: Shortcuts Behind Medical Visual Reasoning
  4. 2025Elicit and Enhance: Advancing Multimodal Reasoning in Medical Scenarios
  5. 2026Evo-PI: Aligning Medical Reasoning via Evolving Principle-Guided Supervision
  6. 2025OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoning
  7. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
  8. 2025Chiron-o1: Igniting Multimodal Large Language Models towards Generalizable Medical Reasoning via Mentor-Intern Collaborative Search