mlsanityData to 7 Oct 2026

OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoning

arXiv 2511.23269 ↗First posted 28 Nov 2025cs.AIcited by 10

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

High-quality and carefully curated data is a cornerstone of training medical large language models, as it directly impacts both generalization and robustness to unseen clinical tasks. We investigate strategies for training and data curation to develop a robust multimodal reasoning model in the medical domain. Our work focuses on supervised fine-tuning (SFT) and explores data recipes that leverage structured reasoning traces. Using our proposed data recipe, we scale experiments to a dataset of over 8 million examples and 6.8 billion response tokens, achieving state-of-the-art performance among open-source models across diverse out-of-distribution medical benchmark tasks. Our results further indicate that curating a high-quality, diverse training dataset with varying structured reasoning trace lengths enables the fine-tuned model to self-calibrate its reasoning trajectory lengths based on the downstream task, without explicit supervision. We present key insights, describe the data curation strategy, and outline next steps toward developing robust medical vision-language reasoning system.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 53 of its 74 references that are in the map. First posted on arXiv 28 Nov 2025.

Builds on

53 of 74 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025MedVLThinker: Simple Baselines for Multimodal Medical Reasoning4 Aug
  2. 2025GEMeX-RMCoT: An Enhanced Med-VQA Dataset for Region-Aware Multimodal Chain-of-Thought Reasoning22 Jun
  3. 2025Chiron-o1: Igniting Multimodal Large Language Models towards Generalizable Medical Reasoning via Mentor-Intern Collaborative Search20 Jun
  4. 2025ReasonMed: A 370K Multi-Agent Generated Dataset for Advancing Medical Reasoning11 Jun
  5. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
  6. 2025QoQ-Med: Building Multimodal Clinical Foundation Models with Domain-Aware GRPO Training31 May
  7. 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner16 May
  8. 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs1 Apr
  9. 2025Med-RLVR: Emerging Medical Reasoning from a 3B base model via reinforcement Learning27 Feb
  10. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb
  11. 2024MedCoT: Medical Chain of Thought via Hierarchical Expert18 Dec

Other references · 42

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2024GPT-4o System Cardcited by 4,467
  7. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  8. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  9. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  10. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  11. 2025s1: Simple test-time scalingcited by 1,311
  12. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
30 more
  1. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
  2. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  3. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  4. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  5. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
  6. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
  7. 2025MedGemma Technical Reportcited by 398
  8. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
  9. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
  10. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
  11. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
  12. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 212
  13. 2025Spurious Rewards: Rethinking Training Signals in RLVRcited by 199
  14. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 194
  15. 2024RegMix: Data Mixture as Regression for Language Model Pre-trainingcited by 172
  16. 2024MAIRA-2: Grounded Radiology Report Generationcited by 140
  17. 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scalecited by 125
  18. 2019HEAD-QA: A Healthcare Dataset for Complex Reasoningcited by 100
  19. 2025Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contaminationcited by 81
  20. 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thoughtcited by 69
  21. 2025FineVision: Open Data Is All You Needcited by 51
  22. 2024EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Recordscited by 31
  23. 2025X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domainscited by 30
  24. 2025ReXVQA: A Large-scale Visual Question Answering Benchmark for Generalist Chest X-ray Understandingcited by 20
  25. 2023A Foundational Multimodal Vision Language AI Assistant for Human Pathologycited by 19
  26. 2025CLIMB: Data Foundations for Large Scale Multimodal Clinical Foundation Modelscited by 13
  27. 2025HoneyBee: Data Recipes for Vision-Language Reasonerscited by 13
  28. 2023Hierarchical Pretraining on Multimodal Electronic Health Recordscited by 11
  29. 2024OLIVE: Object Level In-Context Visual Embeddingscited by 2
  30. 2025Learning and Generalization with Mixture Datacited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Efficient Medical Reasoning with Minimal Fine-Tuning Data
  2. 2025Med-CMR: A Fine-Grained Benchmark Integrating Visual Evidence and Clinical Logic for Medical Complex Multimodal Reasoning
  3. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
  4. 2025Fleming-VL: Towards Universal Medical Visual Reasoning with Multimodal LLMs
  5. 2025Elicit and Enhance: Advancing Multimodal Reasoning in Medical Scenarios
  6. 2025A Medical Multimodal Diagnostic Framework Integrating Vision-Language Models and Logic Tree Reasoning
  7. 2026MedQA-MM: Shortcuts Behind Medical Visual Reasoning
  8. 2025Capabilities of GPT-5 on Multimodal Medical Reasoning