OctoMed: Data Recipes for State-of-the-Art Multimodal Medical Reasoning
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
High-quality and carefully curated data is a cornerstone of training medical large language models, as it directly impacts both generalization and robustness to unseen clinical tasks. We investigate strategies for training and data curation to develop a robust multimodal reasoning model in the medical domain. Our work focuses on supervised fine-tuning (SFT) and explores data recipes that leverage structured reasoning traces. Using our proposed data recipe, we scale experiments to a dataset of over 8 million examples and 6.8 billion response tokens, achieving state-of-the-art performance among open-source models across diverse out-of-distribution medical benchmark tasks. Our results further indicate that curating a high-quality, diverse training dataset with varying structured reasoning trace lengths enables the fine-tuned model to self-calibrate its reasoning trajectory lengths based on the downstream task, without explicit supervision. We present key insights, describe the data curation strategy, and outline next steps toward developing robust medical vision-language reasoning system.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 53 of its 74 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
53 of 74 references.
Closest ancestors · 11
Same direction, newest first
- 2025MedVLThinker: Simple Baselines for Multimodal Medical Reasoning4 Aug
- 2025GEMeX-RMCoT: An Enhanced Med-VQA Dataset for Region-Aware Multimodal Chain-of-Thought Reasoning22 Jun
- 2025Chiron-o1: Igniting Multimodal Large Language Models towards Generalizable Medical Reasoning via Mentor-Intern Collaborative Search20 Jun
- 2025ReasonMed: A 370K Multi-Agent Generated Dataset for Advancing Medical Reasoning11 Jun
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
- 2025QoQ-Med: Building Multimodal Clinical Foundation Models with Domain-Aware GRPO Training31 May
- 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner16 May
- 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs1 Apr
- 2025Med-RLVR: Emerging Medical Reasoning from a 3B base model via reinforcement Learning27 Feb
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb
- 2024MedCoT: Medical Chain of Thought via Hierarchical Expert18 Dec
Other references · 42
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2025s1: Simple test-time scalingcited by 1,311
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
30 more
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
- 2025MedGemma Technical Reportcited by 398
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 212
- 2025Spurious Rewards: Rethinking Training Signals in RLVRcited by 199
- 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 194
- 2024RegMix: Data Mixture as Regression for Language Model Pre-trainingcited by 172
- 2024MAIRA-2: Grounded Radiology Report Generationcited by 140
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scalecited by 125
- 2019HEAD-QA: A Healthcare Dataset for Complex Reasoningcited by 100
- 2025Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contaminationcited by 81
- 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thoughtcited by 69
- 2025FineVision: Open Data Is All You Needcited by 51
- 2024EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Recordscited by 31
- 2025X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domainscited by 30
- 2025ReXVQA: A Large-scale Visual Question Answering Benchmark for Generalist Chest X-ray Understandingcited by 20
- 2023A Foundational Multimodal Vision Language AI Assistant for Human Pathologycited by 19
- 2025CLIMB: Data Foundations for Large Scale Multimodal Clinical Foundation Modelscited by 13
- 2025HoneyBee: Data Recipes for Vision-Language Reasonerscited by 13
- 2023Hierarchical Pretraining on Multimodal Electronic Health Recordscited by 11
- 2024OLIVE: Object Level In-Context Visual Embeddingscited by 2
- 2025Learning and Generalization with Mixture Datacited by 2
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoningcited by 3
- 2026MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Modelscited by 3
- 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gainscited by 2
- 2026MedAction: Towards Active Multi-turn Clinical Diagnostic LLMscited by 2
- 2026OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Modelscited by 1
- 2026MedGPT-oss: Training a General-Purpose Vision-Language Model for Biomedicinecited by 0
- 2026PathoSage: Towards Multi-Source Evidence Adjudication in Pathology via Experience-Aware Agentic Workflowcited by 0
- 2026DeepLens Diagnosis Agent: Agentic Workflow Design Lets a Small Reasoning Model Compete with Frontier LLMscited by 0
- 2026PathScale-R1: Cross-scale Reasoning for Pathological Image Analysiscited by 0
- 2026Volumetric Radiology AI in the Era of Multimodal Large Language Modelscited by 0
- 2026Volumetric Radiology AI in the Era of Multimodal Large Language Models20 Aug 2026
- 2026PathScale-R1: Cross-scale Reasoning for Pathological Image Analysis26 Jul 2026
- 2026OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models10 Jun 2026
- 2026MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models4 Jun 2026
- 2026DeepLens Diagnosis Agent: Agentic Workflow Design Lets a Small Reasoning Model Compete with Frontier LLMs19 May 2026
- 2026ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning19 May 2026
- 2026PathoSage: Towards Multi-Source Evidence Adjudication in Pathology via Experience-Aware Agentic Workflow18 May 2026
- 2026MedAction: Towards Active Multi-turn Clinical Diagnostic LLMs8 May 2026
- 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gains1 Mar 2026
- 2026MedGPT-oss: Training a General-Purpose Vision-Language Model for Biomedicine1 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Towards Efficient Medical Reasoning with Minimal Fine-Tuning Data
- 2025Med-CMR: A Fine-Grained Benchmark Integrating Visual Evidence and Clinical Logic for Medical Complex Multimodal Reasoning
- 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
- 2025Fleming-VL: Towards Universal Medical Visual Reasoning with Multimodal LLMs
- 2025Elicit and Enhance: Advancing Multimodal Reasoning in Medical Scenarios
- 2025A Medical Multimodal Diagnostic Framework Integrating Vision-Language Models and Logic Tree Reasoning
- 2026MedQA-MM: Shortcuts Behind Medical Visual Reasoning
- 2025Capabilities of GPT-5 on Multimodal Medical Reasoning