From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning
On the map: LLM reasoning → Clinical and biomedical applications
also in 1 more
Abstract (arXiv)
Foundation models can serve as clinical agents through tool-use harnesses. However, conventional medical benchmarks assess reasoning over preselected evidence rather than the ability to seek it across clinical records and longitudinal imaging. We propose CASE: a series of role-specific Clinical Agents for Seeking Evidence, together with a tool-use harness and an agentic post-training framework for compact vision-language policy models. We further introduce a longitudinal multimodal benchmark built on UK Biobank, comprising 50,401 clinical questions derived from real-world ICD-10-coded diagnoses of 4,739 participants. Each question links to a patient-specific environment containing clinical context and multi-sequence MRI from baseline and follow-up visits, where agents autonomously select which visits, organs, modalities, slices, and specialist tools to inspect and compare. Supervised fine-tuning transfers evidence-seeking workflows from 147,434 frontier-model interaction trajectories, followed by agentic reinforcement learning on the learner's own environment interactions. Privileged on-policy self-distillation and rubric-based LLM feedback refine evidence-to-conclusion reasoning without prescribing tool sequences. Experiments show that CASE moves beyond question-answer imitation toward transferable investigation policies, strengthening evidence-grounded longitudinal reasoning. Under matched evaluation conditions, our Qwen3-VL-8B-Instruct based agent achieves over 16% and 10% relative improvements in answer accuracy over GPT-5.4 and Claude Opus 4.8. Project page available at: https://vinyehshaw.github.io/case-project/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 52 of its 61 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
52 of 61 references.
Closest ancestors · 7
Same direction, newest first
- 2026MedVR: Annotation-Free Medical Visual Reasoning via Agentic Reinforcement Learning9 Apr
- 2025Ophiuchus: Incentivizing Tool-augmented "Think with Images" for Joint Medical Segmentation, Understanding and Reasoning16 Dec
- 2025MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncology25 Nov
- 2025Simulating Viva Voce Examinations to Evaluate Clinical Reasoning in Large Language Models11 Oct
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
- 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflow21 Mar
- 2025Quantifying the Reasoning Abilities of LLMs on Real-world Clinical Cases6 Mar
Other references · 45
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
33 more
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 455
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2025MedGemma Technical Reportcited by 436
- 2026Reinforcement Learning via Self-Distillationcited by 332
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
- 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
- 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 109
- 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
- 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imagingcited by 64
- 2025MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agentscited by 62
- 2020Consistency of a Recurrent Language Model With Respect to Incomplete Decodingcited by 54
- 2026MedGemma 1.5 Technical Reportcited by 45
- 2026The Many Faces of On-Policy Distillation: Pitfalls, Mechanisms, and Fixescited by 45
- 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactionscited by 40
- 2026Reinforcement-aware Knowledge Distillation for LLM Reasoningcited by 35
- 2025MedAgentBoard: Benchmarking Multi-Agent Collaboration with Conventional Methods for Diverse Medical Taskscited by 29
- 2024ClinicalLab: Aligning Agents for Multi-Departmental Clinical Diagnostics in the Real Worldcited by 28
- 2024Medchain: Bridging the Gap Between LLM Agents and Clinical Practice with Interactive Sequencecited by 17
- 2026On-policy Distillation with Verifiable Rewardcited by 15
- 2026Teacher-Guided Policy Optimization for On-Policy Reasoning Distillation under Large Policy Divergencecited by 13
- 2026Evolving Medical Imaging Agents via Experience-driven Self-skill Discoverycited by 11
- 2026Self-Supervised On-Policy Distillation for Reasoning Language Modelscited by 10
- 2025RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflowscited by 8
- 2026Agentic Reinforcement Learning with Observation-Calibrated Self-Distillationcited by 7
- 2025RadImageNet-VQA: A Large-Scale CT and MRI Dataset for Radiologic Visual Question Answeringcited by 6
- 2026PBSD: Privileged Bayesian Self-Distillation for Long-Horizon Credit Assignmentcited by 6
- 2025UKBOB: One Billion MRI Labeled Masks for Generalizable 3D Medical Image Segmentationcited by 4
- 2026Agentic Reinforcement Learning with Self-Distilled Reward Shapingcited by 3
- 2026Beyond Outcome Rewards: Step-Level Self-Distilled Policy Optimization for Deep Search Agentscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ClinSeekAgent: Automating Multimodal Evidence Seeking for Agentic Clinical Reasoning
- 2026CDEG: Learning Decision-Critical Evidence for Long-Horizon Diagnostic Agents
- 2026CARE: Towards Clinical Accountability in Multi-Modal Medical Reasoning with an Evidence-Grounded Agentic Framework
- 2026Inference-Time Agentic Decision Rules Beat Longer Evolving Search for Multi-Image Medical Reasoning
- 2026Scaling Medical Reasoning Verification via Tool-Integrated Reinforcement Learning
- 2026Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translation
- 2026AutoMedBench: Towards Medical AutoResearch with Agentic AI Models
- 2026Reinforcement Learning for Evidence-Seeking Diagnostic Reasoning with Large Language Models