MIRA: Medical Image Reflection for Agentic Diagnosis
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Medical visual agents can use tools to inspect images and retrieve external knowledge, but indiscriminate tool use may introduce noisy or misleading evidence. Reliable diagnosis therefore requires not only acquiring additional observations, but also verifying whether tool actions are necessary and whether the resulting evidence supports the current hypothesis. We introduce MIRA (Medical Image Reflection for Agentic Diagnosis), a medical visual diagnostic framework for autonomous evidence search and reflective verification. MIRA dynamically invokes image-processing operations, including zooming, grounding, pointing, rotation, and measurement, as well as web search, while evaluating the relevance and consistency of the acquired evidence. We develop MIRA through a two-stage training strategy. First, a tool-augmented Monte Carlo Tree Search data engine explores diverse diagnostic hypotheses and jointly verifies visual grounding accuracy and semantic consistency to construct supervised fine-tuning trajectories. Second, reinforcement learning further improves decision-making through online reflective principle evolution: failure cases are distilled into candidate principles, and only principles that improve held-out rollout rewards are retained. Across nine medical visual reasoning benchmarks, MIRA achieves an average score of 64.73, improving its Qwen3-VL-8B backbone by 7.44 points. It also increases useful tool-use judgments from 56.2% to 73.8% and reduces harmful judgments from 8.9% to 1.6%. Qualitative analyses show that MIRA can re-examine evidence, correct premature conclusions, and adapt its tool-use strategy. Project page: https://MIRA-VL.github.io/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 41 of its 54 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
41 of 54 references.
Closest ancestors · 3
Same direction, newest first
- 2026Meissa: Multi-modal Medical Agentic Intelligence9 Mar
- 2026MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learning3 Feb
- 2026MEDVISTAGYM: A Scalable Training Environment for Thinking with Medical Images via Tool-Integrated Reinforcement Learning12 Jan
Other references · 38
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
26 more
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
- 2025Seed1.5-VL Technical Reportcited by 373
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 230
- 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
- 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
- 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 184
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
- 2025Thyme: Think Beyond Imagescited by 167
- 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
- 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
- 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
- 2025Latent Visual Reasoningcited by 104
- 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Usecited by 90
- 2025Thinking with Generated Imagescited by 73
- 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Imagescited by 15
- 2025MedReasoner: Reinforcement Learning Drives Reasoning Grounding from Clinical Thought to Pixel-Level Precisioncited by 10
- 2026MediX-R1: Open Ended Medical Reinforcement Learningcited by 7
- 2026MedXIAOHE: A Comprehensive Recipe for Building Medical MLLMscited by 6
- 2026MedScope: Incentivizing "Think with Videos" for Clinical Reasoning via Coarse-to-Fine Tool Callingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Inference-Time Agentic Decision Rules Beat Longer Evolving Search for Multi-Image Medical Reasoning
- 2026VERITAS: A Multi-Agent Co-Scientist for Verifiable Image-Derived Hypothesis Testing ↗
- 2025MedEyes: Learning Dynamic Visual Focus for Medical Progressive Diagnosis
- 2026From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning
- 2026Route, Retrieve, Reflect, Repair: Self-Improving Agentic Framework for Visual Detection and Linguistic Reasoning in Medical Imaging
- 2026Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoning
- 2026EVADE: Evidence-Verified Agentic Diagnosis with Escape
- 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learning