mlsanityData to 14 Oct 2026

MIRA: Medical Image Reflection for Agentic Diagnosis

arXiv 2608.10827 ↗First posted 11 Aug 2026cs.CV cs.AIcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Medical visual agents can use tools to inspect images and retrieve external knowledge, but indiscriminate tool use may introduce noisy or misleading evidence. Reliable diagnosis therefore requires not only acquiring additional observations, but also verifying whether tool actions are necessary and whether the resulting evidence supports the current hypothesis. We introduce MIRA (Medical Image Reflection for Agentic Diagnosis), a medical visual diagnostic framework for autonomous evidence search and reflective verification. MIRA dynamically invokes image-processing operations, including zooming, grounding, pointing, rotation, and measurement, as well as web search, while evaluating the relevance and consistency of the acquired evidence. We develop MIRA through a two-stage training strategy. First, a tool-augmented Monte Carlo Tree Search data engine explores diverse diagnostic hypotheses and jointly verifies visual grounding accuracy and semantic consistency to construct supervised fine-tuning trajectories. Second, reinforcement learning further improves decision-making through online reflective principle evolution: failure cases are distilled into candidate principles, and only principles that improve held-out rollout rewards are retained. Across nine medical visual reasoning benchmarks, MIRA achieves an average score of 64.73, improving its Qwen3-VL-8B backbone by 7.44 points. It also increases useful tool-use judgments from 56.2% to 73.8% and reduces harmful judgments from 8.9% to 1.6%. Qualitative analyses show that MIRA can re-examine evidence, correct premature conclusions, and adapt its tool-use strategy. Project page: https://MIRA-VL.github.io/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 41 of its 54 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

41 of 54 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026Meissa: Multi-modal Medical Agentic Intelligence9 Mar
  2. 2026MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learning3 Feb
  3. 2026MEDVISTAGYM: A Scalable Training Environment for Thinking with Medical Images via Tool-Integrated Reinforcement Learning12 Jan

Other references · 38

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  6. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  8. 2025Qwen3-VL Technical Reportcited by 2,793
  9. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  10. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  11. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  12. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
26 more
  1. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  2. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
  3. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  4. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
  5. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
  6. 2025Seed1.5-VL Technical Reportcited by 373
  7. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
  8. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 230
  9. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 224
  10. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
  11. 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 184
  12. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
  13. 2025Thyme: Think Beyond Imagescited by 167
  14. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
  15. 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
  16. 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
  17. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
  18. 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
  19. 2025Latent Visual Reasoningcited by 104
  20. 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Usecited by 90
  21. 2025Thinking with Generated Imagescited by 73
  22. 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Imagescited by 15
  23. 2025MedReasoner: Reinforcement Learning Drives Reasoning Grounding from Clinical Thought to Pixel-Level Precisioncited by 10
  24. 2026MediX-R1: Open Ended Medical Reinforcement Learningcited by 7
  25. 2026MedXIAOHE: A Comprehensive Recipe for Building Medical MLLMscited by 6
  26. 2026MedScope: Incentivizing "Think with Videos" for Clinical Reasoning via Coarse-to-Fine Tool Callingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Inference-Time Agentic Decision Rules Beat Longer Evolving Search for Multi-Image Medical Reasoning
  2. 2026VERITAS: A Multi-Agent Co-Scientist for Verifiable Image-Derived Hypothesis Testing ↗
  3. 2025MedEyes: Learning Dynamic Visual Focus for Medical Progressive Diagnosis
  4. 2026From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning
  5. 2026Route, Retrieve, Reflect, Repair: Self-Improving Agentic Framework for Visual Detection and Linguistic Reasoning in Medical Imaging
  6. 2026Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoning
  7. 2026EVADE: Evidence-Verified Agentic Diagnosis with Escape
  8. 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learning