mlsanityData to 14 Oct 2026

Synergistic Perception-Reasoning Governance: Grounding Medical MLLMs with Verifiable Anatomical Evidence

arXiv 2607.00060 ↗First posted 30 Jun 2026cs.CVcited by 0

On the map: LLM reasoning → Hallucination detection and mitigation

also in 1 more
Abstract (arXiv)

Multimodal large language models (MLLMs) show strong promise for clinical VQA and radiology report generation, yet inference-time hallucinations still undermine trustworthy use: models can produce fluent conclusions that conflict with imaging evidence. Existing mitigation strategies typically rely on additional training, external retrieval/knowledge bases, or multi-stage post-hoc verification, which increases cost and pipeline complexity and often generalizes poorly across models and tasks.To address this, we propose a holistic, training-free evidence-injection framework that systematically mitigates hallucinations through dual-side evidence injection. By leveraging ROI priors acquired using MedSAM in our implementation, we recalibrate the visual perception trajectory via ROI-guided activation modulation while anchoring the textual reasoning trajectory by mapping anatomical coordinates into discrete semantic tokens as verifiable external memory. Then we introduce a task-aware dynamic router to select modality-specific interventions based on task semantics, balancing perceptual grounding and linguistic fluency. We conduct systematic evaluations on 2 tasks and 5 datasets using textttLLaVA-1.5-7B, textttLLaVA-Med-1.5-7B, textttQwen3-VL-8B/32B, and textttInternVL-3.5-8B/38B. Controlled ablations and visualizations further validate the framework, which consistently outperforms baselines across medical benchmarks, improving close-ended accuracy by up to ~6%uparrow and reducing open-ended hallucinations by ~35%downarrow. The code has been made available on GitHub: hrefhttps://github.com/Henry991115/SPRGtextcolorbluehttps://github.com/Henry991115/SPRG.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 17 of its 26 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

17 of 26 references.

References · 17

  1. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  2. 2025Qwen3-VL Technical Reportcited by 2,793
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  4. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  5. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 688
  6. 2023OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocationcited by 478
  7. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  8. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
  9. 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 376
  10. 2024Multi-Modal Hallucination Control by Visual Information Groundingcited by 208
  11. 2024Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMscited by 179
  12. 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Modelscited by 61
5 more
  1. 2023LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generationcited by 57
  2. 2024DAMRO: Dive into the Attention Mechanism of LVLM to Reduce Object Hallucinationcited by 48
  3. 2024Don't Miss the Forest for the Trees: Attentional Vision Calibration for Large Vision Language Modelscited by 47
  4. 2025Attention Reallocation: Towards Zero-cost and Controllable Hallucination Mitigation of MLLMscited by 23
  5. 2025MedHEval: Benchmarking Hallucinations and Mitigation Strategies in Medical Large Vision-Language Modelscited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Med-StepBench: A Hierarchical Reasoning Framework for Evaluating Hallucinations in Medical Vision-Language Models
  2. 2025Anatomical Region-Guided Contrastive Decoding: A Plug-and-Play Strategy for Mitigating Hallucinations in Medical VLMs
  3. 2024Combating Multimodal LLM Hallucination via Bottom-Up Holistic Reasoning
  4. 2025MedHallTune: An Instruction-Tuning Benchmark for Mitigating Medical Hallucination in Vision-Language Models
  5. 2026Deterministic Hallucination Detection in Medical VQA via Confidence-Evidence Bayesian Gain
  6. 2025EH-Benchmark Ophthalmic Hallucination Benchmark and Agent-Driven Top-Down Traceable Reasoning Workflow
  7. 2026Kestrel: Grounding Self-Refinement for LVLM Hallucination Mitigation
  8. 2026Toward Guarantees for Clinical Reasoning in Vision Language Models via Formal Verification