mlsanityData to 14 Oct 2026

E-MRL: Cross-view Aligned Evidence-driven Multimodal Reinforcement Learning for Reliable 3D Tumor Analysis

arXiv 2606.23888 ↗First posted 22 Jun 2026eess.IV cs.AI cs.CVcited by 4

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

also in 1 more
Abstract (arXiv)

While Vision-Language Models (VLMs) show great promise in volumetric medical report generation, they frequently suffer from visual hallucinations and a lack of grounding in 3D CT data. Current Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) strategies typically optimize text fidelity alone, essentially rewarding correct diagnoses derived from language priors rather than genuine visual perception. To address this, we propose cross-view aligned Evidence-driven Multimodal Reinforcement Learning (Evidence-MRL, noted as E-MRL), a reliable RL reasoning framework that formulates the generation process as a Markov Decision Process of "diagnosis-localization-verification". Unlike standard approaches, our model is explicitly trained to identify a "key evidence slice" alongside the global diagnostic report, grounding its findings in verifiable visual evidence. Crucially, we introduce a novel cross-view consistency reward, which validates the semantic alignment between the golden-standard report and a local visual re-query of the selected key slice, providing additional rewards for correctly-localized reasoning. Experiments on large-scale 3D CT tumor datasets demonstrate that E-MRL significantly reduces hallucinations and improves diagnostic accuracy compared to SFT and RL baselines, offering a clinically interpretable solution for visually-grounded and tumor analysis.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 16 of its 33 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

16 of 33 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Images6 Feb
  2. 2026Med3D-R1: Incentivizing Clinical Reasoning in 3D Medical Vision-Language Models for Abnormality Diagnosis1 Feb
  3. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
  4. 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning31 May
  5. 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation14 Feb
  6. 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models31 Mar

Other references · 10

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  4. 2025MedGemma Technical Reportcited by 436
  5. 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 102
  6. 2025Real-World Doctor Agent with Proactive Consultation through Multi-Agent Reinforcement Learningcited by 27
  7. 2025MedVLThinker: Simple Baselines for Multimodal Medical Reasoningcited by 27
  8. 2026OmniCT: Towards a Unified Slice-Volume LVLM for Comprehensive CT Analysiscited by 10
  9. 2026CtrlCoT: Dual-Granularity Chain-of-Thought Compression for Controllable Reasoningcited by 7
  10. 2026DIYHealth Suite: Dataset, Model, and Benchmark for Health Management at Homecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MedScribe: Clinically Grounded CT Reporting through Agentic Workflows
  2. 2026Mr3D-VL: A generalist vision language foundation model for Multiparametric 3D Magnetic Resonance Imaging
  3. 2025MedVista3D: Vision-Language Modeling for Reducing Diagnostic Errors in 3D CT Disease Detection, Understanding and Reporting
  4. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning
  5. 20263DMedAgent: Unified Perception-to-Understanding for 3D Medical Analysis
  6. 2025MedReason-R1: Learning to Reason for CT Diagnosis with Reinforcement Learning and Local Zoom
  7. 2025MRG-R1: Reinforcement Learning for Clinically Aligned Medical Report Generation
  8. 2025RL4Med-DDPO: Reinforcement Learning for Controlled Guidance Towards Diverse Medical Image Generation using Vision-Language Foundation Models