E-MRL: Cross-view Aligned Evidence-driven Multimodal Reinforcement Learning for Reliable 3D Tumor Analysis
On the map: Multimodal LLMs / vision-language models → Medical vision-language models
Abstract (arXiv)
While Vision-Language Models (VLMs) show great promise in volumetric medical report generation, they frequently suffer from visual hallucinations and a lack of grounding in 3D CT data. Current Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) strategies typically optimize text fidelity alone, essentially rewarding correct diagnoses derived from language priors rather than genuine visual perception. To address this, we propose cross-view aligned Evidence-driven Multimodal Reinforcement Learning (Evidence-MRL, noted as E-MRL), a reliable RL reasoning framework that formulates the generation process as a Markov Decision Process of "diagnosis-localization-verification". Unlike standard approaches, our model is explicitly trained to identify a "key evidence slice" alongside the global diagnostic report, grounding its findings in verifiable visual evidence. Crucially, we introduce a novel cross-view consistency reward, which validates the semantic alignment between the golden-standard report and a local visual re-query of the selected key slice, providing additional rewards for correctly-localized reasoning. Experiments on large-scale 3D CT tumor datasets demonstrate that E-MRL significantly reduces hallucinations and improves diagnostic accuracy compared to SFT and RL baselines, offering a clinically interpretable solution for visually-grounded and tumor analysis.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 16 of its 33 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
16 of 33 references.
Closest ancestors · 6
Same direction, newest first
- 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Images6 Feb
- 2026Med3D-R1: Incentivizing Clinical Reasoning in 3D Medical Vision-Language Models for Abnormality Diagnosis1 Feb
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
- 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning31 May
- 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation14 Feb
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models31 Mar
Other references · 10
- 2025Qwen3 Technical Reportcited by 8,820
- 2024GPT-4o System Cardcited by 4,588
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2025MedGemma Technical Reportcited by 436
- 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 102
- 2025Real-World Doctor Agent with Proactive Consultation through Multi-Agent Reinforcement Learningcited by 27
- 2025MedVLThinker: Simple Baselines for Multimodal Medical Reasoningcited by 27
- 2026OmniCT: Towards a Unified Slice-Volume LVLM for Comprehensive CT Analysiscited by 10
- 2026CtrlCoT: Dual-Granularity Chain-of-Thought Compression for Controllable Reasoningcited by 7
- 2026DIYHealth Suite: Dataset, Model, and Benchmark for Health Management at Homecited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026CARVE: Cross-Slice Anisotropic Reallocation of Visual Evidence for Efficient 3D Medical Volume Understandingcited by 0
- 2026Holtercare-Bench: A Multimodal Benchmark for Evaluating Long-Term Dynamic ECG Analysiscited by 0
- 2026Volumetric Radiology AI in the Era of Multimodal Large Language Modelscited by 0
- 2026ReVision3D: Attribution-Guided Recursive Self-Improvement for 3D Medical Perceptioncited by 0
- 2026ReVision3D: Attribution-Guided Recursive Self-Improvement for 3D Medical Perception26 Sep 2026
- 2026Volumetric Radiology AI in the Era of Multimodal Large Language Models20 Aug 2026
- 2026Holtercare-Bench: A Multimodal Benchmark for Evaluating Long-Term Dynamic ECG Analysis19 Aug 2026
- 2026CARVE: Cross-Slice Anisotropic Reallocation of Visual Evidence for Efficient 3D Medical Volume Understanding5 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026MedScribe: Clinically Grounded CT Reporting through Agentic Workflows
- 2026Mr3D-VL: A generalist vision language foundation model for Multiparametric 3D Magnetic Resonance Imaging
- 2025MedVista3D: Vision-Language Modeling for Reducing Diagnostic Errors in 3D CT Disease Detection, Understanding and Reporting
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning
- 20263DMedAgent: Unified Perception-to-Understanding for 3D Medical Analysis
- 2025MedReason-R1: Learning to Reason for CT Diagnosis with Reinforcement Learning and Local Zoom
- 2025MRG-R1: Reinforcement Learning for Clinically Aligned Medical Report Generation
- 2025RL4Med-DDPO: Reinforcement Learning for Controlled Guidance Towards Diverse Medical Image Generation using Vision-Language Foundation Models