When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Models
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Vision-Language Models (VLMs) have enabled interpretable medical diagnosis by integrating visual perception with linguistic reasoning. Yet, existing medical chain-of-thought (CoT) models lack explicit mechanisms to represent and enforce causal reasoning, leaving them vulnerable to spurious correlations and limiting their clinical reliability. We pinpoint three core challenges in medical CoT reasoning: how to adaptively trigger causal correction, construct high-quality causal-spurious contrastive samples, and maintain causal consistency across reasoning trajectories. To address these challenges, we propose MedCausalX, an end-to-end framework explicitly models causal reasoning chains in medical VLMs. We first introduce the CRMed dataset providing fine-grained anatomical annotations, structured causal reasoning chains, and counterfactual variants that guide the learning of causal relationships beyond superficial correlations. Building upon CRMed, MedCausalX employs a two-stage adaptive reflection architecture equipped with langlecausalrangle and langleverifyrangle tokens, enabling the model to autonomously determine when and how to perform causal analysis and verification. Finally, a trajectory-level causal correction objective optimized through error-attributed reinforcement learning refines the reasoning chain, allowing the model to distinguish genuine causal dependencies from shortcut associations. Extensive experiments on multiple benchmarks show that MedCausalX consistently outperforms state-of-the-art methods, improving diagnostic consistency by +5.4 points, reducing hallucination by over 10 points, and attaining top spatial grounding IoU, thereby setting a new standard for causally grounded medical reasoning. The code and dataset are available at https://github.com/zhcz328/MedCausalX.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 58 of its 109 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
58 of 109 references.
Closest ancestors · 3
Same direction, newest first
- 2026Gastric-X: A Multimodal Multi-Phase Benchmark Dataset for Advancing Vision-Language Models in Gastric Cancer Analysis19 Mar
- 2026NeuroSymb-MRG: Differentiable Abductive Reasoning with Active Uncertainty Minimization for Radiology Report Generation2 Mar
- 2025Med-CMR: A Fine-Grained Benchmark Integrating Visual Evidence and Clinical Logic for Medical Complex Multimodal Reasoning30 Nov
Other references · 55
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
38 more
- 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
- 2024Chain-of-Thought Reasoning Without Promptingcited by 208
- 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 194
- 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2024Improve Vision Language Model Chain-of-thought Reasoningcited by 135
- 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 96
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 80
- 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Modelcited by 56
- 2023SA-Med2D-20M Dataset: Segment Anything in 2D Medical Imaging with 20 Million maskscited by 54
- 2023Toward Understanding Why Adam Converges Faster Than SGD for Transformerscited by 50
- 2025The Choice of Divergence: A Neglected Key to Mitigating Diversity Collapse in Reinforcement Learning with Verifiable Rewardcited by 36
- 2024GSCo: Towards Generalizable AI in Medicine via Generalist-Specialist Collaborationcited by 33
- 2026Your Group-Relative Advantage Is Biasedcited by 32
- 2025Exploring Efficient Open-Vocabulary Segmentation in the Remote Sensingcited by 31
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2023Advancing Medical Imaging with Language Models: A Journey from N-grams to ChatGPTcited by 28
- 2026Look Inward to Explore Outward: Learning Temperature Policy from LLM Internal States via Hierarchical RLcited by 27
- 2024Interpretable Bilingual Multimodal Large Language Model for Diverse Biomedical Taskscited by 24
- 2025CodeV: Code with Images for Faithful Visual Reasoning via Tool-Aware Policy Optimizationcited by 24
- 2025GaussianDWM: 3D Gaussian Driving World Model for Unified Scene Understanding and Multi-Modal Generationcited by 23
- 2025Bottom-up Policy Optimization: Your Language Model Policy Secretly Contains Internal Policiescited by 22
- 2026EvoTool: Self-Evolving Tool-Use Policy Optimization in LLM Agents via Blame-Aware Mutation and Diversity-Aware Selectioncited by 22
- 2026Thinking with Blueprints: Assisting Vision-Language Models in Spatial Reasoning via Structured Object Representationcited by 21
- 2020Pathological Visual Question Answeringcited by 18
- 2025CATP: Contextually Adaptive Token Pruning for Efficient and Enhanced Multimodal In-Context Learningcited by 18
- 2024On the Intrinsic Self-Correction Capability of LLMs: Uncertainty and Latent Conceptcited by 16
- 2025MARIS: Marine Open-Vocabulary Instance Segmentation with Geometric Enhancement and Semantic Alignmentcited by 14
- 2026Automated Optimization Modeling via a Localizable Error-Driven Perspectivecited by 14
- 2025TIC-GRPO: Provable and Efficient Optimization for Reinforcement Learning from Human Feedbackcited by 11
- 2025MMT-ARD: Multimodal Multi-Teacher Adversarial Distillation for Robust Vision-Language Modelscited by 11
- 2026CDRRM: Contrast-Driven Rubric Generation for Reliable and Interpretable Reward Modelingcited by 10
- 2025MedReflect: Teaching Medical LLMs to Self-Improve via Reflective Correctioncited by 8
- 2026PRPO: Aligning Process Reward with Outcome Reward in Policy Optimizationcited by 7
- 2025Self-Taught Self-Correction for Small Language Modelscited by 5
- 2026Unified Thinker: A General Reasoning Modular Core for Image Generationcited by 5
- 2025CARE What Fails: Contrastive Anchored-REflection for Verifiable Multimodal Reasoningcited by 4
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Beyond Accuracy: Measuring Bias Acknowledgment in Chain-of-Thought Reasoning for Responsible AI Evaluationcited by 8
- 2026Driver-WM: A Driver-Centric Traffic-Conditioned Latent World Model for In-Cabin Dynamics Rolloutcited by 6
- 2026What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoningcited by 4
- 2026Dynamic Model Merging Made Slimcited by 1
- 2026TopoAgent: An Agentic Framework for Automated Topology Learning in Medical Imagingcited by 0
- 2026TopoAgent: An Agentic Framework for Automated Topology Learning in Medical Imaging29 Jun 2026
- 2026Beyond Accuracy: Measuring Bias Acknowledgment in Chain-of-Thought Reasoning for Responsible AI Evaluation13 Jun 2026
- 2026Dynamic Model Merging Made Slim17 May 2026
- 2026Driver-WM: A Driver-Centric Traffic-Conditioned Latent World Model for In-Cabin Dynamics Rollout6 May 2026
- 2026What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoning8 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Making medical vision-language models think causally across modalities with retrieval-augmented cross-modal reasoning
- 2026Position, Not Provenance: Separating Reasoning Mediation from Sycophancy in Medical Vision-Language Models
- 2026ClinCoT: Clinical-Aware Visual Chain-of-Thought for Medical Vision Language Models
- 2026The Abstraction Gap in Vision-Language Causal Reasoning
- 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning
- 2026Med-OPD: Improving Medical Vision-Language Models via Evidence-Aware On-Policy Distillation
- 2026CRAFT: Causal Responsibility and Failure Tracing in Medical Vision Language Models
- 2026M3CoTBench: Benchmark Chain-of-Thought of MLLMs in Medical Image Understanding