Reasoning Visual Language Model for Chest X-Ray Analysis
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings chain-of-thought (CoT) reasoning to chest X-ray interpretation. Inspired by reasoning-first training paradigms, our approach is designed to learn how experts reason, not just what they conclude, by aligning intermediate steps with observable image evidence and radiology workflow. Beyond accuracy, the explicit reasoning traces support clinical auditability: they reveal why a conclusion was reached, which alternatives were considered, and where uncertainty remains, enabling quality assurance, error analysis, and safer human-AI collaboration. Our model couples high-fidelity visual encoding with a two-stage training recipe: a reasoning-style supervised fine-tuning (SFT) followed by reinforcement learning (RL) that uses verifiable rewards over a list of X-ray abnormalities. The model outputs reasoning that mirrors radiologists systematic thought process, uncertainty, and differential diagnosis. In out-of-distribution evaluation, the approach achieves competitive multi-label classification while improving interpretability. In a reader study with expert radiologists, full reasoning traces increased confidence, supported error auditing, and reduced time to finalize reports. We release code and the model NV-Reason-CXR-3B to support community progress toward trustworthy, explainable AI in chest radiography and other medical imaging tasks where reasoning quality is as critical as prediction quality.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 13 of its 38 references that are in the map. First posted on arXiv 28 Oct 2025.
Builds on
13 of 38 references.
References · 13
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
- 2025MedGemma Technical Reportcited by 398
- 2024Capabilities of Gemini Models in Medicinecited by 231
- 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
1 more
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretationcited by 4
- 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gainscited by 2
- 2026CheXthought: A global multimodal dataset of clinical chain-of-thought reasoning and visual attention for chest X-ray interpretationcited by 2
- 2026CheXpercept: A Benchmark for Evaluating Expert-Level Lesion Perception in Chest X-rayscited by 1
- 2025Benchmark Success, Clinical Failure: When Reinforcement Learning Optimizes for Benchmarks, Not Patientscited by 0
- 2026SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generationcited by 0
- 2026Positive-Unlabeled Preference Optimization For Chest X-ray Report Generationcited by 0
- 2026NV-Reason-CT: 3D Visual Language Model for CT Analysiscited by 0
- 2026NV-Reason-CT: 3D Visual Language Model for CT Analysis23 Sep 2026
- 2026Positive-Unlabeled Preference Optimization For Chest X-ray Report Generation5 Aug 2026
- 2026SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generation29 Jun 2026
- 2026CheXpercept: A Benchmark for Evaluating Expert-Level Lesion Perception in Chest X-rays19 Jun 2026
- 2026CheXthought: A global multimodal dataset of clinical chain-of-thought reasoning and visual attention for chest X-ray interpretation29 Apr 2026
- 2026A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation1 Apr 2026
- 2026When Does RL Help Medical VLMs? Disentangling Vision, SFT, and RL Gains1 Mar 2026
- 2025Benchmark Success, Clinical Failure: When Reinforcement Learning Optimizes for Benchmarks, Not Patients28 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025X-Ray-CoT: Interpretable Chest X-ray Diagnosis with Vision-Language Models via Chain-of-Thought Reasoning
- 2026Enhancing Visual Reasoning in Chest X-Ray Report Generation Using Reinforcement Learning
- 2025ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step Verification
- 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learning
- 2024CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting
- 2025Enhancing Radiology Report Generation and Visual Grounding using Reinforcement Learning
- 2025Evaluating Reasoning Faithfulness in Medical Vision-Language Models using Multimodal Perturbations
- 2026Toward Guarantees for Clinical Reasoning in Vision Language Models via Formal Verification