X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray Reasoning
Not on the map. Why?
Abstract (arXiv)
Chest X-ray (CXR) interpretation often requires integrating visual findings with task-specific evidence rather than relying on direct visual recognition alone. While tool-augmented medical agents can supply such evidence via external modules, they often lack explicit mechanisms for learning when auxiliary evidence is needed and for preventing inapplicable quantitative evidence from entering diagnostic reasoning. To address this, we propose X-Ragent, a post-training framework for tool-augmented reinforcement learning that decouples learned auxiliary-evidence seeking from validity-gated quantitative measurement acquisition for evidence-grounded CXR reasoning. We construct Rad-CoT, a 7.7K-sample corpus combining causally ordered tool-augmented trajectories with report-style diagnostic reasoning, and use it to initialize Qwen3-VL-8B via agentic supervised fine-tuning (SFT). We then optimize the policy with Group Relative Policy Optimization (GRPO) using an accuracy-gated reward that applies process-level terms for measurement consistency and auxiliary-tool cost only to correct trajectories, preventing plausible process behavior from compensating for an incorrect diagnosis. Across three CXR benchmarks, X-Ragent achieves the strongest results, including an 8.6-point improvement on the fully held-out ChestAgentBench. By seeking evidence selectively and admitting only valid measurements, X-Ragent supports more faithful and evidence-grounded CXR reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 74 of its 88 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
74 of 88 references.
References · 74
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2022Uncertainty Modeling for Out-of-Distribution Generalizationcited by 125
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 111
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 109
38 more
- 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 95
- 2024DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perceptioncited by 73
- 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
- 2025PRISM: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selectioncited by 61
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
- 2025Enhanced Contrastive Learning with Multi-view Longitudinal Data for Chest X-ray Report Generationcited by 42
- 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 41
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 36
- 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Drivingcited by 34
- 2022mc-BEiT: Multi-choice Discretization for Image BERT Pre-trainingcited by 31
- 2025ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step Verificationcited by 31
- 2024GEMeX: A Large-Scale, Groundable, and Explainable Medical VQA Benchmark for Chest X-ray Diagnosiscited by 29
- 2023Accurate Fine-Grained Segmentation of Human Anatomy in Radiographs via Volumetric Pseudo-Labelingcited by 26
- 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Toolscited by 26
- 2025From Editor to Dense Geometry Estimatorcited by 24
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Surveycited by 23
- 2025Reward and Guidance through Rubrics: Promoting Exploration to Improve Multi-Domain Reasoningcited by 21
- 2024SD-MVS: Segmentation-Driven Deformation Multi-View Stereo with Spherical Refinement and EM optimizationcited by 19
- 2023Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reportingcited by 18
- 2023Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learningcited by 17
- 2024MSP-MVS: Multi-Granularity Segmentation Prior Guided Multi-View Stereocited by 17
- 2024M4CXR: Exploring Multi-task Potentials of Multi-modal Large Language Models for Chest X-ray Interpretationcited by 17
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 17
- 2025RefineX: Learning to Refine Pre-training Data at Scale from Expert-Guided Programscited by 17
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 17
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 15
- 2024γ-MoD: Exploring Mixture-of-Depth Adaptation for Multimodal Large Language Modelscited by 14
- 2025Layout2Scene: 3D Semantic Layout Guided Scene Generation via Geometry and Appearance Diffusion Priorscited by 13
- 2025Think Twice to See More: Iterative Visual Reasoning in Medical VLMscited by 13
- 2024FactCheXcker: Mitigating Measurement Hallucinations in Chest X-ray Report Generation Modelscited by 12
- 2024GradiSeg: Gradient-Guided Gaussian Segmentation with Enhanced 3D Boundary Precisioncited by 12
- 2024DVP-MVS: Synergize Depth-Edge and Visibility Prior for Multi-View Stereocited by 12
- 2023Exploring Model Transferability through the Lens of Potential Energycited by 11
- 2025SED-MVS: Segmentation-Driven and Edge-Aligned Deformation Multi-View Stereo with Depth Restoration and Occlusion Constraintcited by 11
- 2025Ophiuchus: Incentivizing Tool-augmented "Think with Images" for Joint Medical Segmentation, Understanding and Reasoningcited by 10
- 2023TSAR-MVS: Textureless-aware Segmentation and Correlative Refinement Guided Multi-View Stereocited by 9
- 2026AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Designcited by 9
- 2026What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generationcited by 8
50 most cited of 74 All 74 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing Radiology Report Generation and Visual Grounding using Reinforcement Learning
- 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learning
- 2025Toward Clinically Explainable AI for Medical Diagnosis: A Foundation Model with Human-Compatible Reasoning via Reinforcement Learning
- 2025RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows
- 2026Enhancing Visual Reasoning in Chest X-Ray Report Generation Using Reinforcement Learning
- 2025CXRAgent: Director-Orchestrated Multi-Stage Reasoning for Chest X-Ray Interpretation
- 2026Which Tool Response Should I Trust? Tool-Expertise-Aware Chest X-ray Agent with Multimodal Agentic Learning
- 2023Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generation