mlsanityData to 14 Oct 2026

X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray Reasoning

arXiv 2610.16811 ↗First posted 12 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Chest X-ray (CXR) interpretation often requires integrating visual findings with task-specific evidence rather than relying on direct visual recognition alone. While tool-augmented medical agents can supply such evidence via external modules, they often lack explicit mechanisms for learning when auxiliary evidence is needed and for preventing inapplicable quantitative evidence from entering diagnostic reasoning. To address this, we propose X-Ragent, a post-training framework for tool-augmented reinforcement learning that decouples learned auxiliary-evidence seeking from validity-gated quantitative measurement acquisition for evidence-grounded CXR reasoning. We construct Rad-CoT, a 7.7K-sample corpus combining causally ordered tool-augmented trajectories with report-style diagnostic reasoning, and use it to initialize Qwen3-VL-8B via agentic supervised fine-tuning (SFT). We then optimize the policy with Group Relative Policy Optimization (GRPO) using an accuracy-gated reward that applies process-level terms for measurement consistency and auxiliary-tool cost only to correct trajectories, preventing plausible process behavior from compensating for an incorrect diagnosis. Across three CXR benchmarks, X-Ragent achieves the strongest results, including an 8.6-point improvement on the fully held-out ChestAgentBench. By seeking evidence selectively and admitting only valid measurements, X-Ragent supports more faithful and evidence-grounded CXR reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 74 of its 88 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

74 of 88 references.

References · 74

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  6. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  7. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  8. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
  9. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  10. 2022Uncertainty Modeling for Out-of-Distribution Generalizationcited by 125
  11. 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 111
  12. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 109
38 more
  1. 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 95
  2. 2024DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perceptioncited by 73
  3. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
  4. 2025PRISM: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selectioncited by 61
  5. 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 49
  6. 2025Enhanced Contrastive Learning with Multi-view Longitudinal Data for Chest X-ray Report Generationcited by 42
  7. 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 41
  8. 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 36
  9. 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Drivingcited by 34
  10. 2022mc-BEiT: Multi-choice Discretization for Image BERT Pre-trainingcited by 31
  11. 2025ChestX-Reasoner: Advancing Radiology Foundation Models with Reasoning through Step-by-Step Verificationcited by 31
  12. 2024GEMeX: A Large-Scale, Groundable, and Explainable Medical VQA Benchmark for Chest X-ray Diagnosiscited by 29
  13. 2023Accurate Fine-Grained Segmentation of Human Anatomy in Radiographs via Volumetric Pseudo-Labelingcited by 26
  14. 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Toolscited by 26
  15. 2025From Editor to Dense Geometry Estimatorcited by 24
  16. 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Surveycited by 23
  17. 2025Reward and Guidance through Rubrics: Promoting Exploration to Improve Multi-Domain Reasoningcited by 21
  18. 2024SD-MVS: Segmentation-Driven Deformation Multi-View Stereo with Spherical Refinement and EM optimizationcited by 19
  19. 2023Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reportingcited by 18
  20. 2023Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learningcited by 17
  21. 2024MSP-MVS: Multi-Granularity Segmentation Prior Guided Multi-View Stereocited by 17
  22. 2024M4CXR: Exploring Multi-task Potentials of Multi-modal Large Language Models for Chest X-ray Interpretationcited by 17
  23. 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 17
  24. 2025RefineX: Learning to Refine Pre-training Data at Scale from Expert-Guided Programscited by 17
  25. 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 17
  26. 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 15
  27. 2024γ-MoD: Exploring Mixture-of-Depth Adaptation for Multimodal Large Language Modelscited by 14
  28. 2025Layout2Scene: 3D Semantic Layout Guided Scene Generation via Geometry and Appearance Diffusion Priorscited by 13
  29. 2025Think Twice to See More: Iterative Visual Reasoning in Medical VLMscited by 13
  30. 2024FactCheXcker: Mitigating Measurement Hallucinations in Chest X-ray Report Generation Modelscited by 12
  31. 2024GradiSeg: Gradient-Guided Gaussian Segmentation with Enhanced 3D Boundary Precisioncited by 12
  32. 2024DVP-MVS: Synergize Depth-Edge and Visibility Prior for Multi-View Stereocited by 12
  33. 2023Exploring Model Transferability through the Lens of Potential Energycited by 11
  34. 2025SED-MVS: Segmentation-Driven and Edge-Aligned Deformation Multi-View Stereo with Depth Restoration and Occlusion Constraintcited by 11
  35. 2025Ophiuchus: Incentivizing Tool-augmented "Think with Images" for Joint Medical Segmentation, Understanding and Reasoningcited by 10
  36. 2023TSAR-MVS: Textureless-aware Segmentation and Correlative Refinement Guided Multi-View Stereocited by 9
  37. 2026AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Designcited by 9
  38. 2026What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generationcited by 8

50 most cited of 74 All 74 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Enhancing Radiology Report Generation and Visual Grounding using Reinforcement Learning
  2. 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learning
  3. 2025Toward Clinically Explainable AI for Medical Diagnosis: A Foundation Model with Human-Compatible Reasoning via Reinforcement Learning
  4. 2025RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows
  5. 2026Enhancing Visual Reasoning in Chest X-Ray Report Generation Using Reinforcement Learning
  6. 2025CXRAgent: Director-Orchestrated Multi-Stage Reasoning for Chest X-Ray Interpretation
  7. 2026Which Tool Response Should I Trust? Tool-Expertise-Aware Chest X-ray Agent with Multimodal Agentic Learning
  8. 2023Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generation