mlsanityData to 14 Oct 2026

RadAgent: A tool-using AI agent for stepwise interpretation of chest computed tomography

arXiv 2604.15231 ↗First posted 16 Apr 2026cs.AIcited by 6

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

also in 1 more
Abstract (arXiv)

Vision-language models (VLM) have markedly advanced AI-driven interpretation and reporting of complex medical imaging, such as computed tomography (CT). Yet, existing methods largely relegate clinicians to passive observers of final outputs, offering no interpretable reasoning trace for them to inspect, validate, or refine. To address this, we introduce RadAgent, a tool-using AI agent that generates CT reports through a stepwise and interpretable process. Each resulting report is accompanied by a fully inspectable trace of intermediate decisions and tool interactions, allowing clinicians to examine how the reported findings are derived. In our experiments, we observe that RadAgent improves chest CT report generation over its 3D VLM counterpart, CT-Chat, across three dimensions. Clinical accuracy improves by 5.8 points (35.4% relative) in macro-F1 and 5.1 points (18.6% relative) in micro-F1. Robustness under adversarial conditions improves by 24.7 points (41.9% relative). Furthermore, RadAgent achieves 37.0% in faithfulness, a new capability entirely absent in its 3D VLM counterpart. By structuring the interpretation of chest CT as an explicit, tool-augmented and iterative reasoning trace, RadAgent brings us closer toward transparent and reliable AI for radiology.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 23 of its 37 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

23 of 37 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026MedMO: Grounding and Understanding Multimodal Large Language Model for Medical Images6 Feb
  2. 2025Enhancing Radiology Report Generation and Visual Grounding using Reinforcement Learning11 Dec
  3. 2025Large-scale and Fine-grained Vision-language Pre-training for Enhanced CT Image Understanding24 Jan
  4. 2024Merlin: A Computed Tomography Vision-Language Foundation Model and Dataset10 Jun
  5. 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models31 Mar

Other references · 18

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
  5. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
  6. 2025ToolRL: Reward is All Tool Learning Needscited by 362
  7. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 337
  8. 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 199
  9. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 128
  10. 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflowcited by 73
  11. 2025In-the-Flow Agentic System Optimization for Effective Planning and Tool Usecited by 72
  12. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
6 more
  1. 2020Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumescited by 67
  2. 2025CT-Agent: A Multimodal-LLM Agent for 3D CT Radiology Question Answeringcited by 21
  3. 2025A co-evolving agentic AI system for medical imaging analysiscited by 17
  4. 2025Artificial Intelligence Should Genuinely Support Clinical Reasoning and Decision Making To Bridge the Translational Gapcited by 14
  5. 2025Clinical-R1: Empowering Large Language Models for Faithful and Comprehensive Reasoning with Clinical Objective Relative Policy Optimizationcited by 7
  6. 2025MRG-R1: Reinforcement Learning for Clinically Aligned Medical Report Generationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MARCH: Multi-Agent Radiology Clinical Hierarchy for CT Report Generation
  2. 2025RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows
  3. 2024CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting
  4. 2025RadAlign: Advancing Radiology Report Generation with Vision-Language Concept Alignment
  5. 2025RadFabric: Agentic AI System with Reasoning Capability for Radiology
  6. 2026CT-Flow: Orchestrating CT Interpretation Workflow with Model Context Protocol Servers
  7. 2026Route, Retrieve, Reflect, Repair: Self-Improving Agentic Framework for Visual Detection and Linguistic Reasoning in Medical Imaging
  8. 2026NV-Reason-CT: 3D Visual Language Model for CT Analysis