RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Agentic systems offer a potential path to solve complex clinical tasks through collaboration among specialized agents, augmented by tool use and external knowledge bases. Nevertheless, for chest X-ray (CXR) interpretation, prevailing methods remain limited: (i) reasoning is frequently neither clinically interpretable nor aligned with guidelines, reflecting mere aggregation of tool outputs; (ii) multimodal evidence is insufficiently fused, yielding text-only rationales that are not visually grounded; and (iii) systems rarely detect or resolve cross-tool inconsistencies and provide no principled verification mechanisms. To bridge the above gaps, we present RadAgents, a multi-agent framework that couples clinical priors with task-aware multimodal reasoning and encodes a radiologist-style workflow into a modular, auditable pipeline. In addition, we integrate grounding and multimodal retrieval-augmentation to verify and resolve context conflicts, resulting in outputs that are more reliable, transparent, and consistent with clinical practice.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 35 of its 48 references that are in the map. First posted on arXiv 24 Sep 2025.
Builds on
35 of 48 references.
Closest ancestors · 2
Same direction, newest first
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agent2 Jul
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments13 May
Other references · 33
- 2023GPT-4 Technical Reportcited by 18,396
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024GPT-4o System Cardcited by 4,588
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2025MedGemma Technical Reportcited by 436
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
- 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 337
21 more
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
- 2023Towards Generalist Biomedical AIcited by 289
- 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 211
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
- 2024MAIRA-2: Grounded Radiology Report Generationcited by 145
- 2024Exploring scalable medical image encoders beyond text supervisioncited by 132
- 2021TorchXRayVision: A library of chest X-ray datasets and modelscited by 131
- 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 128
- 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 106
- 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
- 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
- 2025OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoningcited by 69
- 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
- 2024VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledgecited by 50
- 2023Accurate Fine-Grained Segmentation of Human Anatomy in Radiographs via Volumetric Pseudo-Labelingcited by 26
- 2023Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reportingcited by 18
- 2025Reducing Hallucinations of Medical Multimodal Large Language Models with Visual Retrieval-Augmented Generationcited by 8
- 2025RadFabric: Agentic AI System with Reasoning Capability for Radiologycited by 7
- 2025Scaling Up Biomedical Vision-Language Models: Fine-Tuning, Instruction Tuning, and Multi-Modal Learningcited by 6
- 2025CXReasonBench: A Benchmark for Evaluating Structured Diagnostic Reasoning in Chest X-rayscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
- 2025Unsupervised Deep Generative Models for Anomaly Detection in Neuroimaging: A Systematic Scoping Reviewcited by 1
- 2026Multi-Modal Multi-Agent Reinforcement Learning for Radiology Report Generationcited by 1
- 2026MedGPT-oss: Training a General-Purpose Vision-Language Model for Biomedicinecited by 0
- 2026Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretationcited by 0
- 2026VLM- and LLM-Driven Multi-Agent System for PET Image Denoisingcited by 0
- 2026MammoClaw: Towards Skill-Evolving Agent Harness for Breast Cancer Mammography Analysiscited by 0
- 2026From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoningcited by 0
- 2026From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning30 Sep 2026
- 2026MammoClaw: Towards Skill-Evolving Agent Harness for Breast Cancer Mammography Analysis25 Sep 2026
- 2026VLM- and LLM-Driven Multi-Agent System for PET Image Denoising13 Aug 2026
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy13 Jul 2026
- 2026Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation30 Apr 2026
- 2026MedGPT-oss: Training a General-Purpose Vision-Language Model for Biomedicine1 Mar 2026
- 2026Multi-Modal Multi-Agent Reinforcement Learning for Radiology Report Generation17 Feb 2026
- 2025Unsupervised Deep Generative Models for Anomaly Detection in Neuroimaging: A Systematic Scoping Review16 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025CXRAgent: Director-Orchestrated Multi-Stage Reasoning for Chest X-Ray Interpretation
- 2026CXReasonAgent: Evidence-Grounded Diagnostic Reasoning Agent for Chest X-rays
- 2026XrayClaw: Cooperative-Competitive Multi-Agent Alignment for Trustworthy Chest X-ray Diagnosis
- 2025PASS: Probabilistic Agentic Supernet Sampling for Interpretable and Adaptive Chest X-Ray Reasoning
- 2026AgentsEval: Clinically Faithful Evaluation of Medical Imaging Reports via Multi-Agent Reasoning
- 2026Which Tool Response Should I Trust? Tool-Expertise-Aware Chest X-ray Agent with Multimodal Agentic Learning
- 2026X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray Reasoning
- 2024CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting