mlsanityData to 14 Oct 2026

RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows

arXiv 2509.20490 ↗First posted 24 Sep 2025cs.MA cs.CL cs.CVcited by 8

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Agentic systems offer a potential path to solve complex clinical tasks through collaboration among specialized agents, augmented by tool use and external knowledge bases. Nevertheless, for chest X-ray (CXR) interpretation, prevailing methods remain limited: (i) reasoning is frequently neither clinically interpretable nor aligned with guidelines, reflecting mere aggregation of tool outputs; (ii) multimodal evidence is insufficiently fused, yielding text-only rationales that are not visually grounded; and (iii) systems rarely detect or resolve cross-tool inconsistencies and provide no principled verification mechanisms. To bridge the above gaps, we present RadAgents, a multi-agent framework that couples clinical priors with task-aware multimodal reasoning and encodes a radiologist-style workflow into a modular, auditable pipeline. In addition, we integrate grounding and multimodal retrieval-augmentation to verify and resolve context conflicts, resulting in outputs that are more reliable, transparent, and consistent with clinical practice.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 35 of its 48 references that are in the map. First posted on arXiv 24 Sep 2025.

Builds on

35 of 48 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agent2 Jul
  2. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments13 May

Other references · 33

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
  6. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
  7. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
  8. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  9. 2025MedGemma Technical Reportcited by 436
  10. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
  11. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
  12. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 337
21 more
  1. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
  2. 2023Towards Generalist Biomedical AIcited by 289
  3. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 211
  4. 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
  5. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
  6. 2024MAIRA-2: Grounded Radiology Report Generationcited by 145
  7. 2024Exploring scalable medical image encoders beyond text supervisioncited by 132
  8. 2021TorchXRayVision: A library of chest X-ray datasets and modelscited by 131
  9. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 128
  10. 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 106
  11. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 86
  12. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 70
  13. 2025OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoningcited by 69
  14. 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
  15. 2024VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledgecited by 50
  16. 2023Accurate Fine-Grained Segmentation of Human Anatomy in Radiographs via Volumetric Pseudo-Labelingcited by 26
  17. 2023Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reportingcited by 18
  18. 2025Reducing Hallucinations of Medical Multimodal Large Language Models with Visual Retrieval-Augmented Generationcited by 8
  19. 2025RadFabric: Agentic AI System with Reasoning Capability for Radiologycited by 7
  20. 2025Scaling Up Biomedical Vision-Language Models: Fine-Tuning, Instruction Tuning, and Multi-Modal Learningcited by 6
  21. 2025CXReasonBench: A Benchmark for Evaluating Structured Diagnostic Reasoning in Chest X-rayscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025CXRAgent: Director-Orchestrated Multi-Stage Reasoning for Chest X-Ray Interpretation
  2. 2026CXReasonAgent: Evidence-Grounded Diagnostic Reasoning Agent for Chest X-rays
  3. 2026XrayClaw: Cooperative-Competitive Multi-Agent Alignment for Trustworthy Chest X-ray Diagnosis
  4. 2025PASS: Probabilistic Agentic Supernet Sampling for Interpretable and Adaptive Chest X-Ray Reasoning
  5. 2026AgentsEval: Clinically Faithful Evaluation of Medical Imaging Reports via Multi-Agent Reasoning
  6. 2026Which Tool Response Should I Trust? Tool-Expertise-Aware Chest X-ray Agent with Multimodal Agentic Learning
  7. 2026X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray Reasoning
  8. 2024CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting