mlsanityData to 7 Oct 2026

Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translation

arXiv 2607.25489 ↗First posted 28 Jul 2026cs.CVcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Large language models and multimodal foundation models are enabling medical artificial intelligence (AI) systems to move beyond isolated prediction and undertake multistep clinical tasks that require planning, tool use, memory, iterative correction, and coordination among specialized agents. However, the scope of agentic AI in medicine remains unsettled, and current evaluation practices are not yet aligned with the requirements of clinical use. We conducted a scoping review with systematic evidence mapping across five electronic sources, screened 1,649 exportable records, and provisionally included 557 unique studies that met predefined criteria for goal-directed task execution, tool use, interaction with external resources, feedback-based refinement, or multi-agent collaboration. The included studies describe single agents that use external tools, workflows supported by retrieval and external knowledge, multimodal agents, and multi-agent systems applied to medical question answering, image interpretation, electronic health record analysis, drug safety, and clinical trial prediction. The evidence base remains dominated by public benchmarks, simulated settings, retrospective datasets, and small-scale expert evaluation. Process reliability, evidence traceability, uncertainty, safety, workflow impact, and external validity are evaluated less consistently. Clinical translation will depend on clearer definitions, reproducible evaluation, auditable oversight, interoperable system design, and prospective validation in real-world clinical workflows.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 56 of its 107 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

56 of 107 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026Agentic AI in Healthcare & Medicine: A Seven-Dimensional Taxonomy for Empirical Evaluation of LLM-based Agents4 Feb
  2. 2025AT-CXR: Uncertainty-Aware Agentic Triage for Chest X-rays26 Aug
  3. 2025MedAgentBoard: Benchmarking Multi-Agent Collaboration with Conventional Methods for Diverse Medical Tasks18 May
  4. 2024Rx Strategist: Prescription Verification using LLM Agents System5 Sep
  5. 2024MALADE: Orchestration of LLM-powered Agents with Retrieval Augmented Generation for Pharmacovigilance3 Aug
  6. 2024CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting11 Jul
  7. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agent2 Jul
  8. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agents5 May
  9. 2024ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoning23 Apr
  10. 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator15 Feb

Other references · 46

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2023Segment Anythingcited by 8,158
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2017On Calibration of Modern Neural Networkscited by 4,860
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  8. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  10. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  11. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  12. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
34 more
  1. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  2. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  3. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  4. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  5. 2017Constrained Policy Optimizationcited by 928
  6. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  7. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  8. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  9. 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 636
  10. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  11. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
  12. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
  13. 2019Measuring Calibration in Deep Learningcited by 443
  14. 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
  15. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  16. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
  17. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  18. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
  19. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
  20. 2023Towards Generalist Biomedical AIcited by 286
  21. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 236
  22. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
  23. 2022Can large language models reason about medical questions?cited by 194
  24. 2025Survey on Evaluation of LLM-based Agentscited by 190
  25. 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 162
  26. 2020Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scanscited by 158
  27. 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 145
  28. 2019Reducing the Hausdorff Distance in Medical Image Segmentation with Convolutional Neural Networkscited by 116
  29. 2024A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretationcited by 79
  30. 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 75
  31. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 68
  32. 2023FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcarecited by 59
  33. 2024Large Language Models for Disease Diagnosis: A Scoping Reviewcited by 51
  34. 2021How I failed machine learning in medical imaging -- shortcomings and recommendationscited by 37

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments
  2. 2026DeepER-Med: Advancing Deep Evidence-Based Research in Medicine Through Agentic AI
  3. 2026Human-Guided Agentic AI for Multimodal Clinical Prediction: Lessons from the AgentDS Healthcare Benchmark
  4. 2024Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios
  5. 2024Autonomous Artificial Intelligence Agents for Clinical Decision Making in Oncology
  6. 2026AutoMedBench: Towards Medical AutoResearch with Agentic AI Models
  7. 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicine
  8. 2026From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning