mlsanityData to 7 Oct 2026

EyeAgent: An Agentic AI System for Multimodal Clinical Decision Support in Ophthalmology

arXiv 2511.09394 ↗First posted 12 Nov 2025cs.HCcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Artificial intelligence has shown promise in medical imaging, yet most existing systems lack flexibility, interpretability, and adaptability - challenges especially pronounced in ophthalmology, where diverse imaging modalities are essential. We present EyeAgent, the first agentic AI framework for comprehensive and interpretable clinical decision support in ophthalmology. Using a large language model (DeepSeek-V3) as its central reasoning engine, EyeAgent interprets user queries and dynamically orchestrates 53 validated ophthalmic tools across 23 imaging modalities for diverse tasks including classification, segmentation, detection, image/report generation, and quantitative analysis. Stepwise ablation analysis demonstrated a progressive improvement in diagnostic accuracy, rising from a baseline of 69.71% (using only 5 general tools) to 80.79% when the full suite of 53 specialized tools was integrated. In an expert rating study on 200 real-world clinical cases, EyeAgent achieved 93.7% tool selection accuracy and received expert ratings of more than 88% across accuracy, completeness, safety, reasoning, and interpretability. In human-AI collaboration, EyeAgent matched or exceeded the performance of senior ophthalmologists and, when used as an assistant, improved overall diagnostic accuracy by 18.51% and report quality scores by 19%, with the greatest benefit observed among junior ophthalmologists. These findings establish EyeAgent as a scalable and trustworthy AI framework for ophthalmology and provide a blueprint for modular, multimodal, and clinically aligned next-generation AI systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 16 of its 62 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

16 of 62 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agent2 Jul
  2. 2024AgentMD: Empowering Language Agents for Risk Prediction with Large-Scale Clinical Tool Learning20 Feb

Other references · 14

  1. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  2. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  3. 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
  4. 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 167
  5. 2024Empowering Biomedical Discovery with AI Agentscited by 117
  6. 2018OCTID: Optical Coherence Tomography Image Databasecited by 36
  7. 2021A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detectioncited by 34
  8. 2023OCTDL: Optical Coherence Tomography Dataset for Image-Based Deep Learning Methodscited by 28
  9. 2024EyeDiff: text-to-image diffusion model improves rare eye disease diagnosiscited by 5
  10. 2024Fundus2Video: Cross-Modal Angiography Video Generation from Static Fundus Photography with Clinical Knowledge Guidancecited by 4
  11. 2025Fundus2Globe: Generative AI-Driven 3D Digital Twins for Personalized Myopia Managementcited by 4
  12. 2024Choroidal Vessel Segmentation on Indocyanine Green Angiography Images via Human-in-the-Loop Labelingcited by 1
2 more
  1. 2025APTOS-2024 challenge report: Generation of synthetic 3D OCT images from fundus photographscited by 1
  2. 2025ChatMyopia: An AI Agent for Pre-consultation Education in Primary Eye Care Settingscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024EyeGPT: Ophthalmic Assistant with Large Language Models
  2. 2025MedChat: A Multi-Agent Framework for Multimodal Diagnosis with Large Language Models
  3. 2025AURA: A Multi-Modal Medical Agent for Understanding, Reasoning & Annotation
  4. 2026An Agentic AI Framework Overcomes Fundamental Limitations of Large Language Models for Glaucoma Detection from Fundus Photography
  5. 2025CataractSurg-80K: Knowledge-Driven Benchmarking for Structured Reasoning in Ophthalmic Surgery Planning
  6. 2026Route, Retrieve, Reflect, Repair: Self-Improving Agentic Framework for Visual Detection and Linguistic Reasoning in Medical Imaging
  7. 2025EyecareGPT: Boosting Comprehensive Ophthalmology Understanding with Tailored Dataset, Benchmark and Model
  8. 2026Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translation