mlsanityData to 14 Oct 2026

Learning to Be A Doctor: Searching for Effective Medical Agent Architectures

arXiv 2504.11301 ↗First posted 15 Apr 2025cs.AIcited by 4

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Large Language Model (LLM)-based agents have demonstrated strong capabilities across a wide range of tasks, and their application in the medical domain holds particular promise due to the demand for high generalizability and reliance on interdisciplinary knowledge. However, existing medical agent systems often rely on static, manually crafted workflows that lack the flexibility to accommodate diverse diagnostic requirements and adapt to emerging clinical scenarios. Motivated by the success of automated machine learning (AutoML), this paper introduces a novel framework for the automated design of medical agent architectures. Specifically, we define a hierarchical and expressive agent search space that enables dynamic workflow adaptation through structured modifications at the node, structural, and framework levels. Our framework conceptualizes medical agents as graph-based architectures composed of diverse, functional node types and supports iterative self-improvement guided by diagnostic feedback. Experimental results on skin disease diagnosis tasks demonstrate that the proposed method effectively evolves workflow structures and significantly enhances diagnostic accuracy over time. This work represents the first fully automated framework for medical agent architecture design and offers a scalable, adaptable foundation for deploying intelligent agents in real-world clinical environments.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 49 references that are in the map. First posted on arXiv 15 Apr 2025.

Builds on

28 of 49 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agent2 Jul
  2. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments13 May
  3. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agents5 May

Other references · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  8. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  9. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  10. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
  11. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 564
  12. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
13 more
  1. 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
  2. 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 325
  3. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
  4. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 216
  5. 2021Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Datasetcited by 185
  6. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 159
  7. 2024Self-Evolving Multi-Agent Collaboration Networks for Software Developmentcited by 74
  8. 2019A Survey on Neural Architecture Searchcited by 71
  9. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 55
  10. 2025AppAgentX: Evolving GUI Agents as Proficient Smartphone Userscited by 46
  11. 2023SkinCon: A skin disease dataset densely annotated by domain experts for fine-grained model debugging and analysiscited by 44
  12. 2019Automated Machine Learning: State-of-The-Art and Open Challengescited by 29
  13. 2022A Comprehensive Survey on Automated Machine Learning for Recommendationscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DoctorAgents: an agentic framework to iteratively refine AutoML pipeline for small clinical temporal data
  2. 2024Adaptive Reasoning and Acting in Medical Language Agents
  3. 2026MDIA: A Multi-Agent Diagnostic Intelligence Pipeline on HealthBench Professional
  4. 2025MAM: Modular Multi-Agent Framework for Multi-Modal Medical Diagnosis via Role-Specialized Collaboration
  5. 2026Agentic AI in Healthcare & Medicine: A Seven-Dimensional Taxonomy for Empirical Evaluation of LLM-based Agents
  6. 2026AutoMedBench: Towards Medical AutoResearch with Agentic AI Models
  7. 2026EMR: Self-Evolving Medical Multi-Agent System via Experience Mining and Reuse
  8. 2024Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios