EvoClinician: A Self-Evolving Agent for Multi-Turn Medical Diagnosis via Test-Time Evolutionary Learning
Not on the map. Why?
Abstract (arXiv)
Prevailing medical AI operates on an unrealistic ''one-shot'' model, diagnosing from a complete patient file. However, real-world diagnosis is an iterative inquiry where Clinicians sequentially ask questions and order tests to strategically gather information while managing cost and time. To address this, we first propose Med-Inquire, a new benchmark designed to evaluate an agent's ability to perform multi-turn diagnosis. Built upon a dataset of real-world clinical cases, Med-Inquire simulates the diagnostic process by hiding a complete patient file behind specialized Patient and Examination agents. They force the agent to proactively ask questions and order tests to gather information piece by piece. To tackle the challenges posed by Med-Inquire, we then introduce EvoClinician, a self-evolving agent that learns efficient diagnostic strategies at test time. Its core is a ''Diagnose-Grade-Evolve'' loop: an Actor agent attempts a diagnosis; a Process Grader agent performs credit assignment by evaluating each action for both clinical yield and resource efficiency; finally, an Evolver agent uses this feedback to update the Actor's strategy by evolving its prompt and memory. Our experiments show EvoClinician outperforms continual learning baselines and other self-evolving agents like memory agents. The code is available at https://github.com/yf-he/EvoClinician
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 49 of its 58 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
49 of 58 references.
References · 49
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2024GPT-4o System Cardcited by 4,467
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2025OpenAI GPT-5 System Cardcited by 910
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
- 2023Large Language Models as Optimizerscited by 830
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
37 more
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2025MedGemma Technical Reportcited by 398
- 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
- 2024Agent Workflow Memorycited by 342
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 215
- 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 210
- 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
- 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 182
- 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 145
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
- 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 113
- 2024GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AIcited by 96
- 2025GuardReasoner: Towards Reasoning-based LLM Safeguardscited by 89
- 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 60
- 2025Efficient Inference for Large Reasoning Models: A Surveycited by 58
- 2025Safety in Large Reasoning Models: A Surveycited by 58
- 2025MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Researchcited by 57
- 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 56
- 2025Sequential Diagnosis with Language Modelscited by 53
- 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 47
- 2025Can Indirect Prompt Injection Attacks Be Detected and Removed?cited by 43
- 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactionscited by 40
- 2024FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answeringcited by 38
- 2025EvoTest: Evolutionary Test-Time Learning for Self-Improving Agentic Systemscited by 34
- 2025Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Modelscited by 33
- 2025Evaluating the Paperclip Maximizer: Are RL-Based Language Models More Likely to Pursue Instrumental Goals?cited by 26
- 2025MDTeamGPT: A Self-Evolving LLM-based Multi-Agent Framework for Multi-Disciplinary Team Medical Consultationcited by 25
- 2024Can Knowledge Graphs Make Large Language Models More Trustworthy? An Empirical Study Over Open-ended Question Answeringcited by 20
- 2026Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updatescited by 17
- 2025Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instructioncited by 15
- 2025Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidancecited by 14
- 2026Rewarding the Rare: Uniqueness-Aware RL for Creative Problem Solving in LLMscited by 12
- 2024Generalizing Graph Transformers Across Diverse Graphs and Tasks via Pre-trainingcited by 7
- 2025DYSTIL: Dynamic Strategy Induction with Large Language Models for Reinforcement Learningcited by 7
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injectionscited by 44
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlookcited by 5
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvementcited by 5
- 2026Continual Learning in Transitioncited by 0
- 2026CDPR: Counterfactual Advantage-based Credit Assignment for Cost-Aware Sequential Medical Diagnosiscited by 0
- 2026Asclepius: An Adaptive Harness for Long-Horizon Clinical Agentscited by 0
- 2026PrivMeSA: Privacy-Aware Self-Evolving Multi-Agent System for Medicine via Local-Remote LLM Collaborationcited by 0
- 2026PrivMeSA: Privacy-Aware Self-Evolving Multi-Agent System for Medicine via Local-Remote LLM Collaboration29 Sep 2026
- 2026Asclepius: An Adaptive Harness for Long-Horizon Clinical Agents11 Sep 2026
- 2026The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement10 Sep 2026
- 2026Continual Learning in Transition6 Aug 2026
- 2026CDPR: Counterfactual Advantage-based Credit Assignment for Cost-Aware Sequential Medical Diagnosis27 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlook26 Mar 2026
- 2026Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injections17 Feb 2026