LLMs Can Simulate Standardized Patients via Agent Coevolution
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Training medical personnel using standardized patients (SPs) remains a complex challenge, requiring extensive domain expertise and role-specific practice. Previous research on Large Language Model (LLM)-based SPs mostly focuses on improving data retrieval accuracy or adjusting prompts through human feedback. However, this focus has overlooked the critical need for patient agents to learn a standardized presentation pattern that transforms data into human-like patient responses through unsupervised simulations. To address this gap, we propose EvoPatient, a novel simulated patient framework in which a patient agent and doctor agents simulate the diagnostic process through multi-turn dialogues, simultaneously gathering experience to improve the quality of both questions and answers, ultimately enabling human doctor training. Extensive experiments on various cases demonstrate that, by providing only overall SP requirements, our framework improves over existing reasoning methods by more than 10% in requirement alignment and better human preference, while achieving an optimal balance of resource consumption after evolving over 200 cases for 10 hours, with excellent generalizability. Our system will be available at https://github.com/ZJUMAI/EvoPatient.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 57 references that are in the map. First posted on arXiv 16 Dec 2024.
Builds on
23 of 57 references.
Closest ancestors · 1
Same direction, newest first
Other references · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
10 more
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 498
- 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
- 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 301
- 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
- 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 238
- 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 145
- 2023AlpaCare:Instruction-tuned Large Language Models for Medical Applicationcited by 90
- 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teamingcited by 85
- 2024Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principlescited by 73
Built on by
Citing papers per year: 2025: 9; 2026: 13.
22 papers.
Sort:
By area:
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 149
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?cited by 85
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agentscited by 50
- 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactionscited by 40
- 2025PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactionscited by 32
- 2025ChatThero: An LLM-Supported Chatbot for Behavior Change and Therapeutic Support in Addiction Recoverycited by 4
- 2026PatientHub: A Unified Framework for Patient Simulationcited by 4
- 2026Strong Reasoning Isn't Enough: Evaluating Evidence Elicitation in Interactive Diagnosiscited by 3
- 2025Patient-Zero: Scaling Synthetic Patient Agents to Real-World Distributions without Real Patient Datacited by 2
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Educationcited by 2
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
10 more
- 2026Multi-Stage Patient Role-Playing Framework for Realistic Clinical Interactionscited by 1
- 2026From Prediction to Intervention: Personalized Meal-Level Glucose Regulation via an LLM Agentcited by 1
- 2025An Agentic AI Framework for Training General Practitioner Student Skillscited by 0
- 2026VeriSim: A Configurable Framework for Stress-Testing Medical AI Under Patient Communication Noisecited by 0
- 2026Beyond Prompt: Fine-grained Simulation of Cognitively Impaired Standardized Patients via Stochastic Steeringcited by 0
- 2026MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Educationcited by 0
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studiescited by 0
- 2026Agentic AI-driven Immersive Simulation: A Knowledge-Aware Virtual Training Platform forHigh Dose Rate (HDR) Brachytherapycited by 0
- 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurorscited by 0
- 2026Evaluating Scaffolding-Oriented Multi-Agent Large Language Model System for Clinical Interview Trainingcited by 0
- 2026Evaluating Scaffolding-Oriented Multi-Agent Large Language Model System for Clinical Interview Training10 Sep 2026
- 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurors9 Sep 2026
- 2026Agentic AI-driven Immersive Simulation: A Knowledge-Aware Virtual Training Platform forHigh Dose Rate (HDR) Brachytherapy8 Aug 2026
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studies6 Aug 2026
- 2026MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Education23 Jul 2026
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy13 Jul 2026
- 2026From Prediction to Intervention: Personalized Meal-Level Glucose Regulation via an LLM Agent7 Jul 2026
- 2026Beyond Prompt: Fine-grained Simulation of Cognitively Impaired Standardized Patients via Stochastic Steering14 Apr 2026
- 2026VeriSim: A Configurable Framework for Stress-Testing Medical AI Under Patient Communication Noise12 Apr 2026
- 2026PatientHub: A Unified Framework for Patient Simulation12 Feb 2026
- 2026Strong Reasoning Isn't Enough: Evaluating Evidence Elicitation in Interactive Diagnosis27 Jan 2026
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents18 Jan 2026
10 more
- 2026Multi-Stage Patient Role-Playing Framework for Realistic Clinical Interactions16 Jan 2026
- 2025An Agentic AI Framework for Training General Practitioner Student Skills20 Dec 2025
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Education12 Nov 2025
- 2025Patient-Zero: Scaling Synthetic Patient Agents to Real-World Distributions without Real Patient Data14 Sep 2025
- 2025ChatThero: An LLM-Supported Chatbot for Behavior Change and Therapeutic Support in Addiction Recovery28 Aug 2025
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul 2025
- 2025PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactions23 May 2025
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Review28 Apr 2025
- 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactions28 Mar 2025
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?16 Feb 2025
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?cited by 85
- 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactionscited by 40
- 2025Patient-Zero: Scaling Synthetic Patient Agents to Real-World Distributions without Real Patient Datacited by 2
- 2026From Prediction to Intervention: Personalized Meal-Level Glucose Regulation via an LLM Agentcited by 1
- 2025An Agentic AI Framework for Training General Practitioner Student Skillscited by 0
- 2026Agentic AI-driven Immersive Simulation: A Knowledge-Aware Virtual Training Platform forHigh Dose Rate (HDR) Brachytherapycited by 0
- 2026Evaluating Scaffolding-Oriented Multi-Agent Large Language Model System for Clinical Interview Trainingcited by 0
- 2026Evaluating Scaffolding-Oriented Multi-Agent Large Language Model System for Clinical Interview Training10 Sep 2026
- 2026Agentic AI-driven Immersive Simulation: A Knowledge-Aware Virtual Training Platform forHigh Dose Rate (HDR) Brachytherapy8 Aug 2026
- 2026From Prediction to Intervention: Personalized Meal-Level Glucose Regulation via an LLM Agent7 Jul 2026
- 2025An Agentic AI Framework for Training General Practitioner Student Skills20 Dec 2025
- 2025Patient-Zero: Scaling Synthetic Patient Agents to Real-World Distributions without Real Patient Data14 Sep 2025
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul 2025
- 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactions28 Mar 2025
- 2025A Survey of LLM-based Agents in Medicine: How far are we from Baymax?16 Feb 2025
- 2025PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactionscited by 32
- 2025ChatThero: An LLM-Supported Chatbot for Behavior Change and Therapeutic Support in Addiction Recoverycited by 4
- 2026PatientHub: A Unified Framework for Patient Simulationcited by 4
- 2026Strong Reasoning Isn't Enough: Evaluating Evidence Elicitation in Interactive Diagnosiscited by 3
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Educationcited by 2
- 2026Multi-Stage Patient Role-Playing Framework for Realistic Clinical Interactionscited by 1
- 2026VeriSim: A Configurable Framework for Stress-Testing Medical AI Under Patient Communication Noisecited by 0
- 2026Beyond Prompt: Fine-grained Simulation of Cognitively Impaired Standardized Patients via Stochastic Steeringcited by 0
- 2026MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Educationcited by 0
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studiescited by 0
- 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurorscited by 0
- 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurors9 Sep 2026
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studies6 Aug 2026
- 2026MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Education23 Jul 2026
- 2026Beyond Prompt: Fine-grained Simulation of Cognitively Impaired Standardized Patients via Stochastic Steering14 Apr 2026
- 2026VeriSim: A Configurable Framework for Stress-Testing Medical AI Under Patient Communication Noise12 Apr 2026
- 2026PatientHub: A Unified Framework for Patient Simulation12 Feb 2026
- 2026Strong Reasoning Isn't Enough: Evaluating Evidence Elicitation in Interactive Diagnosis27 Jan 2026
- 2026Multi-Stage Patient Role-Playing Framework for Realistic Clinical Interactions16 Jan 2026
- 2025Human or LLM as Standardized Patients? A Comparative Study for Medical Education12 Nov 2025
- 2025ChatThero: An LLM-Supported Chatbot for Behavior Change and Therapeutic Support in Addiction Recovery28 Aug 2025
- 2025PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactions23 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating Large Language Models in Dynamic Clinical Decision-Making with Standardized Patient Cases
- 2024Simulated patient systems powered by large language model-based AI agents offer potential for transforming medical education
- 2025AI Agents for Conversational Patient Triage: Preliminary Simulation-Based Evaluation with Real-World EHR Data
- 2025AutoMedic: An Automated Evaluation Framework for Clinical Conversational Agents with Medical Dataset Grounding
- 2025Ask Patients with Patience: Enabling LLMs for Human-Centric Medical Dialogue with Grounded Reasoning
- 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator
- 2025LLM-Powered Virtual Patient Agents for Interactive Clinical Skills Training with Automated Feedback
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments