PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactions
Not on the map. Why?
Abstract (arXiv)
Doctor-patient consultations require multi-turn, context-aware communication tailored to diverse patient personas. Training or evaluating doctor LLMs in such settings requires realistic patient interaction systems. However, existing simulators often fail to reflect the full range of personas seen in clinical practice. To address this, we introduce PatientSim, a patient simulator that generates realistic and diverse patient personas for clinical scenarios, grounded in medical expertise. PatientSim operates using: 1) clinical profiles, including symptoms and medical history, derived from real-world data in the MIMIC-ED and MIMIC-IV datasets, and 2) personas defined by four axes: personality, language proficiency, medical history recall level, and cognitive confusion level, resulting in 37 unique combinations. We evaluate eight LLMs for factual accuracy and persona consistency. The top-performing open-source model, Llama 3.3 70B, is validated by four clinicians to confirm the robustness of our framework. As an open-source, customizable platform, PatientSim provides a reproducible and scalable solution that can be customized for specific training needs. Offering a privacy-compliant environment, it serves as a robust testbed for evaluating medical dialogue systems across diverse patient presentations and shows promise as an educational tool for healthcare. The code is available at https://github.com/dek924/PatientSim.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 23 of its 71 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
23 of 71 references.
References · 23
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 575
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
- 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
- 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
- 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 154
- 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 101
11 more
- 2024PersonaGym: Evaluating Persona Agents and LLMscited by 97
- 2024Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principlescited by 73
- 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactionscited by 40
- 2024Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulatorcited by 39
- 2024MEDCO: Medical Education Copilots Based on A Multi-Agent Frameworkcited by 33
- 2024Towards a Client-Centered Assessment of LLM Therapists by Client Simulationcited by 24
- 2024LLMs Can Simulate Standardized Patients via Agent Coevolutioncited by 22
- 2024Leveraging Large Language Model as Simulated Patients for Clinical Educationcited by 21
- 2023An Automatic Evaluation Framework for Multi-turn Medical Consultations Capabilities of Large Language Modelscited by 13
- 2024PIORS: Personalized Intelligent Outpatient Reception based on Large Language Model with Multi-Agents Medical Scenario Simulationcited by 8
- 2024Med-PMC: Medical Personalized Multi-modal Consultation with a Proactive Ask-First-Observe-Next Paradigmcited by 5
Built on by
Citing papers per year: 2025: 3; 2026: 29.
32 papers.
Sort:
By area:
- 2026EHRWorld: A Patient-Centric Medical World Model for Long-Horizon Clinical Trajectoriescited by 19
- 2026Simulated Students in Tutoring Dialogues: Substance or Illusion?cited by 18
- 2026OdysSim: Building Foundation Models for Human Behavior Simulationcited by 13
- 2025The Dialogue That Heals: A Comprehensive Evaluation of Doctor Agents' Inquiry Capabilitycited by 10
- 2025KnowGuard: Knowledge-Driven Abstention for Multi-Round Clinical Reasoningcited by 7
- 2026Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verificationcited by 5
- 2026The Persona Paradox: Medical Personas as Behavioral Priors in Clinical Language Modelscited by 3
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistencycited by 3
- 2026TriageSim: A Conversational Emergency Triage Simulation Framework from Structured Electronic Health Recordscited by 2
- 2026MedConceal: A Benchmark for Clinical Hidden-Concern Reasoning Under Partial Observabilitycited by 2
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
- 2026Multi-Stage Patient Role-Playing Framework for Realistic Clinical Interactionscited by 1
20 more
- 2026LegalWorld: A Life-Cycle Interactive Environment for Legal Agentscited by 1
- 2025When Avatars Have Personality: Effects on Engagement and Communication in Immersive Medical Trainingcited by 0
- 2026Think Like a Doctor: Conversational Diagnosis through the Exploration of Diagnostic Knowledge Graphscited by 0
- 2026H-AdminSim: A Multi-Agent Simulator for Realistic Hospital Administrative Workflows with FHIR Integrationcited by 0
- 2026VeriSim: A Configurable Framework for Stress-Testing Medical AI Under Patient Communication Noisecited by 0
- 2026STREAM: A Data-Centric Framework for Mining High-Value Task-Oriented Dialogues from Streaming Mediacited by 0
- 2026Persona Non Grata: LLM Persona-Driven Generations in MCQA are Unstable in Distinct Dimensionscited by 0
- 2026The complexities of patient-centred conversational artificial intelligencecited by 0
- 2026Evaluating the Effectiveness of Persona Simulation in Opinion Prediction with GPT-4.1cited by 0
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studiescited by 0
- 2026EmoPatient: An Emotion-Directed Patient Simulator for Realistic Palliative Care Communication Trainingcited by 0
- 2026ELICITED: EHR-grounded Longitudinal Interactive Conversations for Information-seeking Triage Evaluation and Decision-makingcited by 0
- 2026When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptionscited by 0
- 2026SIC-Agents: Benchmarking and Building an Adaptive Simulator for Pediatric Serious Illness Communication Trainingcited by 0
- 2026GPAgentBench-2K: Benchmarking Large Language Model Agents in Complex Clinical Action Spacecited by 0
- 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurorscited by 0
- 2026DischargeBench: Pre-Deployment Evaluation of LLM Discharge Educators through Persona-Grounded Patient Simulationcited by 0
- 2026Clinician-Grounded Quality Assurance for AI-Assisted Psychiatric Intakecited by 0
- 2026InterviewPlayground: A Validated Simulation Environment for Evaluating AI Interviewerscited by 0
- 2026Prompt or Policy? Optimizing Physician Slate Presentations with LLM User Simulatorscited by 0
- 2026Prompt or Policy? Optimizing Physician Slate Presentations with LLM User Simulators13 Oct 2026
- 2026InterviewPlayground: A Validated Simulation Environment for Evaluating AI Interviewers8 Oct 2026
- 2026Clinician-Grounded Quality Assurance for AI-Assisted Psychiatric Intake17 Sep 2026
- 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurors9 Sep 2026
- 2026GPAgentBench-2K: Benchmarking Large Language Model Agents in Complex Clinical Action Space31 Aug 2026
- 2026SIC-Agents: Benchmarking and Building an Adaptive Simulator for Pediatric Serious Illness Communication Training30 Aug 2026
- 2026When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions29 Aug 2026
- 2026ELICITED: EHR-grounded Longitudinal Interactive Conversations for Information-seeking Triage Evaluation and Decision-making10 Aug 2026
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studies6 Aug 2026
- 2026DischargeBench: Pre-Deployment Evaluation of LLM Discharge Educators through Persona-Grounded Patient Simulation22 Jul 2026
- 2026Evaluating the Effectiveness of Persona Simulation in Opinion Prediction with GPT-4.122 Jul 2026
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy13 Jul 2026
20 more
- 2026The complexities of patient-centred conversational artificial intelligence9 Jul 2026
- 2026Persona Non Grata: LLM Persona-Driven Generations in MCQA are Unstable in Distinct Dimensions1 Jul 2026
- 2026EmoPatient: An Emotion-Directed Patient Simulator for Realistic Palliative Care Communication Training17 Jun 2026
- 2026LegalWorld: A Life-Cycle Interactive Environment for Legal Agents17 Jun 2026
- 2026OdysSim: Building Foundation Models for Human Behavior Simulation12 Jun 2026
- 2026STREAM: A Data-Centric Framework for Mining High-Value Task-Oriented Dialogues from Streaming Media24 May 2026
- 2026VeriSim: A Configurable Framework for Stress-Testing Medical AI Under Patient Communication Noise12 Apr 2026
- 2026MedConceal: A Benchmark for Clinical Hidden-Concern Reasoning Under Partial Observability9 Apr 2026
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistency26 Mar 2026
- 2026Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verification3 Mar 2026
- 2026TriageSim: A Conversational Emergency Triage Simulation Framework from Structured Electronic Health Records2 Mar 2026
- 2026H-AdminSim: A Multi-Agent Simulator for Realistic Hospital Administrative Workflows with FHIR Integration5 Feb 2026
- 2026EHRWorld: A Patient-Centric Medical World Model for Long-Horizon Clinical Trajectories3 Feb 2026
- 2026Think Like a Doctor: Conversational Diagnosis through the Exploration of Diagnostic Knowledge Graphs2 Feb 2026
- 2026Multi-Stage Patient Role-Playing Framework for Realistic Clinical Interactions16 Jan 2026
- 2026The Persona Paradox: Medical Personas as Behavioral Priors in Clinical Language Models8 Jan 2026
- 2026Simulated Students in Tutoring Dialogues: Substance or Illusion?7 Jan 2026
- 2025The Dialogue That Heals: A Comprehensive Evaluation of Doctor Agents' Inquiry Capability29 Sep 2025
- 2025KnowGuard: Knowledge-Driven Abstention for Multi-Round Clinical Reasoning29 Sep 2025
- 2025When Avatars Have Personality: Effects on Engagement and Communication in Immersive Medical Training17 Sep 2025
- 2025The Dialogue That Heals: A Comprehensive Evaluation of Doctor Agents' Inquiry Capabilitycited by 10
- 2026Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verificationcited by 5
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistencycited by 3
- 2026H-AdminSim: A Multi-Agent Simulator for Realistic Hospital Administrative Workflows with FHIR Integrationcited by 0
- 2026SIC-Agents: Benchmarking and Building an Adaptive Simulator for Pediatric Serious Illness Communication Trainingcited by 0
- 2026GPAgentBench-2K: Benchmarking Large Language Model Agents in Complex Clinical Action Spacecited by 0
- 2026GPAgentBench-2K: Benchmarking Large Language Model Agents in Complex Clinical Action Space31 Aug 2026
- 2026SIC-Agents: Benchmarking and Building an Adaptive Simulator for Pediatric Serious Illness Communication Training30 Aug 2026
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistency26 Mar 2026
- 2026Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verification3 Mar 2026
- 2026H-AdminSim: A Multi-Agent Simulator for Realistic Hospital Administrative Workflows with FHIR Integration5 Feb 2026
- 2025The Dialogue That Heals: A Comprehensive Evaluation of Doctor Agents' Inquiry Capability29 Sep 2025
- 2026Simulated Students in Tutoring Dialogues: Substance or Illusion?cited by 18
- 2026OdysSim: Building Foundation Models for Human Behavior Simulationcited by 13
- 2026The Persona Paradox: Medical Personas as Behavioral Priors in Clinical Language Modelscited by 3
- 2026TriageSim: A Conversational Emergency Triage Simulation Framework from Structured Electronic Health Recordscited by 2
- 2026Multi-Stage Patient Role-Playing Framework for Realistic Clinical Interactionscited by 1
- 2026LegalWorld: A Life-Cycle Interactive Environment for Legal Agentscited by 1
- 2025When Avatars Have Personality: Effects on Engagement and Communication in Immersive Medical Trainingcited by 0
- 2026Think Like a Doctor: Conversational Diagnosis through the Exploration of Diagnostic Knowledge Graphscited by 0
- 2026VeriSim: A Configurable Framework for Stress-Testing Medical AI Under Patient Communication Noisecited by 0
- 2026STREAM: A Data-Centric Framework for Mining High-Value Task-Oriented Dialogues from Streaming Mediacited by 0
- 2026Persona Non Grata: LLM Persona-Driven Generations in MCQA are Unstable in Distinct Dimensionscited by 0
- 2026The complexities of patient-centred conversational artificial intelligencecited by 0
12 most cited of 22 All 22 (JSON)
- 2026Prompt or Policy? Optimizing Physician Slate Presentations with LLM User Simulators13 Oct 2026
- 2026InterviewPlayground: A Validated Simulation Environment for Evaluating AI Interviewers8 Oct 2026
- 2026Clinician-Grounded Quality Assurance for AI-Assisted Psychiatric Intake17 Sep 2026
- 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurors9 Sep 2026
- 2026When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions29 Aug 2026
- 2026ELICITED: EHR-grounded Longitudinal Interactive Conversations for Information-seeking Triage Evaluation and Decision-making10 Aug 2026
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studies6 Aug 2026
- 2026DischargeBench: Pre-Deployment Evaluation of LLM Discharge Educators through Persona-Grounded Patient Simulation22 Jul 2026
- 2026Evaluating the Effectiveness of Persona Simulation in Opinion Prediction with GPT-4.122 Jul 2026
- 2026The complexities of patient-centred conversational artificial intelligence9 Jul 2026
- 2026Persona Non Grata: LLM Persona-Driven Generations in MCQA are Unstable in Distinct Dimensions1 Jul 2026
- 2026EmoPatient: An Emotion-Directed Patient Simulator for Realistic Palliative Care Communication Training17 Jun 2026
12 newest of 22 All 22 (JSON)