mlsanityData to 14 Oct 2026

PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactions

arXiv 2505.17818 ↗First posted 23 May 2025cs.AI cs.CLcited by 32

Not on the map. Why?

Abstract (arXiv)

Doctor-patient consultations require multi-turn, context-aware communication tailored to diverse patient personas. Training or evaluating doctor LLMs in such settings requires realistic patient interaction systems. However, existing simulators often fail to reflect the full range of personas seen in clinical practice. To address this, we introduce PatientSim, a patient simulator that generates realistic and diverse patient personas for clinical scenarios, grounded in medical expertise. PatientSim operates using: 1) clinical profiles, including symptoms and medical history, derived from real-world data in the MIMIC-ED and MIMIC-IV datasets, and 2) personas defined by four axes: personality, language proficiency, medical history recall level, and cognitive confusion level, resulting in 37 unique combinations. We evaluate eight LLMs for factual accuracy and persona consistency. The top-performing open-source model, Llama 3.3 70B, is validated by four clinicians to confirm the robustness of our framework. As an open-source, customizable platform, PatientSim provides a reproducible and scalable solution that can be customized for specific training needs. Offering a privacy-compliant environment, it serves as a robust testbed for evaluating medical dialogue systems across diverse patient presentations and shows promise as an educational tool for healthcare. The code is available at https://github.com/dek924/PatientSim.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 23 of its 71 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

23 of 71 references.

References · 23

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  3. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  4. 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 575
  5. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
  6. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  7. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
  8. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
  9. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
  10. 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
  11. 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 154
  12. 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 101
11 more
  1. 2024PersonaGym: Evaluating Persona Agents and LLMscited by 97
  2. 2024Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principlescited by 73
  3. 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactionscited by 40
  4. 2024Automatic Interactive Evaluation for Large Language Models with State Aware Patient Simulatorcited by 39
  5. 2024MEDCO: Medical Education Copilots Based on A Multi-Agent Frameworkcited by 33
  6. 2024Towards a Client-Centered Assessment of LLM Therapists by Client Simulationcited by 24
  7. 2024LLMs Can Simulate Standardized Patients via Agent Coevolutioncited by 22
  8. 2024Leveraging Large Language Model as Simulated Patients for Clinical Educationcited by 21
  9. 2023An Automatic Evaluation Framework for Multi-turn Medical Consultations Capabilities of Large Language Modelscited by 13
  10. 2024PIORS: Personalized Intelligent Outpatient Reception based on Large Language Model with Multi-Agents Medical Scenario Simulationcited by 8
  11. 2024Med-PMC: Medical Personalized Multi-modal Consultation with a Proactive Ask-First-Observe-Next Paradigmcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 29.

32 papers.

Sort:

By area:

  1. 2026EHRWorld: A Patient-Centric Medical World Model for Long-Horizon Clinical Trajectoriescited by 19
  2. 2026Simulated Students in Tutoring Dialogues: Substance or Illusion?cited by 18
  3. 2026OdysSim: Building Foundation Models for Human Behavior Simulationcited by 13
  4. 2025The Dialogue That Heals: A Comprehensive Evaluation of Doctor Agents' Inquiry Capabilitycited by 10
  5. 2025KnowGuard: Knowledge-Driven Abstention for Multi-Round Clinical Reasoningcited by 7
  6. 2026Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verificationcited by 5
  7. 2026The Persona Paradox: Medical Personas as Behavioral Priors in Clinical Language Modelscited by 3
  8. 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistencycited by 3
  9. 2026TriageSim: A Conversational Emergency Triage Simulation Framework from Structured Electronic Health Recordscited by 2
  10. 2026MedConceal: A Benchmark for Clinical Hidden-Concern Reasoning Under Partial Observabilitycited by 2
  11. 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
  12. 2026Multi-Stage Patient Role-Playing Framework for Realistic Clinical Interactionscited by 1
20 more
  1. 2026LegalWorld: A Life-Cycle Interactive Environment for Legal Agentscited by 1
  2. 2025When Avatars Have Personality: Effects on Engagement and Communication in Immersive Medical Trainingcited by 0
  3. 2026Think Like a Doctor: Conversational Diagnosis through the Exploration of Diagnostic Knowledge Graphscited by 0
  4. 2026H-AdminSim: A Multi-Agent Simulator for Realistic Hospital Administrative Workflows with FHIR Integrationcited by 0
  5. 2026VeriSim: A Configurable Framework for Stress-Testing Medical AI Under Patient Communication Noisecited by 0
  6. 2026STREAM: A Data-Centric Framework for Mining High-Value Task-Oriented Dialogues from Streaming Mediacited by 0
  7. 2026Persona Non Grata: LLM Persona-Driven Generations in MCQA are Unstable in Distinct Dimensionscited by 0
  8. 2026The complexities of patient-centred conversational artificial intelligencecited by 0
  9. 2026Evaluating the Effectiveness of Persona Simulation in Opinion Prediction with GPT-4.1cited by 0
  10. 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studiescited by 0
  11. 2026EmoPatient: An Emotion-Directed Patient Simulator for Realistic Palliative Care Communication Trainingcited by 0
  12. 2026ELICITED: EHR-grounded Longitudinal Interactive Conversations for Information-seeking Triage Evaluation and Decision-makingcited by 0
  13. 2026When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptionscited by 0
  14. 2026SIC-Agents: Benchmarking and Building an Adaptive Simulator for Pediatric Serious Illness Communication Trainingcited by 0
  15. 2026GPAgentBench-2K: Benchmarking Large Language Model Agents in Complex Clinical Action Spacecited by 0
  16. 2026When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurorscited by 0
  17. 2026DischargeBench: Pre-Deployment Evaluation of LLM Discharge Educators through Persona-Grounded Patient Simulationcited by 0
  18. 2026Clinician-Grounded Quality Assurance for AI-Assisted Psychiatric Intakecited by 0
  19. 2026InterviewPlayground: A Validated Simulation Environment for Evaluating AI Interviewerscited by 0
  20. 2026Prompt or Policy? Optimizing Physician Slate Presentations with LLM User Simulatorscited by 0