mlsanityData to 7 Oct 2026

The Persona Paradox: Medical Personas as Behavioral Priors in Clinical Language Models

arXiv 2601.05376 ↗First posted 8 Jan 2026cs.AI cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Persona conditioning can be viewed as a behavioral prior for large language models (LLMs) and is often assumed to confer expertise and improve safety in a monotonic manner. However, its effects on high-stakes clinical decision-making remain poorly characterized. We systematically evaluate persona-based control in clinical LLMs, examining how professional roles (e.g., Emergency Department physician, nurse) and interaction styles (bold vs. cautious) influence behavior across models and medical tasks. We assess performance on clinical triage and patient-safety tasks using multidimensional evaluations that capture task accuracy, calibration, and safety-relevant risk behavior. We find systematic, context-dependent, and non-monotonic effects: Medical personas improve performance in critical care tasks, yielding gains of up to ~+20% in accuracy and calibration, but degrade performance in primary-care settings by comparable margins. Interaction style modulates risk propensity and sensitivity, but it's highly model-dependent. While aggregated LLM-judge rankings favor medical over non-medical personas in safety-critical cases, we found that human clinicians show moderate agreement on safety compliance (average Cohen's kappa = 0.43) but indicate a low confidence in 95.9% of their responses on reasoning quality. Our work shows that personas function as behavioral priors that introduce context-dependent trade-offs rather than guarantees of safety or expertise. The code is available at https://github.com/rsinghlab/PersonaParadox.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 29 references that are in the map. First posted on arXiv 8 Jan 2026.

Builds on

13 of 29 references.

References · 13

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  2. 2023LaMP: When Large Language Models Meet Personalizationcited by 425
  3. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
  4. 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 301
  5. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 257
  6. 2023Aligning Language Models to User Opinionscited by 98
  7. 2025Medical Large Language Model Benchmarks Should Prioritize Construct Validitycited by 36
  8. 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Modelscited by 30
  9. 2025Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfactscited by 30
  10. 2025PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactionscited by 30
  11. 2024Persona is a Double-edged Sword: Mitigating the Negative Impact of Role-playing Prompts in Zero-shot Reasoning Taskscited by 28
  12. 2025Afrispeech-Dialog: A Benchmark Dataset for Spontaneous English Conversations in Healthcare and Beyondcited by 10
1 more
  1. 2025PersonaTeaming: Exploring How Introducing Personas Can Improve Automated AI Red-Teamingcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.