Moral Susceptibility and Robustness under Persona Role-Play in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) increasingly operate in social contexts, motivating analysis of how they express and shift moral judgments. In this work, we investigate the moral response of LLMs to persona role-play, prompting a LLM to assume a specific character. Using the Moral Foundations Questionnaire (MFQ), we introduce a benchmark that quantifies two properties: moral susceptibility and moral robustness, defined from the variability of MFQ scores across- and within-personas. We estimate these quantities with two complementary procedures, repeated sampling and a logit-based method that directly estimates the rating distributions and enables temperature analysis. We evaluate 15 models across six families: Claude, DeepSeek, Gemini, GPT, Grok, and Llama. The two metrics show qualitatively different patterns. Moral robustness varies by more than an order of magnitude, with a coefficient of variation of about 152%, and is explained almost entirely by model family. The Claude family is, by a significant margin, the most robust, about 30 times more so than the lower-performing families (DeepSeek, Grok, and Llama), while Gemini and GPT occupy an intermediate tier. This strong family dependence suggests that robustness is primarily shaped by post-training. Moral susceptibility, by contrast, spans a much narrower range, with a coefficient of variation of about 13%, and the most susceptible model is only 1.6 times more susceptible than the least. Unlike robustness, susceptibility shows no clear family dependence, suggesting that it is primarily determined by pre-training. Additionally, we present moral foundation profiles for models without persona role-play and for personas averaged across models. Together, these analyses provide a systematic view of how persona conditioning shapes moral behavior in LLMs and a window into the internal machinery they use to instantiate personas.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 16 of its 128 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
16 of 128 references.
References · 16
- 2020Aligning AI With Shared Human Valuescited by 706
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
- 2023Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmarkcited by 174
- 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysiscited by 93
- 2024PersonaGym: Evaluating Persona Agents and LLMscited by 89
- 2023Moral Foundations of Large Language Modelscited by 84
- 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
- 2024Are Large Language Models Moral Hypocrites? A Study Based on Moral Foundationscited by 19
- 2024Whose Morality Do They Speak? Unraveling Cultural Bias in Multilingual Language Modelscited by 17
- 2025RPGBENCH: Evaluating Large Language Models as Role-Playing Game Enginescited by 11
4 more
- 2025Deceive, Detect, and Disclose: Large Language Models Play Mini-Mafiacited by 7
- 2025Know Thyself? On the Incapability and Implications of AI Self-Recognitioncited by 7
- 2025Role-Playing Evaluation for Large Language Modelscited by 5
- 2025Concept Incongruence: An Exploration of Time and Death in Role Playingcited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Culturally Grounded Personas in Large Language Models: Characterization and Alignment with Socio-Psychological Value Frameworkscited by 3
- 2026To Nuke or Not to Nuke: LLMs' (Missing) Ethical Reasoning and Actions in a High-Stakes Decision-Making Simulationcited by 1
- 2026Persona-Model Collapse in Emergent Misalignmentcited by 0
- 2026Normative Robustness as a Frontier for Non-Verifiable Reasoning in LLMscited by 0
- 2026Normative Robustness as a Frontier for Non-Verifiable Reasoning in LLMs10 Jun 2026
- 2026To Nuke or Not to Nuke: LLMs' (Missing) Ethical Reasoning and Actions in a High-Stakes Decision-Making Simulation6 Jun 2026
- 2026Persona-Model Collapse in Emergent Misalignment13 May 2026
- 2026Culturally Grounded Personas in Large Language Models: Characterization and Alignment with Socio-Psychological Value Frameworks29 Jan 2026