mlsanityData to 7 Oct 2026

Moral Susceptibility and Robustness under Persona Role-Play in Large Language Models

arXiv 2511.08565 ↗First posted 11 Nov 2025cs.CL cs.AI cs.CYcited by 4

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) increasingly operate in social contexts, motivating analysis of how they express and shift moral judgments. In this work, we investigate the moral response of LLMs to persona role-play, prompting a LLM to assume a specific character. Using the Moral Foundations Questionnaire (MFQ), we introduce a benchmark that quantifies two properties: moral susceptibility and moral robustness, defined from the variability of MFQ scores across- and within-personas. We estimate these quantities with two complementary procedures, repeated sampling and a logit-based method that directly estimates the rating distributions and enables temperature analysis. We evaluate 15 models across six families: Claude, DeepSeek, Gemini, GPT, Grok, and Llama. The two metrics show qualitatively different patterns. Moral robustness varies by more than an order of magnitude, with a coefficient of variation of about 152%, and is explained almost entirely by model family. The Claude family is, by a significant margin, the most robust, about 30 times more so than the lower-performing families (DeepSeek, Grok, and Llama), while Gemini and GPT occupy an intermediate tier. This strong family dependence suggests that robustness is primarily shaped by post-training. Moral susceptibility, by contrast, spans a much narrower range, with a coefficient of variation of about 13%, and the most susceptible model is only 1.6 times more susceptible than the least. Unlike robustness, susceptibility shows no clear family dependence, suggesting that it is primarily determined by pre-training. Additionally, we present moral foundation profiles for models without persona role-play and for personas averaged across models. Together, these analyses provide a systematic view of how persona conditioning shapes moral behavior in LLMs and a window into the internal machinery they use to instantiate personas.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 16 of its 128 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

16 of 128 references.

References · 16

  1. 2020Aligning AI With Shared Human Valuescited by 706
  2. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
  3. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
  4. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
  5. 2023Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmarkcited by 174
  6. 2024How Well Can LLMs Negotiate? NegotiationArena Platform and Analysiscited by 93
  7. 2024PersonaGym: Evaluating Persona Agents and LLMscited by 89
  8. 2023Moral Foundations of Large Language Modelscited by 84
  9. 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
  10. 2024Are Large Language Models Moral Hypocrites? A Study Based on Moral Foundationscited by 19
  11. 2024Whose Morality Do They Speak? Unraveling Cultural Bias in Multilingual Language Modelscited by 17
  12. 2025RPGBENCH: Evaluating Large Language Models as Role-Playing Game Enginescited by 11
4 more
  1. 2025Deceive, Detect, and Disclose: Large Language Models Play Mini-Mafiacited by 7
  2. 2025Know Thyself? On the Incapability and Implications of AI Self-Recognitioncited by 7
  3. 2025Role-Playing Evaluation for Large Language Modelscited by 5
  4. 2025Concept Incongruence: An Exploration of Time and Death in Role Playingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.