mlsanityData to 14 Oct 2026

Too Good to be Bad: On the Failure of LLMs to Role-Play Villains

arXiv 2511.04962 ↗First posted 7 Nov 2025cs.CL cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are increasingly tasked with creative generation, including the simulation of fictional characters. However, their ability to portray non-prosocial, antagonistic personas remains largely unexamined. We hypothesize that the safety alignment of modern LLMs creates a fundamental conflict with the task of authentically role-playing morally ambiguous or villainous characters. To investigate this, we introduce the Moral RolePlay benchmark, a new dataset featuring a four-level moral alignment scale and a balanced test set for rigorous evaluation. We task state-of-the-art LLMs with role-playing characters from moral paragons to pure villains. Our large-scale evaluation reveals a consistent, monotonic decline in role-playing fidelity as character morality decreases. We find that models struggle most with traits directly antithetical to safety principles, such as ``Deceitful'' and ``Manipulative'', often substituting nuanced malevolence with superficial aggression. Furthermore, we demonstrate that general chatbot proficiency is a poor predictor of villain role-playing ability, with highly safety-aligned models performing particularly poorly. Our work provides the first systematic evidence of this critical limitation, highlighting a key tension between model safety and creative fidelity. Our benchmark and findings pave the way for developing more nuanced, context-aware alignment methods.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 7 Nov 2025.

Builds on

24 of 34 references.

References · 24

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  5. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  6. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 656
  7. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
  8. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Ciphercited by 423
  9. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  10. 2023Pretraining Language Models with Human Preferencescited by 247
  11. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
  12. 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 179
12 more
  1. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  2. 2025MiniMax-01: Scaling Foundation Models with Lightning Attentioncited by 166
  3. 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluationcited by 143
  4. 2024Safe LoRA: the Silver Lining of Reducing Safety Risks when Fine-tuning Large Language Modelscited by 125
  5. 2024Know Your Limits: A Survey of Abstention in Large Language Modelscited by 121
  6. 2024Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Trainingcited by 69
  7. 2024SocialBench: Sociality Evaluation of Role-Playing Conversational Agentscited by 50
  8. 2025Hunyuan-TurboS: Advancing Large Language Models through Mamba-Transformer Synergy and Adaptive Chain-of-Thoughtcited by 29
  9. 2025Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Modelscited by 21
  10. 2025RAIDEN-R1: Improving Role-awareness of LLMs via GRPO with Verifiable Rewardcited by 13
  11. 2025RPGBENCH: Evaluating Large Language Models as Role-Playing Game Enginescited by 12
  12. 2025BookWorld: From Novels to Interactive Agent Societies for Creative Story Generationcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 10.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agents
  2. 2026Self-reported archetypes and behavioral failures in Large Language Models
  3. 2024Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment
  4. 2026Rethinking Role-Playing Evaluation: Anonymous Benchmarking and a Systematic Study of Personality Effects
  5. 2026Cognitive Enhancement: Rethinking the Necessity of Role-Playing for Large Language Models
  6. 2026Bad company corrupts good morals: Understanding and Measuring Narrative-Induced Moral Reasoning Degradation in LLMs
  7. 2025PersonaEval: Are LLM Evaluators Human Enough to Judge Role-Play?
  8. 2024On the Decision-Making Abilities in Role-Playing using Large Language Models