mlsanityData to 7 Oct 2026

RoleCDE:Benchmarking and Mitigating Role-Alignment Trade-offs in Role-Playing Agents

arXiv 2606.01552 ↗First posted 1 Jun 2026cs.AIcited by 3

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Role-playing agents(RPAs) are widely used to steer large language models(LLMs) toward role-consistent behavior, yet existing benchmarks mainly evaluate surface-level fidelity and offer limited insight into decision making under role-alignment value conflicts. To address this gap, we introduce RoleCDE, the first benchmark designed to evaluate RPAs under structured conflicts between role-specific values and alignment-oriented constraints. RoleCDE formulates role-aware decision making as cognitive dilemma scenarios, jointly evaluating role-scenario grounding, value conflict resolution, and decision tendencies. The benchmark is constructed at scale, covering approximately 8k diverse role profiles and scenarios and nearly 24k dilemma instances across three difficulty levels and eight role categories. Evaluation of several mainstream LLMs reveals a "Role Value Decoupling" phenomenon, where agents systematically default to alignment-and morality-consistent decisions rather than role-specific values when the two conflict, even under explicit role conditioning. This behavior is largely invariant to dilemma difficulty but varies substantially across role categories. We further show that RoleCDE-based fine-tuning effectively mitigates this decoupling by improving value trade-off reasoning, while preserving general role-playing fidelity and general reasoning performance. Code is available at: https://github.com/rabbitrose/RoleCDE.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 17 of its 43 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

17 of 43 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024PersonaGym: Evaluating Persona Agents and LLMs25 Jul
  2. 2023Character-LLM: A Trainable Agent for Role-Playing16 Oct
  3. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 14

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  6. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  7. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
  8. 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 99
  9. 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
  10. 2024CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worldscited by 38
  11. 2021Measuring Fairness with Biased Rulers: A Survey on Quantifying Biases in Pretrained Language Modelscited by 20
  12. 2025RoleMRC: A Fine-Grained Composite Benchmark for Role-Playing and Instruction-Followingcited by 18
2 more
  1. 2024Mitigating Hallucination in Fictional Character Role-Playcited by 17
  2. 2025Too Good to be Bad: On the Failure of LLMs to Role-Play Villainscited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DynSess: Dynamic Session-Level Evaluation and Optimization Framework for Role-Playing Agents
  2. 2024Role-Play Paradox in Large Language Models: Reasoning Performance Gains and Ethical Dilemmas
  3. 2026Identifying and Mitigating Bottlenecks in Role-Playing Agents: A Systematic Study of Disentangling Character Profile Axes
  4. 2024ERABAL: Enhancing Role-Playing Agents through Boundary-Aware Learning
  5. 2026Cognitive Enhancement: Rethinking the Necessity of Role-Playing for Large Language Models
  6. 2026Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
  7. 2025RAIDEN-R1: Improving Role-awareness of LLMs via GRPO with Verifiable Reward
  8. 2026AI Alignment through a Game-theoretic Lens: A Survey