RoleCDE:Benchmarking and Mitigating Role-Alignment Trade-offs in Role-Playing Agents
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Role-playing agents(RPAs) are widely used to steer large language models(LLMs) toward role-consistent behavior, yet existing benchmarks mainly evaluate surface-level fidelity and offer limited insight into decision making under role-alignment value conflicts. To address this gap, we introduce RoleCDE, the first benchmark designed to evaluate RPAs under structured conflicts between role-specific values and alignment-oriented constraints. RoleCDE formulates role-aware decision making as cognitive dilemma scenarios, jointly evaluating role-scenario grounding, value conflict resolution, and decision tendencies. The benchmark is constructed at scale, covering approximately 8k diverse role profiles and scenarios and nearly 24k dilemma instances across three difficulty levels and eight role categories. Evaluation of several mainstream LLMs reveals a "Role Value Decoupling" phenomenon, where agents systematically default to alignment-and morality-consistent decisions rather than role-specific values when the two conflict, even under explicit role conditioning. This behavior is largely invariant to dilemma difficulty but varies substantially across role categories. We further show that RoleCDE-based fine-tuning effectively mitigates this decoupling by improving value trade-off reasoning, while preserving general role-playing fidelity and general reasoning performance. Code is available at: https://github.com/rabbitrose/RoleCDE.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 17 of its 43 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
17 of 43 references.
Closest ancestors · 3
Same direction, newest first
- 2024PersonaGym: Evaluating Persona Agents and LLMs25 Jul
- 2023Character-LLM: A Trainable Agent for Role-Playing16 Oct
- 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
Other references · 14
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 99
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
- 2024CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worldscited by 38
- 2021Measuring Fairness with Biased Rulers: A Survey on Quantifying Biases in Pretrained Language Modelscited by 20
- 2025RoleMRC: A Fine-Grained Composite Benchmark for Role-Playing and Instruction-Followingcited by 18
2 more
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026DynSess: Dynamic Session-Level Evaluation and Optimization Framework for Role-Playing Agents
- 2024Role-Play Paradox in Large Language Models: Reasoning Performance Gains and Ethical Dilemmas
- 2026Identifying and Mitigating Bottlenecks in Role-Playing Agents: A Systematic Study of Disentangling Character Profile Axes
- 2024ERABAL: Enhancing Role-Playing Agents through Boundary-Aware Learning
- 2026Cognitive Enhancement: Rethinking the Necessity of Role-Playing for Large Language Models
- 2026Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- 2025RAIDEN-R1: Improving Role-awareness of LLMs via GRPO with Verifiable Reward
- 2026AI Alignment through a Game-theoretic Lens: A Survey