Beyond One World: Benchmarking Super Heros in Role-Playing Across Multiversal Contexts
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used as role-playing agents, yet their capacity to faithfully and consistently portray version-specific characters -- for example, superheroes across comic and cinematic universes -- remains underexplored. Superhero canons such as Marvel and DC provide a rich testbed: decades of storytelling yield multiple incarnations of the same character with distinct histories, values, and moral codes. To study this problem, we introduce Beyond One World, a benchmark for character-grounded roleplay spanning 30 iconic heroes and 90 canon-specific versions. The benchmark comprises two tasks: (i) Canon Events, which probes factual recall of pivotal life stages, and (ii) Moral Dilemmas, which confronts models with ethically charged scenarios. We score responses for canonical accuracy and reasoning fidelity under a framework that separates internal deliberation ("thinking") from outward decisions ("acting"). We further propose Think-Act Matching, a metric that quantifies alignment between reasons and actions and serves as a proxy for model trustworthiness. Experiments across reasoning- and non-reasoning-oriented models yield three findings: (1) chain-of-thought prompting improves narrative coherence in weaker models but can reduce canonical accuracy in stronger ones; (2) cross-version generalization within a character remains a major obstacle; and (3) models often excel at either thinking or acting, but rarely both. Beyond One World exposes critical gaps in multiversal consistency and reasoning alignment, offering a challenging evaluation for role-playing LLMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 31 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
9 of 31 references.
References · 9
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 179
- 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluationcited by 143
- 2024Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignmentcited by 104
- 2024SocialBench: Sociality Evaluation of Role-Playing Conversational Agentscited by 50
- 2022Heroes, Villains, and Victims, and GPT-3: Automated Extraction of Character Roles Without Training Datacited by 27
- 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agentscited by 22
- 2025Reasoning Does Not Necessarily Improve Role-Playing Abilitycited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Too Good to be Bad: On the Failure of LLMs to Role-Play Villains
- 2026Identifying and Mitigating Bottlenecks in Role-Playing Agents: A Systematic Study of Disentangling Character Profile Axes
- 2026RoleCDE:Benchmarking and Mitigating Role-Alignment Trade-offs in Role-Playing Agents
- 2025Operation Veja: Fixing Fundamental Concepts Missing from Modern Roleplaying Training Paradigms
- 2026NARRA-Gym for Evaluating Interactive Narrative Agents
- 2023Better Zero-Shot Reasoning with Role-Play Prompting
- 2026Cognitive Enhancement: Rethinking the Necessity of Role-Playing for Large Language Models
- 2026Rethinking Role-Playing Evaluation: Anonymous Benchmarking and a Systematic Study of Personality Effects