Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment
Not on the map. Why?
Cited by 21 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Considerable efforts have been invested in augmenting the role-playing proficiency of open-source large language models (LLMs) by emulating proprietary counterparts. Nevertheless, we posit that LLMs inherently harbor role-play capabilities, owing to the extensive knowledge of characters and potential dialogues ingrained in their vast training corpora. Thus, in this study, we introduce Ditto, a self-alignment method for role-play. Ditto capitalizes on character knowledge, encouraging an instruction-following LLM to simulate role-play dialogues as a variant of reading comprehension. This method creates a role-play training set comprising 4,000 characters, surpassing the scale of currently available datasets by tenfold regarding the number of roles. Subsequently, we fine-tune the LLM using this self-generated dataset to augment its role-playing capabilities. Upon evaluating our meticulously constructed and reproducible role-play benchmark and the roleplay subset of MT-Bench, Ditto, in various parameter scales, consistently maintains a consistent role identity and provides accurate role-specific knowledge in multi-turn role-play conversations. Notably, it outperforms all open-source role-play baselines, showcasing performance levels comparable to advanced proprietary chatbots. Furthermore, we present the first comprehensive cross-supervision alignment experiment in the role-play domain, revealing that the intrinsic capabilities of LLMs confine the knowledge within role-play. Meanwhile, the role-play styles can be easily acquired with the guidance of smaller models. We open-source related resources at https://github.com/OFA-Sys/Ditto.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). Builds on 11 of its 21 references that are in the map. First posted on arXiv 23 Jan 2024.
Builds on
11 of 21 references.
References · 11
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Qwen Technical Reportcited by 3,273
- 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 445
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
- 2023The False Promise of Imitating Proprietary LLMscited by 254
- 2023OpenChat: Advancing Open-source Language Models with Mixed-Quality Datacited by 250
- 2023Wider and Deeper LLM Networks are Fairer LLM Evaluatorscited by 91
- 2023CharacterChat: Learning towards Conversational AI with Personalized Social Supportcited by 58
- 2020Coarse-to-Fine Pre-training for Named Entity Recognitioncited by 28
Built on by
Citing papers per year: 2024: 41; 2025: 41; 2026: 22.
104 papers.
Sort:
By area:
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024Qwen2 Technical Reportcited by 2,076
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2024A Survey on Self-Evolution of Large Language Modelscited by 86
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignmentcited by 71
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
- 2024From Role-Play to Drama-Interaction: An LLM Solutioncited by 42
- 2025SPC: Evolving Self-Play Critic via Adversarial Games for LLM Reasoningcited by 40
- 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 38
- 2024IBSEN: Director-Actor Agent Collaboration for Controllable and Interactive Drama Script Generationcited by 35
- 2024AI Safety in Generative AI Large Language Models: A Surveycited by 31
- 2025SDPO: Segment-Level Direct Preference Optimization for Social Agentscited by 29
38 more
- 2025Enhancing Persona Consistency for LLMs' Role-Playing using Persona-Aware Contrastive Learningcited by 27
- 2024Emotional RAG: Enhancing Role-Playing Agents through Emotional Retrievalcited by 26
- 2025CoSER: A Comprehensive Literary Dataset and Framework for Training and Evaluating LLM Role-Playing and Persona Simulationcited by 26
- 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personascited by 25
- 2024SweetieChat: A Strategy-Enhanced Role-playing Framework for Diverse Scenarios Handling Emotional Support Agentcited by 24
- 2025Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMscited by 22
- 2024TimeChara: Evaluating Point-in-Time Character Hallucination of Role-Playing Large Language Modelscited by 21
- 2025AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulationcited by 21
- 2025Population-Aligned Persona Generation for LLM-based Social Simulationcited by 20
- 2024RoleBreak: Character Hallucination as a Jailbreak Attack in Role-Playing Systemscited by 19
- 2024Mitigating Hallucination in Fictional Character Role-Playcited by 17
- 2024Self-Cognition in Large Language Models: An Exploratory Studycited by 14
- 2026A Survey on LLM-based Conversational User Simulationcited by 14
- 2024BEYOND DIALOGUE: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Modelcited by 13
- 2024Multi-expert Prompting Improves Reliability, Safety, and Usefulness of Large Language Modelscited by 13
- 2025NarraBench: A Comprehensive Framework for Narrative Benchmarkingcited by 13
- 2025Persistent Personas? Role-Playing, Instruction Following, and Safety in Extended Interactionscited by 12
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trendscited by 11
- 2024Crafting Customisable Characters with LLMs: A Persona-Driven Role-Playing Agent Frameworkcited by 10
- 2024PingPong: A Benchmark for Role-Playing Language Models with User Emulation and Multi-Model Evaluationcited by 10
- 2025RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playingcited by 10
- 2025CPO: Addressing Reward Ambiguity in Role-playing Dialogue via Comparative Policy Optimizationcited by 10
- 2024Revealing and Mitigating the Challenge of Detecting Character Knowledge Errors in LLM Role-Playingcited by 9
- 2025Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMscited by 9
- 2025Towards Enhanced Immersion and Agency for LLM-based Interactive Dramacited by 9
- 2025PersonaEval: Are LLM Evaluators Human Enough to Judge Role-Play?cited by 9
- 2025Impatient Users Confuse AI Agents: High-fidelity Simulations of Human Traits for Testing Agentscited by 8
- 2024ChatGPT Role-play Dataset: Analysis of User Motives and Model Naturalnesscited by 7
- 2024Who Speaks Next? Multi-party AI Discussion Leveraging the Systematics of Turn-taking in Murder Mystery Gamescited by 7
- 2025The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agentscited by 7
- 2025Simulating Before Planning: Constructing Intrinsic User World Model for User-Tailored Dialogue Policy Planningcited by 7
- 2025RoleRAG: Enhancing LLM Role-Playing via Graph Guided Retrievalcited by 7
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarmscited by 7
- 2025HyCoRA: Hyper-Contrastive Role-Adaptive Learning for Role-Playingcited by 7
- 2026Reward Modeling from Natural Language Human Feedbackcited by 7
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agentscited by 6
- 2024A Multi-Task Role-Playing Agent Capable of Imitating Character Linguistic Stylescited by 6
- 2024DEMO: Reframing Dialogue Interaction with Fine-grained Element Modelingcited by 6
50 most cited of 104 All 104 (JSON)
- 2026Adversarial Closed-Loop Curriculum for Evolving Role-Playing Agents23 Sep 2026
- 2026CHARM: Character Hallucination for Multicultural Role Play Benchmark1 Sep 2026
- 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girls11 Aug 2026
- 2026Beyond Borrowed Histories: Person-Aligned User Simulation for Interactive Role-Playing Evaluation30 Jul 2026
- 2026AI YOU Town: Make Friends and Money with Your Digital Twin12 Jul 2026
- 2026Who Plays Which Role When? Communication Role Dynamics for Peer Recognition and Team Performance Prediction26 Jun 2026
- 2026Dissociative Identity: Language Model Agents Lack Grounding for Reputation Mechanisms28 May 2026
- 2026DynSess: Dynamic Session-Level Evaluation and Optimization Framework for Role-Playing Agents28 May 2026
- 2026DREAM: LLM-based Dynamic Role-playing via Event-Aware Memory Graph27 May 2026
- 2026BOOKMARKS: Efficient Active Storyline Memory for Role-playing13 May 2026
- 2026Reward-Decomposed Reinforcement Learning for Immersive Video Role-Playing6 May 2026
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
38 more
- 2026Character Beyond Speech: Leveraging Role-Playing Evaluation in Audio Large Language Models via Reinforcement Learning15 Apr 2026
- 2026Beyond Prompt: Fine-grained Simulation of Cognitively Impaired Standardized Patients via Stochastic Steering14 Apr 2026
- 2026Beyond Compliance: A Resistance-Informed Motivation Reasoning Framework for Challenging Psychological Client Simulation12 Apr 2026
- 2026Memory-Driven Role-Playing: Evaluation and Enhancement of Persona Knowledge Utilization in LLMs14 Mar 2026
- 2026Rethinking Role-Playing Evaluation: Anonymous Benchmarking and a Systematic Study of Personality Effects4 Mar 2026
- 2026From Utterance to Vividity: Training Expressive Subtitle Translation LLM via Adaptive Local Preference Optimization1 Feb 2026
- 2026Reward Modeling from Natural Language Human Feedback12 Jan 2026
- 2026Identifying and Mitigating Bottlenecks in Role-Playing Agents: A Systematic Study of Disentangling Character Profile Axes8 Jan 2026
- 2026PsyAgent: Constructing Human-like Agents Based on Psychological Modeling and Contextual Interaction6 Jan 2026
- 2026Is He Extroverted? Identifying Missing Relevant Personas for Faithful User Simulation3 Jan 2026
- 2025Understanding Generalization in Role-Playing Models via Information Theory19 Dec 2025
- 2025Persistent Personas? Role-Playing, Instruction Following, and Safety in Extended Interactions14 Dec 2025
- 2025MOA: Multi-Objective Alignment for Role-Playing Agents10 Dec 2025
- 2025HyCoRA: Hyper-Contrastive Role-Adaptive Learning for Role-Playing11 Nov 2025
- 2025Beyond One World: Benchmarking Super Heros in Role-Playing Across Multiversal Contexts16 Oct 2025
- 2025NarraBench: A Comprehensive Framework for Narrative Benchmarking10 Oct 2025
- 2025Impatient Users Confuse AI Agents: High-fidelity Simulations of Human Traits for Testing Agents6 Oct 2025
- 2025Video2Roleplay: A Multimodal Dataset and Framework for Video-Guided Role-playing Agents17 Sep 2025
- 2025RAGs to Riches: RAG-like Few-shot Learning for Large Language Model Role-playing15 Sep 2025
- 2025Pluralistic Alignment for Healthcare: A Role-Driven Framework12 Sep 2025
- 2025Population-Aligned Persona Generation for LLM-based Social Simulation12 Sep 2025
- 2025Understanding Reinforcement Learning for Model Training, and future directions with GRAPE2 Sep 2025
- 2025CPO: Addressing Reward Ambiguity in Role-playing Dialogue via Comparative Policy Optimization12 Aug 2025
- 2025Score Before You Speak: Improving Persona Consistency in Dialogue Generation using Response Quality Scores9 Aug 2025
- 2025PersonaEval: Are LLM Evaluators Human Enough to Judge Role-Play?6 Aug 2025
- 2025Dynamic Context Adaptation for Consistent Role-Playing Agents with Retrieval-Augmented Generations4 Aug 2025
- 2025RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing27 Jul 2025
- 2025Test-Time-Matching: Decouple Personality, Memory, and Linguistic Style in LLM-based Role-Playing Language Agent22 Jul 2025
- 2025HAMLET: A Hierarchical and Adaptive Multi-Agent Framework for Live Embodied Theatrics21 Jul 2025
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms2 Jul 2025
- 2025ORPP: Self-Optimizing Role-playing Prompts to Enhance Language Model Capabilities3 Jun 2025
- 2025AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation31 May 2025
- 2025When Harry Meets Superman: The Role of The Interlocutor in Persona-Based Dialogue Generation30 May 2025
- 2025Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity29 May 2025
- 2025STEER-BENCH: A Benchmark for Evaluating the Steerability of Large Language Models27 May 2025
- 2025RoleRAG: Enhancing LLM Role-Playing via Graph Guided Retrieval24 May 2025
- 2025Role-Playing Evaluation for Large Language Models19 May 2025
- 2025PsyMem: Fine-grained psychological alignment and Explicit Memory Control for Advanced Role-Playing LLMs19 May 2025
50 newest of 104 All 104 (JSON)
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2024IBSEN: Director-Actor Agent Collaboration for Controllable and Interactive Drama Script Generationcited by 35
- 2025SDPO: Segment-Level Direct Preference Optimization for Social Agentscited by 29
- 2024SweetieChat: A Strategy-Enhanced Role-playing Framework for Diverse Scenarios Handling Emotional Support Agentcited by 24
- 2025AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulationcited by 21
- 2024Crafting Customisable Characters with LLMs: A Persona-Driven Role-Playing Agent Frameworkcited by 10
- 2025The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agentscited by 7
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarmscited by 7
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agentscited by 6
- 2024A Multi-Task Role-Playing Agent Capable of Imitating Character Linguistic Stylescited by 6
- 2024ERABAL: Enhancing Role-Playing Agents through Boundary-Aware Learningcited by 5
- 2024Apollonion: Profile-centric Dialog Agentcited by 4
12 most cited of 20 All 20 (JSON)
- 2026Adversarial Closed-Loop Curriculum for Evolving Role-Playing Agents23 Sep 2026
- 2026Dissociative Identity: Language Model Agents Lack Grounding for Reputation Mechanisms28 May 2026
- 2026DynSess: Dynamic Session-Level Evaluation and Optimization Framework for Role-Playing Agents28 May 2026
- 2026Identifying and Mitigating Bottlenecks in Role-Playing Agents: A Systematic Study of Disentangling Character Profile Axes8 Jan 2026
- 2025Video2Roleplay: A Multimodal Dataset and Framework for Video-Guided Role-playing Agents17 Sep 2025
- 2025Test-Time-Matching: Decouple Personality, Memory, and Linguistic Style in LLM-based Role-Playing Language Agent22 Jul 2025
- 2025HAMLET: A Hierarchical and Adaptive Multi-Agent Framework for Live Embodied Theatrics21 Jul 2025
- 2025RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms2 Jul 2025
- 2025AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation31 May 2025
- 2025The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agents28 Feb 2025
- 2025SDPO: Segment-Level Direct Preference Optimization for Social Agents3 Jan 2025
- 2024SweetieChat: A Strategy-Enhanced Role-playing Framework for Diverse Scenarios Handling Emotional Support Agent11 Dec 2024
12 newest of 20 All 20 (JSON)
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignmentcited by 71
- 2026Reward Modeling from Natural Language Human Feedbackcited by 7
- 2024Mixture-of-Instructions: Aligning Large Language Models via Mixture Promptingcited by 4
- 2025Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguitycited by 2
- 2026From Utterance to Vividity: Training Expressive Subtitle Translation LLM via Adaptive Local Preference Optimizationcited by 1
- 2026From Utterance to Vividity: Training Expressive Subtitle Translation LLM via Adaptive Local Preference Optimization1 Feb 2026
- 2026Reward Modeling from Natural Language Human Feedback12 Jan 2026
- 2025Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity29 May 2025
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignment24 Jul 2024
- 2024Mixture-of-Instructions: Aligning Large Language Models via Mixture Prompting29 Apr 2024
- 2025SPC: Evolving Self-Play Critic via Adversarial Games for LLM Reasoningcited by 40
- 2025CPO: Addressing Reward Ambiguity in Role-playing Dialogue via Comparative Policy Optimizationcited by 10
- 2024Thinking Before Speaking: A Role-playing Model with Mindsetcited by 5
- 2025Understanding Reinforcement Learning for Model Training, and future directions with GRAPEcited by 1
- 2026Beyond Compliance: A Resistance-Informed Motivation Reasoning Framework for Challenging Psychological Client Simulationcited by 1
- 2026Beyond Compliance: A Resistance-Informed Motivation Reasoning Framework for Challenging Psychological Client Simulation12 Apr 2026
- 2025Understanding Reinforcement Learning for Model Training, and future directions with GRAPE2 Sep 2025
- 2025CPO: Addressing Reward Ambiguity in Role-playing Dialogue via Comparative Policy Optimization12 Aug 2025
- 2025SPC: Evolving Self-Play Critic via Adversarial Games for LLM Reasoning27 Apr 2025
- 2024Thinking Before Speaking: A Role-playing Model with Mindset14 Sep 2024
- 2024Emotional RAG: Enhancing Role-Playing Agents through Emotional Retrievalcited by 26
- 2025Dynamic Context Adaptation for Consistent Role-Playing Agents with Retrieval-Augmented Generationscited by 4
- 2024RAM2C: A Liberal Arts Educational Chatbot based on Retrieval-augmented Multi-role Multi-expert Collaborationcited by 1
- 2025Dynamic Context Adaptation for Consistent Role-Playing Agents with Retrieval-Augmented Generations4 Aug 2025
- 2024Emotional RAG: Enhancing Role-Playing Agents through Emotional Retrieval30 Oct 2024
- 2024RAM2C: A Liberal Arts Educational Chatbot based on Retrieval-augmented Multi-role Multi-expert Collaboration23 Sep 2024
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024Qwen2.5 Technical Report19 Dec 2024
- 2024Qwen2 Technical Reportcited by 2,076
- 2024A Survey on Self-Evolution of Large Language Modelscited by 86
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
- 2024From Role-Play to Drama-Interaction: An LLM Solutioncited by 42
- 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 38
- 2024AI Safety in Generative AI Large Language Models: A Surveycited by 31
- 2025Enhancing Persona Consistency for LLMs' Role-Playing using Persona-Aware Contrastive Learningcited by 27
- 2025CoSER: A Comprehensive Literary Dataset and Framework for Training and Evaluating LLM Role-Playing and Persona Simulationcited by 26
- 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personascited by 25
- 2025Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMscited by 22
- 2024TimeChara: Evaluating Point-in-Time Character Hallucination of Role-Playing Large Language Modelscited by 21
- 2025Population-Aligned Persona Generation for LLM-based Social Simulationcited by 20
12 most cited of 67 All 67 (JSON)
- 2026CHARM: Character Hallucination for Multicultural Role Play Benchmark1 Sep 2026
- 2026ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girls11 Aug 2026
- 2026Beyond Borrowed Histories: Person-Aligned User Simulation for Interactive Role-Playing Evaluation30 Jul 2026
- 2026AI YOU Town: Make Friends and Money with Your Digital Twin12 Jul 2026
- 2026Who Plays Which Role When? Communication Role Dynamics for Peer Recognition and Team Performance Prediction26 Jun 2026
- 2026DREAM: LLM-based Dynamic Role-playing via Event-Aware Memory Graph27 May 2026
- 2026BOOKMARKS: Efficient Active Storyline Memory for Role-playing13 May 2026
- 2026Reward-Decomposed Reinforcement Learning for Immersive Video Role-Playing6 May 2026
- 2026A Survey on LLM-based Conversational User Simulation27 Apr 2026
- 2026Character Beyond Speech: Leveraging Role-Playing Evaluation in Audio Large Language Models via Reinforcement Learning15 Apr 2026
- 2026Beyond Prompt: Fine-grained Simulation of Cognitively Impaired Standardized Patients via Stochastic Steering14 Apr 2026
- 2026Memory-Driven Role-Playing: Evaluation and Enhancement of Persona Knowledge Utilization in LLMs14 Mar 2026
12 newest of 67 All 67 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025RoleMRC: A Fine-Grained Composite Benchmark for Role-Playing and Instruction-Following
- 2026Cognitive Enhancement: Rethinking the Necessity of Role-Playing for Large Language Models
- 2025Reasoning Does Not Necessarily Improve Role-Playing Ability
- 2025Improving LLM Reasoning through Interpretable Role-Playing Steering
- 2023Better Zero-Shot Reasoning with Role-Play Prompting
- 2026OSPD: On-Policy Self-Distillation for Persona-Consistent Dialogue
- 2025SpeechRole: A Large-Scale Dataset and Benchmark for Evaluating Speech Role-Playing Agents
- 2023RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Models