When Role-playing, Do Models Believe What They Say?
Not on the map. Why?
Abstract (arXiv)
Language models can state that "the Earth orbits the Sun" and, when role-playing Aristotle, assert the opposite. Recent work argues that persona adoption is fundamental to how language models behave, with models selecting the most appropriate persona for a given context. Does such role-playing merely change the model's outputs, or does it also affect what the model internally represents as truthful? We study this question using the role-play of characters whose beliefs differ from the modern consensus, and induce personas with a number of different methods: prompting, in-context learning (ICL), supervised fine-tuning (SFT), and Open Character Training (OCT), and Emergent Misalignment (EM). We measure belief internalization across these approaches with truth probes and with behavioral tests, finding a broad spectrum of belief internalization. Prompting, ICL, and SFT change what the model says with little representational change. EM creates a large, broad shift in the model's truth representation, and OCT a smaller shift that is clearest on the larger model. Understanding when training changes a model's worldview rather than merely its behavior may become increasingly important as AI systems are entrusted with greater autonomy and influence.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
22 of 35 references.
References · 22
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
- 2023Role-Play with Large Language Modelscited by 294
- 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
- 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 172
- 2023Mechanistically analyzing the effects of fine-tuning on procedurally defined taskscited by 115
- 2025Model Organisms for Emergent Misalignmentcited by 91
- 2025Weird Generalization and Inductive Backdoors: New Ways to Corrupt LLMscited by 55
10 more
- 2025Inoculation Prompting: Eliciting traits from LLMs during training can suppress them at test-timecited by 43
- 2025No Answer Needed: Predicting LLM Answer Accuracy from Question-Only Linear Probescited by 38
- 2026Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignmentcited by 33
- 2024Language Models Represent Beliefs of Self and Otherscited by 31
- 2025Believe It or Not: How Deeply do LLMs Believe Implanted Facts?cited by 24
- 2025Open Character Training: Shaping the Persona of AI Assistants through Constitutional AIcited by 24
- 2025Difficulties with Evaluating a Deception Detector for AIscited by 13
- 2023Conditioning Predictive Models: Risks and Strategiescited by 11
- 2024Truth-value judgment in language models: 'truth directions' are context sensitivecited by 7
- 2026Tracing Persona Vectors Through LLM Pretrainingcited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Character Training for Risk-Averse Agentscited by 0
- 2026Stress-Testing LLM Lie Detectors: Role-Play Failures and Spurious Correlationscited by 0
- 2026Pre-training interventions, ex post facto: Grafting model beliefs across checkpointscited by 0
- 2026Predicting Alignment Generalization with Value Representationscited by 0
- 2026Predicting Alignment Generalization with Value Representations8 Oct 2026
- 2026Pre-training interventions, ex post facto: Grafting model beliefs across checkpoints30 Sep 2026
- 2026Stress-Testing LLM Lie Detectors: Role-Play Failures and Spurious Correlations30 Sep 2026
- 2026Character Training for Risk-Averse Agents29 Sep 2026