mlsanityData to 14 Oct 2026

When Role-playing, Do Models Believe What They Say?

arXiv 2606.11502 ↗First posted 9 Jun 2026cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Language models can state that "the Earth orbits the Sun" and, when role-playing Aristotle, assert the opposite. Recent work argues that persona adoption is fundamental to how language models behave, with models selecting the most appropriate persona for a given context. Does such role-playing merely change the model's outputs, or does it also affect what the model internally represents as truthful? We study this question using the role-play of characters whose beliefs differ from the modern consensus, and induce personas with a number of different methods: prompting, in-context learning (ICL), supervised fine-tuning (SFT), and Open Character Training (OCT), and Emergent Misalignment (EM). We measure belief internalization across these approaches with truth probes and with behavioral tests, finding a broad spectrum of belief internalization. Prompting, ICL, and SFT change what the model says with little representational change. EM creates a large, broad shift in the model's truth representation, and OCT a smaller shift that is clearest on the larger model. Understanding when training changes a model's worldview rather than merely its behavior may become increasingly important as AI systems are entrusted with greater autonomy and influence.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

22 of 35 references.

References · 22

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  3. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  4. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  5. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
  6. 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
  7. 2023Role-Play with Large Language Modelscited by 294
  8. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  9. 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 172
  10. 2023Mechanistically analyzing the effects of fine-tuning on procedurally defined taskscited by 115
  11. 2025Model Organisms for Emergent Misalignmentcited by 91
  12. 2025Weird Generalization and Inductive Backdoors: New Ways to Corrupt LLMscited by 55
10 more
  1. 2025Inoculation Prompting: Eliciting traits from LLMs during training can suppress them at test-timecited by 43
  2. 2025No Answer Needed: Predicting LLM Answer Accuracy from Question-Only Linear Probescited by 38
  3. 2026Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignmentcited by 33
  4. 2024Language Models Represent Beliefs of Self and Otherscited by 31
  5. 2025Believe It or Not: How Deeply do LLMs Believe Implanted Facts?cited by 24
  6. 2025Open Character Training: Shaping the Persona of AI Assistants through Constitutional AIcited by 24
  7. 2025Difficulties with Evaluating a Deception Detector for AIscited by 13
  8. 2023Conditioning Predictive Models: Risks and Strategiescited by 11
  9. 2024Truth-value judgment in language models: 'truth directions' are context sensitivecited by 7
  10. 2026Tracing Persona Vectors Through LLM Pretrainingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.