How Far Do Persona Effects Generalize in Language Models?
Not on the map. Why?
Abstract (arXiv)
Persona prompts ask language models to answer as particular kinds of people. We test whether relationships learned from these effects predict responses to new questions and remain useful across models and prompts. Across 57 attributes, three behavioral domains, and seven pairs of open 7 to 9B checkpoints, persona effects can be predictable without being portable. Separate attribute and task gains improve prediction beyond shared scaling significantly in OLMo-3 and Qwen2.5, with the most robust evidence in OLMo-3. In that model, target refitting significantly outperforms gains borrowed from each of the other six pairs. Across model transfers, borrowed gains with one amplitude underperform shared scaling in most directions; allowing two target parameters removes the significant losses but yields no significant benefit over target shared scaling. After rewording, refitting significantly outperforms reuse with one amplitude in all six tested pairs, while changes of examples or country context often preserve reuse value. In the tested prompt transfers, regularized updates outperform both reuse strategies in median at 64 target questions per attribute. A separate survey comparison finds that selecting the more responsive checkpoint can worsen human fit; responsiveness is confounded with training status, and temperature calibration largely removes this cost but not errors in group ordering. Within the tested gain representation, apparent transfer can come from target calibration; source relationships must add predictive value beyond calibration and regularization. Code and data are available at https://github.com/thzva/persona-gain
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 26 Sep 2026.
Builds on
27 of 32 references.
References · 27
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 515
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
- 2024Quantifying the Persona Effect in LLM Simulationscited by 169
- 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
- 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 90
- 2025Persona Features Control Emergent Misalignmentcited by 86
15 more
- 2023Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Promptingcited by 81
- 2024Evaluating Large Language Model Biases in Persona-Steered Generationcited by 78
- 2023Questioning the Survey Responses of Large Language Modelscited by 74
- 2024"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Modelscited by 69
- 2024Benchmarking Distributional Alignment of Large Language Modelscited by 61
- 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 51
- 2025The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Modelscited by 42
- 2024Evaluating the Prompt Steerability of Large Language Modelscited by 27
- 2025Spectrum Tuning: Post-Training for Distributional Coverage and In-Context Steerabilitycited by 20
- 2025DeepPersona: A Generative Engine for Scaling Deep Synthetic Personascited by 15
- 2026The Chameleon's Limit: Investigating Persona Collapse and Homogenization in Large Language Modelscited by 8
- 2025German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studiescited by 5
- 2026How Well Do Large Language Models Capture Human Personality?cited by 2
- 2026When Persona Attributes Improve Population Alignment in Large Language Modelscited by 2
- 2026Diagnosing and Repairing Persona Collapse in LLM Advicecited by 1
Built on by
Not cited yet.