The Librarian Who Refused to Code: Model-Dependent Identity Enactment in LLM Code Generation
Not on the map. Why?
Abstract (arXiv)
Biographical personas are widely used in system prompts, but their effects on code generation are rarely evaluated under controlled, pre-registered conditions. We tested four prompt conditions (no persona, two engineer personas, and a research-librarian persona), 12 code-generation tasks, two frontier models, and five runs per cell (480 completions). Persona effects differed between the two tested models. Under the pre-registered mixed-effects analysis, the condition-by-model interaction was significant for provider-reported output tokens; a post-hoc visible-character measure showed the same qualitative pattern. Six GPT-5.5 completions were length-capped and are reported separately. On Claude Opus, the minimalist engineer persona reduced visible output by 30% (33% in provider tokens) without improving correctness, while the thorough engineer persona increased output without a correctness gain. In an exploratory post-hoc analysis, the librarian persona elicited in-character disclaimers in 55 of 60 Opus responses and 12 genuine no-code responses, lowering mean correctness from 0.92 to 0.67. GPT-5.5 produced neither behavior in its 59 non-truncated responses. These results are consistent with personas acting as Model-Dependent behavioral-policy biases rather than universal quality interventions. We release raw completions, derived scores, analysis artifacts, a pre-registration document, and an execution gate log; end-to-end test-based rescoring requires an unreleased task harness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 16 references that are in the map. First posted on arXiv 19 Jul 2026.
Builds on
8 of 16 references.
References · 8
- 2024A Survey on Large Language Models for Code Generationcited by 658
- 2024LLM-Based Test-Driven Interactive Code Generation: User Study and Empirical Evaluationcited by 49
- 2025The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Modelscited by 42
- 2025Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performancecited by 18
- 2026Expert Personas Improve LLM Alignment but Damage Accuracy: Bootstrapping Intent-Based Persona Routing with PRISMcited by 9
- 2025SPeCtrum: A Grounded Framework for Multidimensional Identity Representation in LLM-Based Agentcited by 8
- 2026Persona Prompting as a Lens on LLM Social Reasoningcited by 3
- 2026Understanding Specification-Driven Code Generation with LLMs: An Empirical Study Designcited by 1
Built on by
Not cited yet.