mlsanityData to 14 Oct 2026

Persona Following Is Not Selective Control: The Neutrality Gap in LLM User Simulation

arXiv 2609.35036 ↗First posted 28 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Persona prompting is widely used to construct user simulations with large language models (LLMs), yet it relies on a largely untested assumption: specifying one user attribute should change that attribute alone. We test this assumption and identify a systematic failure of selective control: across all eight black-box LLMs we audit, changing a target attribute also shifts responses on unspecified, non-target attributes. For example, describing a user as more risk-seeking shifts color choices, even though the prompt never mentions color; we term this cross-attribute influence. Semantic, contextual, and internal analyses collectively suggest that models treat a persona prompt as evidence about the user and extend the inferred profile to unspecified preferences, a process we call trait-conditioned completion. We next ask whether explicitly specifying non-target attributes restores selective control. When a non-target attribute is assigned a clear direction, models generally follow the declaration and suppress the target attribute's influence. However, when the same attribute is declared neutral, the target continues to affect choices across all five open-weight checkpoints, even when the model correctly reports the declared state. This disparity, the neutrality gap, demonstrates that successful persona following does not imply selective persona control, which additionally requires keeping non-target attributes stable. We operationalize this distinction with a three-state diagnostic that leaves the non-target attribute unspecified or declares it directional or neutral; because directional tests can be passed by simply following the stated persona, the neutral state reveals failures they miss. In a post hoc analysis of independent items, neutral declarations leave 51-81% of items target-sensitive, against at most 1 of 320 item-pole comparisons under directional ones.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 106 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

23 of 106 references.

References · 23

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  5. 2025Gemma 3 Technical Reportcited by 1,824
  6. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  7. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  8. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  9. 2023Steering Language Models With Activation Engineeringcited by 922
  10. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  11. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  12. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
11 more
  1. 2026Gemma 4 Technical Reportcited by 259
  2. 2026MiMo-V2-Flash Technical Reportcited by 191
  3. 2026Verbalizable Representations Form a Global Workspace in Language Modelscited by 75
  4. 2023The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspectivecited by 59
  5. 2026Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexitycited by 58
  6. 2026Nemotron 3 Super: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoningcited by 38
  7. 2026This human study did not involve human subjects: Validating LLM simulations as behavioral evidencecited by 29
  8. 2026The Chameleon's Limit: Investigating Persona Collapse and Homogenization in Large Language Modelscited by 8
  9. 2026The Illusion of Intervention: Your LLM-Simulated Experiment is an Observational Studycited by 5
  10. 2026Forecasting Side Effects of Activation Steeringcited by 2
  11. 2026Statistical realism is not evidence that LLMs can estimate treatment effects in social science experimentscited by 1

Built on by

Not cited yet.