mlsanityData to 14 Oct 2026

The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs

arXiv 2609.07117 ↗First posted 7 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Prompt-based interventions: system prompts, personas, role instructions, reliably reshape what a language model says, but it is unclear which layer they reach. Do they reconfigure internal structure, or only modulate the output channel? We use persona conditioning as a controlled probe, measuring its effects along a depth axis from self-report, through open-ended generation, to word-level parametric association, across three instruction-tuned models. We find a graded dissociation. Personas are legible but not structural: models follow single-trait instructions yet fail to reproduce human inter-trait covariance. The dissociation deepens with depth: personas hold or amplify closed-form QA bias, shift absolute tone while leaving between-group disparity unchanged, and barely perturb an already saturated associative baseline. Prompt-based steering thus operates in the output channel and has a structural reach limit that surface manipulability can mask.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 72 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

13 of 72 references.

References · 13

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  2. 2016Equality of Opportunity in Supervised Learningcited by 2,007
  3. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
  4. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  5. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 515
  6. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
  7. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  8. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
  9. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
  10. 2024Investigating Implicit Bias in Large Language Models: A Large-Scale Study of Over 50 LLMscited by 25
  11. 2025OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personascited by 25
  12. 2025Silenced Biases: The Dark Side LLMs Learned to Refusecited by 10
1 more
  1. 2025Bias after Prompting: Persistent Discrimination in Large Language Modelscited by 3

Built on by

Not cited yet.