mlsanityData to 7 Oct 2026

Do LLMs Experience an Internal Polylogue? Investigating Reasoning through the Lens of Personas

arXiv 2605.09159 ↗First posted 9 May 2026cs.AIcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Recent work shows that large language models (LLMs) encode behavioral traits ("personas") as linear directions in activation space, often called "persona vectors". Prior work has used such directions as static handles for behavioral steering. We instead treat them as dynamic signals: probes we can monitor and intervene on as reasoning unfolds. We use the term polylogue to denote the time series of alignments between persona vectors and hidden activations over the course of generation. Experiments across four open-weight models show that polylogue features contain predictive signal for correctness comparable to low-dimensional activation summaries, while remaining interpretable through their associated persona directions. They also suggest concrete steering targets, namely, which latent directions to modulate at different stages of a response. We instantiate this as a simple paragraph-conditioned intervention that improves accuracy on three of the four models but degrades the fourth, suggesting that stage-aware latent steering is possible but not yet robust. Together, this positions the polylogue as an interpretable tool for reasoning-time monitoring and intervention.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 13 of its 18 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

13 of 18 references.

References · 13

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2023Let's Verify Step by Stepcited by 3,598
  4. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  5. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  6. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  7. 2022Solving math word problems with process- and outcome-based feedbackcited by 871
  8. 2023Steering Language Models With Activation Engineeringcited by 824
  9. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
  10. 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 217
  11. 2025Mapping the Minds of LLMs: A Graph-Based Analysis of Reasoning LLMcited by 21
  12. 2025What Makes a Good Reasoning Chain? Uncovering Structural Patterns in Long Chain-of-Thought Reasoningcited by 21
1 more
  1. 2025Understanding the Thinking Process of Reasoning Models: A Perspective from Schoenfeld's Episode Theorycited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Dissecting Persona-Driven Reasoning in Language Models via Activation Patching
  2. 2026What Models Express, Suppress, and Resist: Auditing Open-Weight LLMs with Persona Vectors
  3. 2026The Pragmatic Persona: Discovering LLM Persona through Bridging Inference
  4. 2026Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference
  5. 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models
  6. 2026Expert Personas Improve LLM Alignment but Damage Accuracy: Bootstrapping Intent-Based Persona Routing with PRISM
  7. 2024Examining Identity Drift in Conversations of LLM Agents
  8. 2026Your Language Model Secretly Contains Personality Subnetworks