mlsanityData to 7 Oct 2026

Persona Matters: Effects of Activation Steering on Short Answer Generation and Scoring

arXiv 2604.07102 ↗First posted 8 Apr 2026cs.CL cs.AIcited by 0

On the map: Mixture-of-experts → MoE large language models

Abstract (arXiv)

Activation-based steering enables inference-time personalization of large language models, but its effects in educational applications are not well understood. We study activation-based persona vectors representing seven character traits in short-answer generation and automated scoring on the ASAP-SAS benchmark, across three language models spanning dense and mixture-of-experts architectures. Persona steering lowers answer quality overall, with much larger effects on open-ended English Language Arts (ELA) prompts than on factual science prompts. Interpretive and argumentative tasks are particularly sensitive, showing up to 11× larger degradation. On the scoring side, we observe predictable valence-aligned calibration shifts: ``evil'' and ``impolite'' scorers grade more harshly, while ``good'' and ``optimistic'' scorers grade more leniently. ELA tasks are 2.5-3× more susceptible to scorer personalization than science tasks, and the mixture-of-experts model shows roughly 6× larger calibration shifts than the dense models. To our knowledge, this is the first study to systematically examine the effects of activation-steered persona traits in educational generation and scoring. Our findings highlight the need for task- and architecture-aware calibration when deploying personalized models in educational settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE large language models, one of 12 directions in Mixture-of-experts. Builds on 10 of its 18 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

10 of 18 references.

References · 10

  1. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  2. 2023Steering Language Models With Activation Engineeringcited by 824
  3. 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 778
  4. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
  5. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 229
  6. 2023Evaluating Large Language Models in Theory of Mind Taskscited by 217
  7. 2023Theory of Mind in Large Language Models: Examining Performance of 11 State-of-the-Art models vs. Children Aged 7-10 on Advanced Testscited by 46
  8. 2024Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMscited by 44
  9. 2025Training LLM-based Tutors to Improve Student Learning Outcomes in Dialoguescited by 40
  10. 2024Beyond Scores: A Modular RAG-Based System for Automatic Short Answer Scoring with Feedbackcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Persona Hierarchy Model: Understanding Contextual Generalization in Fine-Tuning LLMs
  2. 2025Dissecting Persona-Driven Reasoning in Language Models via Activation Patching
  3. 2026Do LLMs Experience an Internal Polylogue? Investigating Reasoning through the Lens of Personas
  4. 2026Emergent Misalignment Recruits a Pre-existing Persona Subspace
  5. 2025PILOT: Steering Synthetic Data Generation with Psychological & Linguistic Output Targeting
  6. 2025EduPersona: Benchmarking Subjective Ability Boundaries of Virtual Student Agents
  7. 2026Persona Switch: Mixing Distinct Perspectives in Decoding Time
  8. 2026HACHIMI: Scalable and Controllable Student Persona Generation via Orchestrated Agents