Persona Matters: Effects of Activation Steering on Short Answer Generation and Scoring
On the map: Mixture-of-experts → MoE large language models
Abstract (arXiv)
Activation-based steering enables inference-time personalization of large language models, but its effects in educational applications are not well understood. We study activation-based persona vectors representing seven character traits in short-answer generation and automated scoring on the ASAP-SAS benchmark, across three language models spanning dense and mixture-of-experts architectures. Persona steering lowers answer quality overall, with much larger effects on open-ended English Language Arts (ELA) prompts than on factual science prompts. Interpretive and argumentative tasks are particularly sensitive, showing up to 11× larger degradation. On the scoring side, we observe predictable valence-aligned calibration shifts: ``evil'' and ``impolite'' scorers grade more harshly, while ``good'' and ``optimistic'' scorers grade more leniently. ELA tasks are 2.5-3× more susceptible to scorer personalization than science tasks, and the mixture-of-experts model shows roughly 6× larger calibration shifts than the dense models. To our knowledge, this is the first study to systematically examine the effects of activation-steered persona traits in educational generation and scoring. Our findings highlight the need for task- and architecture-aware calibration when deploying personalized models in educational settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE large language models, one of 12 directions in Mixture-of-experts. Builds on 10 of its 18 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
10 of 18 references.
References · 10
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 778
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 229
- 2023Evaluating Large Language Models in Theory of Mind Taskscited by 217
- 2023Theory of Mind in Large Language Models: Examining Performance of 11 State-of-the-Art models vs. Children Aged 7-10 on Advanced Testscited by 46
- 2024Exploring Knowledge Tracing in Tutor-Student Dialogues using LLMscited by 44
- 2025Training LLM-based Tutors to Improve Student Learning Outcomes in Dialoguescited by 40
- 2024Beyond Scores: A Modular RAG-Based System for Automatic Short Answer Scoring with Feedbackcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The Persona Hierarchy Model: Understanding Contextual Generalization in Fine-Tuning LLMs
- 2025Dissecting Persona-Driven Reasoning in Language Models via Activation Patching
- 2026Do LLMs Experience an Internal Polylogue? Investigating Reasoning through the Lens of Personas
- 2026Emergent Misalignment Recruits a Pre-existing Persona Subspace
- 2025PILOT: Steering Synthetic Data Generation with Psychological & Linguistic Output Targeting
- 2025EduPersona: Benchmarking Subjective Ability Boundaries of Virtual Student Agents
- 2026Persona Switch: Mixing Distinct Perspectives in Decoding Time
- 2026HACHIMI: Scalable and Controllable Student Persona Generation via Orchestrated Agents