mlsanityData to 7 Oct 2026

Controllable and explainable personality sliders for LLMs at inference time

arXiv 2603.03326 ↗First posted 10 Feb 2026cs.CL cs.AIcited by 2

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

Aligning Large Language Models (LLMs) with specific personas typically relies on expensive and monolithic Supervised Fine-Tuning (SFT) or RLHF. While effective, these methods require training distinct models for every target personality profile. Inference-time activation steering offers a parameter-efficient alternative, yet naive approaches fail to control multiple traits simultaneously due to destructive vector interference. In this work, we propose a modular framework for continuous, multi-dimensional personality control. Our key innovation is Sequential Adaptive Steering (SAS): a method that orthogonalizes steering vectors by training subsequent probes on the residual stream shifted by prior interventions. This approach transforms steering vectors into reusable primitives, allowing users to instantly synthesize complex, high-fidelity personality profiles by simply adjusting coefficients alpha. We validate our framework on the Big Five personality traits, demonstrating that it outperforms naive baselines in both goal adherence and coherence, enabling precise, holistic personality modulation without updating model parameters.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 19 of its 22 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

19 of 22 references.

References · 19

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2020Scaling Laws for Neural Language Modelscited by 6,411
  6. 2024Qwen2.5 Technical Reportcited by 4,713
  7. 2023Mistral 7Bcited by 3,065
  8. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  9. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  10. 2022Editing Models with Task Arithmeticcited by 1,076
  11. 2023Steering Language Models With Activation Engineeringcited by 824
  12. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
7 more
  1. 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 658
  2. 2023Finding Neurons in a Haystack: Case Studies with Sparse Probingcited by 328
  3. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
  4. 2024LoRA Soups: Merging LoRAs for Practical Skill Composition Taskscited by 49
  5. 2020Separation and Concentration in Deep Networkscited by 28
  6. 2025LLM Knowledge is Brittle: Truthfulness Representations Rely on Superficial Resemblancecited by 9
  7. 2025Linear Personality Probing and Steering in LLMs: A Big Five Studycited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Activation-Space Personality Steering: Hybrid Layer Selection for Stable Trait Control in LLMs
  2. 2026Facet-Level Persona Control by Trait-Activated Routing with Contrastive SAE for Role-Playing LLMs
  3. 2024Extroversion or Introversion? Controlling The Personality of Your Large Language Models
  4. 2025Personality as a Probe for LLM Evaluation: Method Trade-offs and Downstream Effects
  5. 2024P-React: Synthesizing Topic-Adaptive Reactions of Personality Traits via Mixture of Specialized LoRA Experts
  6. 2025The Geometry of Persona: Disentangling Personality from Reasoning in Large Language Models
  7. 2025Evaluating LLM Alignment on Personality Inference from Real-World Interview Data
  8. 2024BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data