Fusian: Multi-LoRA Fusion for Fine-Grained Continuous MBTI Personality Control in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated impressive capabilities in simulating diverse human behaviors and personalities. However, existing methods for personality control, which include prompt engineering and standard Supervised Fine-Tuning (SFT), typically treat personality traits as discrete categories (e.g., "Extroverted" vs. "Introverted"), lacking the ability to precisely control the intensity of a trait on a continuous spectrum. In this paper, we introduce Fusian, a novel framework for fine-grained, continuous personality control in LLMs. Fusian operates in two stages: (1) Trajectory Collection, where we capture the dynamic evolution of personality adoption during SFT by saving a sequence of LoRA adapters, effectively mapping the continuous manifold of a trait; and (2) RL-based Dynamic Fusion, where we train a policy network using Reinforcement Learning to dynamically compute mixing weights for these frozen adapters. By sampling from a Dirichlet distribution parameterized by the policy network, Fusian fuses multiple adapters to align the model's output with a specific numerical target intensity. Experiments on the Qwen3-14B model demonstrate that Fusian achieves high precision in personality control, significantly outperforming baseline methods in aligning with user-specified trait intensities.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
19 of 26 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
7 more
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
- 2022Who is GPT-3? An Exploration of Personality, Values and Demographicscited by 112
- 2024Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agentcited by 52
- 2022CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AIcited by 25
- 2025Personality Vector: Modulating Personality of Large Language Models by Model Mergingcited by 16
- 2024Revealing Personality Traits: A New Benchmark Dataset for Explainable Personality Recognition on Dialoguescited by 7
Built on by
Not cited yet.