EpiPersona: Persona Projection and Episode Coupling for Pluralistic Preference Modeling
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
Abstract (arXiv)
Pluralistic alignment is essential for adapting large language models (LLMs) to the diverse preferences of individuals and minority groups. However, existing approaches often mix stable personal traits with episode-specific factors, limiting their ability to generalize across episodes. To address this challenge, we introduce EpiPersona, a framework for explicit persona-episode coupling. EpiPersona first projects noisy preference feedback into a low-dimensional persona space, where similar personas are aggregated into shared discrete codes. This process separates enduring personal characteristics from situational signals without relying on predefined preference dimensions. The inferred persona representation is then coupled with the current episode, enabling episode-aware preference prediction. Extensive experiments show that EpiPersona consistently outperforms the baselines. It achieves notable performance gains in hard episodic-shift scenarios, while remaining effective with sparse preference data.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 24 of its 30 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
24 of 30 references.
Closest ancestors · 9
Same direction, newest first
- 2025SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMs5 Jun
- 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applications21 Mar
- 2025Value Profiles for Encoding Human Variation19 Mar
- 2025From 1,000,000 Users to Every User: Scaling Up Personalized Preference for User-level Alignment19 Mar
- 2025Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personas20 Jan
- 2024PersonalLLM: Tailoring LLMs to Individual Preferences30 Sep
- 2024Personality Alignment of Large Language Models21 Aug
- 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models24 Apr
- 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging17 Oct
Other references · 15
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2017Neural Discrete Representation Learningcited by 4,650
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
- 2024Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learningcited by 147
- 2024Personalization of Large Language Models: A Surveycited by 100
- 2023Group Preference Optimization: Few-Shot Alignment of Large Language Modelscited by 61
- 2024Hypothetical Minds: Scaffolding Theory of Mind for Multi-Agent Tasks with Large Language Modelscited by 45
- 2025Personalized Generation In Large Model Era: A Surveycited by 45
- 2024Position: Theory of Mind Benchmarks are Broken for Large Language Modelscited by 30
- 2023Cross-domain recommendation via user interest alignmentcited by 19
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignment
- 2025Is Active Persona Inference Necessary for Aligning Small Models to Personal Preferences?
- 2026Probing Persona-Dependent Preferences in Language Models
- 2025Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgment
- 2026After Talking with 1,000 Personas: Learning Preference-Aligned Proactive Assistants From Large-Scale Persona Interactions
- 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environments
- 2024PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences
- 2025Fair-PP: A Synthetic Dataset for Aligning LLM with Personalized Preferences of Social Equity