R2A: Learning Persona Policies Through Persona Representation Learning and Runtime Alignment
Not on the map. Why?
Abstract (arXiv)
The same Persona behavior can be beneficial in one context but harmful in another, causing static Persona elicitation to perform inconsistently across tasks. We introduce the Persona Selection--Realization Framework, which models behavior generation through a latent Persona state and decomposes it into Persona Selection and Persona Realization. The discrepancies between static Persona elicitation and an ideal Persona policy in these two components define the Selection Gap and Realization Gap, respectively. Building on this framework, we propose R2A, a two-stage approach for learning Persona policies. Persona Representation Learning uses structured Who--How--What presentations to encode the target Persona's objective, conditional behavioral principles, and trajectory-level manifestations. Persona Runtime Alignment then removes the explicit Persona specification and jointly calibrates behavior selection and trajectory realization using task feedback. Across 12 evaluation settings covering the four principles of the Accountable-Professional Persona studied in this work, R2A overall outperforms both the base model and static Persona elicitation. Ablation results further show that Persona Representation Learning is critical for preventing Runtime Alignment from producing behaviorally imbalanced policies and for achieving more stable Persona policy learning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 18 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
9 of 18 references.
References · 9
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
- 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 261
- 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 220
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
- 2025ACECODER: Acing Coder RL via Automated Test-Case Synthesiscited by 89
- 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 85
- 2025QuestBench: Can LLMs ask the right question to acquire information in reasoning tasks?cited by 56
- 2024Exploring the Compositional Deficiency of Large Language Models in Mathematical Reasoningcited by 15
Built on by
Not cited yet.