After Talking with 1,000 Personas: Learning Preference-Aligned Proactive Assistants From Large-Scale Persona Interactions
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
Abstract (arXiv)
Smart assistants increasingly act proactively, yet mistimed or intrusive behavior often causes users to lose trust and disable these features. Learning user preferences for proactive assistance is difficult because real-world studies are costly, limited in scale, and rarely capture how preferences change across multiple interaction sessions. Large language model based generative agents offer a way to simulate realistic interactions, but existing synthetic datasets remain limited in temporal depth, diverse personas, and multi-dimensional preferences. They also provide little support for transferring population-level insights to individual users under on-device constraints. We present a population-to-individual learning framework for preference-aligned proactive assistants that operates under on-device and privacy constraints. Our approach uses large-scale interaction simulation with 1,000 diverse personas to learn shared structure in how users express preferences across recurring dimensions such as timing, autonomy, and communication style, providing a strong cold start without relying on real user logs. The assistant then adapts to individual users on device through lightweight activation-based steering driven by simple interaction feedback, without model retraining or cloud-side updates. We evaluate the framework using controlled simulations with 1,000 simulated personas and a human-subject study with 34 participants. Results show improved timing decisions and perceived interaction quality over untuned and direct-response baselines, while on-device activation steering achieves performance comparable to reinforcement learning from human feedback. Participants also report higher satisfaction, trust, and comfort as the assistant adapts over multiple sessions of interactions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 42 of its 77 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
42 of 77 references.
Closest ancestors · 3
Same direction, newest first
- 2024Personality Alignment of Large Language Models21 Aug
- 2024Personalized Language Modeling from Personalized Human Feedback6 Feb
- 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging17 Oct
Other references · 39
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
27 more
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 449
- 2023LaMP: When Large Language Models Meet Personalizationcited by 425
- 2018VirtualHome: Simulating Household Activities via Programscited by 411
- 2020Personalized Federated Learning: A Meta-Learning Approachcited by 309
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
- 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
- 2024Quantifying the Persona Effect in LLM Simulationscited by 164
- 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 142
- 2017ParlAI: A Dialog Research Software Platformcited by 139
- 2024OASIS: Open Agent Social Interaction Simulations with One Million Agentscited by 127
- 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 122
- 2024Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuningcited by 87
- 2024Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistancecited by 84
- 2025ContextAgent: Context-Aware Proactive LLM Agents with Open-World Sensory Perceptionscited by 44
- 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistantscited by 44
- 2019What Makes a Good Conversation? Challenges in Designing Truly Conversational Agentscited by 42
- 2024Need Help? Designing Proactive AI Assistants for Programmingcited by 42
- 2025UXAgent: An LLM Agent-Based Usability Testing Framework for Web Designcited by 39
- 2024SocialMind: LLM-based Proactive AR Social Assistive System with Human-like Perception for In-situ Live Interactionscited by 25
- 2024DrHouse: An LLM-empowered Diagnostic Reasoning System through Harnessing Outcomes from Sensor Data and Expert Knowledgecited by 24
- 2025ProPerSim: Developing Proactive and Personalized AI Assistants through User-Assistant Simulationcited by 10
- 2023Like My Aunt Dorothy: Effects of Conversational Styles on Perceptions, Acceptance and Metaphorical Descriptions of Voice Assistants during Later Adulthoodcited by 8
- 2024Healthcare Voice AI Assistants: Factors Influencing Trust and Intention to Usecited by 6
- 2025MoralReason: Generalizable Moral Decision Alignment For LLM Agents Using Reasoning-Level Reinforcement Learningcited by 5
- 2025Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studiescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Synthetic Interaction Data for Scalable Personalization in Large Language Models
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation
- 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environments
- 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows
- 2026Towards Natural Personalization: Evaluating Long-Horizon Preference Following in Personalized User-LLM Interactions
- 2026Probing Persona-Dependent Preferences in Language Models
- 2025The Era of Real-World Human Interaction: RL from User Conversations
- 2026EpiPersona: Persona Projection and Episode Coupling for Pluralistic Preference Modeling