mlsanityData to 7 Oct 2026

After Talking with 1,000 Personas: Learning Preference-Aligned Proactive Assistants From Large-Scale Persona Interactions

arXiv 2602.04000 ↗First posted 3 Feb 2026cs.HCcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

Smart assistants increasingly act proactively, yet mistimed or intrusive behavior often causes users to lose trust and disable these features. Learning user preferences for proactive assistance is difficult because real-world studies are costly, limited in scale, and rarely capture how preferences change across multiple interaction sessions. Large language model based generative agents offer a way to simulate realistic interactions, but existing synthetic datasets remain limited in temporal depth, diverse personas, and multi-dimensional preferences. They also provide little support for transferring population-level insights to individual users under on-device constraints. We present a population-to-individual learning framework for preference-aligned proactive assistants that operates under on-device and privacy constraints. Our approach uses large-scale interaction simulation with 1,000 diverse personas to learn shared structure in how users express preferences across recurring dimensions such as timing, autonomy, and communication style, providing a strong cold start without relying on real user logs. The assistant then adapts to individual users on device through lightweight activation-based steering driven by simple interaction feedback, without model retraining or cloud-side updates. We evaluate the framework using controlled simulations with 1,000 simulated personas and a human-subject study with 34 participants. Results show improved timing decisions and perceived interaction quality over untuned and direct-response baselines, while on-device activation steering achieves performance comparable to reinforcement learning from human feedback. Participants also report higher satisfaction, trust, and comfort as the assistant adapts over multiple sessions of interactions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 42 of its 77 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

42 of 77 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Personality Alignment of Large Language Models21 Aug
  2. 2024Personalized Language Modeling from Personalized Human Feedback6 Feb
  3. 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging17 Oct

Other references · 39

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2017Deep reinforcement learning from human preferencescited by 3,846
  7. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  8. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  9. 2023Steering Language Models With Activation Engineeringcited by 824
  10. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  11. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  12. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
27 more
  1. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  2. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
  3. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 449
  4. 2023LaMP: When Large Language Models Meet Personalizationcited by 425
  5. 2018VirtualHome: Simulating Household Activities via Programscited by 411
  6. 2020Personalized Federated Learning: A Meta-Learning Approachcited by 309
  7. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
  8. 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
  9. 2024Quantifying the Persona Effect in LLM Simulationscited by 164
  10. 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 142
  11. 2017ParlAI: A Dialog Research Software Platformcited by 139
  12. 2024OASIS: Open Agent Social Interaction Simulations with One Million Agentscited by 127
  13. 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 122
  14. 2024Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuningcited by 87
  15. 2024Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistancecited by 84
  16. 2025ContextAgent: Context-Aware Proactive LLM Agents with Open-World Sensory Perceptionscited by 44
  17. 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistantscited by 44
  18. 2019What Makes a Good Conversation? Challenges in Designing Truly Conversational Agentscited by 42
  19. 2024Need Help? Designing Proactive AI Assistants for Programmingcited by 42
  20. 2025UXAgent: An LLM Agent-Based Usability Testing Framework for Web Designcited by 39
  21. 2024SocialMind: LLM-based Proactive AR Social Assistive System with Human-like Perception for In-situ Live Interactionscited by 25
  22. 2024DrHouse: An LLM-empowered Diagnostic Reasoning System through Harnessing Outcomes from Sensor Data and Expert Knowledgecited by 24
  23. 2025ProPerSim: Developing Proactive and Personalized AI Assistants through User-Assistant Simulationcited by 10
  24. 2023Like My Aunt Dorothy: Effects of Conversational Styles on Perceptions, Acceptance and Metaphorical Descriptions of Voice Assistants during Later Adulthoodcited by 8
  25. 2024Healthcare Voice AI Assistants: Factors Influencing Trust and Intention to Usecited by 6
  26. 2025MoralReason: Generalizable Moral Decision Alignment For LLM Agents Using Reasoning-Level Reinforcement Learningcited by 5
  27. 2025Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studiescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Synthetic Interaction Data for Scalable Personalization in Large Language Models
  2. 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation
  3. 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environments
  4. 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows
  5. 2026Towards Natural Personalization: Evaluating Long-Horizon Preference Following in Personalized User-LLM Interactions
  6. 2026Probing Persona-Dependent Preferences in Language Models
  7. 2025The Era of Real-World Human Interaction: RL from User Conversations
  8. 2026EpiPersona: Persona Projection and Episode Coupling for Pluralistic Preference Modeling