Learning Dynamic User Personas from Implicit Interaction Streams via Iterative Refinement
Not on the map. Why?
Abstract (arXiv)
Personalizing large language models (LLMs) to individual users is essential for improving user experience, yet existing approaches typically rely on explicit preference supervision such as pairwise comparisons or demographic attributes, limiting their applicability in natural interaction settings. We propose IRIS, a framework that learns dynamic user personas directly from implicit interaction streams by extracting behavioral signals from everyday conversations and iteratively refining persona representations through a prediction-driven closed loop without requiring explicit feedback. We introduce an evaluation protocol based on behavior prediction, persona stability, and decision prediction. A proof-of-concept study on a synthetic interaction stream derived from public-domain autobiographical text shows that IRIS produces stable personas and distinguishes individual users while revealing limitations of memory-only approaches on recall-oriented metrics. We then validate IRIS on anonymized real-world Reddit r/AmItheAsshole (AITA) data, with personas built solely from each author's historical interactions. Across 100 authors, IRIS achieves the highest decision prediction accuracy among all evaluated methods (61.0%), outperforming static personas, memory-only retrieval, and no-personalization baselines. These results suggest that implicit behavioral modeling provides a scalable alternative to explicit preference learning for personalized LLMs and offers a practical foundation for adaptive conversational systems and embodied agents that require continuously evolving models of their users.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
16 of 26 references.
References · 16
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2020Learning to summarize from human feedbackcited by 2,562
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,151
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 517
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
- 2023LaMP: When Large Language Models Meet Personalizationcited by 425
- 2024LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuningcited by 133
- 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 91
4 more
- 2022Enabling Conversational Interaction with Mobile UI using Large Language Modelscited by 66
- 2020TREC CAsT 2019: The Conversational Assistance Track Overviewcited by 64
- 2024PersonalLLM: Tailoring LLMs to Individual Preferencescited by 56
- 2023BookGPT: A General Framework for Book Recommendation Empowered by Large Language Modelcited by 22
Built on by
Not cited yet.