Bridging Textual Profiles and Latent User Embeddings for Personalization
Not on the map. Why?
Abstract (arXiv)
Personalized systems rely on user representations to connect behavioral history with downstream recommendation applications. Existing methods typically employ either supervised latent user embeddings, which are effective for retrieval but difficult to interpret, or textual user profiles, which are interpretable but challenging to optimize for downstream utility due to lack of direct supervision. To bridge this gap, we present BLUE, a reinforcement learning framework that unifies these two forms of user representation by aligning language-based user profiles with embedding-based recommendation objectives. Given a user interaction history, BLUE leverages a profiler Large Language Model (LLM) to generate textual profiles, while an embedding model provides reward signals. This encourages the resulting textual representations to move closer to positive items and farther from negative ones in the embedding space. We further introduce a text-space supervision signal based on next-item prediction, ensuring the learned profiles remain both semantically meaningful and highly effective for downstream retrieval. Experiments on Amazon Reviews 2023 and Google Local Reviews in zero-shot sequential recommendation settings demonstrate that BLUE consistently outperforms strong baselines under both frozen and trainable embedding conditions. Notably, BLUE achieves clear gains in cross-domain transfer, highlighting the strong generalization ability of the learned user profiles. Furthermore, these generated profiles provide superior personalized context for question answering compared to raw user histories or alternative profile optimization methods. Overall, these results show that BLUE provides an effective way to unify interpretable textual profiling with discriminative latent embeddings for personalization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 56 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
49 of 56 references.
References · 49
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2020Supervised Contrastive Learningcited by 2,829
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Gemma 3 Technical Reportcited by 1,824
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
37 more
- 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalizationcited by 241
- 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
- 2023Representation Learning with Large Language Models for Recommendationcited by 155
- 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 121
- 2024Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuningcited by 90
- 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
- 2024Personalized Pieces: Efficient Personalized Large Language Models through Collaborative Effortscited by 74
- 2024Evaluating Large Language Models as Generative User Simulators for Conversational Recommendationcited by 48
- 2023LLM-based Medical Assistant Personalization with Short- and Long-Term Memory Coordinationcited by 46
- 2024Large Language Models for Education: A Surveycited by 34
- 2022UCTopic: Unsupervised Contrastive Learning for Phrase Representations and Topic Miningcited by 33
- 2023Linear Recurrent Units for Sequential Recommendationcited by 32
- 2024User Embedding Model for Personalized Language Promptingcited by 28
- 2024Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Modelscited by 26
- 2024Transparent and Scrutable Recommendations Using Natural Language User Profilescited by 24
- 2024CALRec: Contrastive Alignment of Generative LLMs for Sequential Recommendationcited by 24
- 2022On Natural Language User Profiles for Transparent and Scrutable Recommendationcited by 23
- 2023Embedding in Recommender Systems: A Surveycited by 20
- 2025LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential Recommendationcited by 19
- 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
- 2024Language-Based User Profiles for Recommendationcited by 18
- 2024LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendationcited by 18
- 2024Unifying Generative and Dense Retrieval for Sequential Recommendationcited by 18
- 2025Instant Personalized Large Language Model Adaptation via Hypernetworkcited by 18
- 2024LLMs for User Interest Exploration in Large-scale Recommendation Systemscited by 15
- 2024RLPF: Reinforcement Learning from Prediction Feedback for User Summarization with LLMscited by 13
- 2025LettinGo: Explore User Profile Generation for Recommendation Systemcited by 11
- 2024Improving Sequential Recommendations with LLMscited by 10
- 2024"In Dialogues We Learn": Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue Learningcited by 10
- 2025LLM-based User Profile Management for Recommender Systemcited by 10
- 2025UQABench: Evaluating User Embedding for Prompting LLMs in Personalized Question Answeringcited by 10
- 2025Can Large Language Models Understand Preferences in Personalized Recommendation?cited by 9
- 2025Memory Assisted LLM for Personalized Recommendation Systemcited by 9
- 2025Aligning Large Language Models with Implicit Preferences from User-Generated Contentcited by 9
- 2025LLM-RecG: A Semantic Bias-Aware Framework for Zero-Shot Sequential Recommendationcited by 6
- 2025From Millions of Tweets to Actionable Insights: Leveraging LLMs for User Profilingcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026High Fidelity Textual User Representation over Heterogeneous Sources via Reinforcement Learning
- 2025Temporal User Profiling with LLMs: Balancing Short-Term and Long-Term Preferences for Recommendations
- 2026RecoReward: Recommender-Guided Multimodal Description Generation for Recommendation
- 2024Prompt Tuning as User Inherent Profile Inference Machine
- 2026Reproducing Transparent and Scrutable Recommendations: Exploring Open-Weight Models via Natural-Language User Profiles
- 2025Effectiveness of LLMs in Temporal User Profiling for Recommendation
- 2025Behavior Tokens Speak Louder: Disentangled Explainable Recommendation with Behavior Vocabulary
- 2026Self-supervised User Profile Generation for Personalization