mlsanityData to 14 Oct 2026

Bridging Textual Profiles and Latent User Embeddings for Personalization

arXiv 2605.06981 ↗First posted 7 May 2026cs.IR cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Personalized systems rely on user representations to connect behavioral history with downstream recommendation applications. Existing methods typically employ either supervised latent user embeddings, which are effective for retrieval but difficult to interpret, or textual user profiles, which are interpretable but challenging to optimize for downstream utility due to lack of direct supervision. To bridge this gap, we present BLUE, a reinforcement learning framework that unifies these two forms of user representation by aligning language-based user profiles with embedding-based recommendation objectives. Given a user interaction history, BLUE leverages a profiler Large Language Model (LLM) to generate textual profiles, while an embedding model provides reward signals. This encourages the resulting textual representations to move closer to positive items and farther from negative ones in the embedding space. We further introduce a text-space supervision signal based on next-item prediction, ensuring the learned profiles remain both semantically meaningful and highly effective for downstream retrieval. Experiments on Amazon Reviews 2023 and Google Local Reviews in zero-shot sequential recommendation settings demonstrate that BLUE consistently outperforms strong baselines under both frozen and trainable embedding conditions. Notably, BLUE achieves clear gains in cross-domain transfer, highlighting the strong generalization ability of the learned user profiles. Furthermore, these generated profiles provide superior personalized context for question answering compared to raw user histories or alternative profile optimization methods. Overall, these results show that BLUE provides an effective way to unify interpretable textual profiling with discriminative latent embeddings for personalization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 56 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

49 of 56 references.

References · 49

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2020Supervised Contrastive Learningcited by 2,829
  6. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  7. 2025Gemma 3 Technical Reportcited by 1,824
  8. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  9. 2018Self-Attentive Sequential Recommendationcited by 1,184
  10. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  11. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  12. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
37 more
  1. 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalizationcited by 241
  2. 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
  3. 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
  4. 2023Representation Learning with Large Language Models for Recommendationcited by 155
  5. 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 121
  6. 2024Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuningcited by 90
  7. 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
  8. 2024Personalized Pieces: Efficient Personalized Large Language Models through Collaborative Effortscited by 74
  9. 2024Evaluating Large Language Models as Generative User Simulators for Conversational Recommendationcited by 48
  10. 2023LLM-based Medical Assistant Personalization with Short- and Long-Term Memory Coordinationcited by 46
  11. 2024Large Language Models for Education: A Surveycited by 34
  12. 2022UCTopic: Unsupervised Contrastive Learning for Phrase Representations and Topic Miningcited by 33
  13. 2023Linear Recurrent Units for Sequential Recommendationcited by 32
  14. 2024User Embedding Model for Personalized Language Promptingcited by 28
  15. 2024Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Modelscited by 26
  16. 2024Transparent and Scrutable Recommendations Using Natural Language User Profilescited by 24
  17. 2024CALRec: Contrastive Alignment of Generative LLMs for Sequential Recommendationcited by 24
  18. 2022On Natural Language User Profiles for Transparent and Scrutable Recommendationcited by 23
  19. 2023Embedding in Recommender Systems: A Surveycited by 20
  20. 2025LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential Recommendationcited by 19
  21. 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
  22. 2024Language-Based User Profiles for Recommendationcited by 18
  23. 2024LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendationcited by 18
  24. 2024Unifying Generative and Dense Retrieval for Sequential Recommendationcited by 18
  25. 2025Instant Personalized Large Language Model Adaptation via Hypernetworkcited by 18
  26. 2024LLMs for User Interest Exploration in Large-scale Recommendation Systemscited by 15
  27. 2024RLPF: Reinforcement Learning from Prediction Feedback for User Summarization with LLMscited by 13
  28. 2025LettinGo: Explore User Profile Generation for Recommendation Systemcited by 11
  29. 2024Improving Sequential Recommendations with LLMscited by 10
  30. 2024"In Dialogues We Learn": Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue Learningcited by 10
  31. 2025LLM-based User Profile Management for Recommender Systemcited by 10
  32. 2025UQABench: Evaluating User Embedding for Prompting LLMs in Personalized Question Answeringcited by 10
  33. 2025Can Large Language Models Understand Preferences in Personalized Recommendation?cited by 9
  34. 2025Memory Assisted LLM for Personalized Recommendation Systemcited by 9
  35. 2025Aligning Large Language Models with Implicit Preferences from User-Generated Contentcited by 9
  36. 2025LLM-RecG: A Semantic Bias-Aware Framework for Zero-Shot Sequential Recommendationcited by 6
  37. 2025From Millions of Tweets to Actionable Insights: Leveraging LLMs for User Profilingcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026High Fidelity Textual User Representation over Heterogeneous Sources via Reinforcement Learning
  2. 2025Temporal User Profiling with LLMs: Balancing Short-Term and Long-Term Preferences for Recommendations
  3. 2026RecoReward: Recommender-Guided Multimodal Description Generation for Recommendation
  4. 2024Prompt Tuning as User Inherent Profile Inference Machine
  5. 2026Reproducing Transparent and Scrutable Recommendations: Exploring Open-Weight Models via Natural-Language User Profiles
  6. 2025Effectiveness of LLMs in Temporal User Profiling for Recommendation
  7. 2025Behavior Tokens Speak Louder: Disentangled Explainable Recommendation with Behavior Vocabulary
  8. 2026Self-supervised User Profile Generation for Personalization