Textual User Taste: Natural-Language User Context for Foundation-Model Recommender System at Scale
Not on the map. Why?
Abstract (arXiv)
Foundation model recommender systems require user context that can be consumed by large language models, reasoned over, and refined through natural-language interaction. Traditional behavioral embedding vectors remain highly effective for retrieval and ranking, but they are opaque to users and not natively expressed for language model workflows. We present Textual User Taste, a system that generates structured natural-language taste profiles from listening behavior, interaction signals, content metadata, and optional user feedback, and deploys them to millions of Spotify users. We describe the end-to-end production lifecycle required to generate, evaluate, optimize, and maintain these representations at industrial scale, including prompt development and compression, user steering, and integration with downstream personalization systems. Because no unique ground-truth taste profile exists, we introduce a multi-faceted evaluation framework to evaluate taste profiles as a production representation: they carry user-specific predictive signal independently, and when integrated with behavioral embeddings, improve MRR by 0.6% for future-track prediction and NDCG@7 by 2.2% for search ranking. Our evaluation also reveals that taste profiles support positive natural-language steering, while exposing important limitations, including challenges with negation and short-term temporal adaptation. These findings position taste profiles not as replacements for behavioral embeddings, but as an interpretable and steerable interface between evolving user context and foundation-model recommender systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
14 of 22 references.
References · 14
- 2017Neural Collaborative Filteringcited by 1,111
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
- 2023Representation Learning with Large Language Models for Recommendationcited by 155
- 2023CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendationcited by 100
- 2022PinnerFormer: Sequence Modeling for User Representation at Pinterestcited by 57
- 2024LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendationcited by 47
- 2025PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequencecited by 33
- 2024Language-Based User Profiles for Recommendationcited by 18
- 2025LLM-based User Profile Management for Recommender Systemcited by 10
- 2024TEARS: Textual Representations for Scrutable Recommendationscited by 5
- 2026LLM-Based User Personas for Recommendations at Scalecited by 2
- 2026High Fidelity Textual User Representation over Heterogeneous Sources via Reinforcement Learningcited by 1
2 more
Built on by
Not cited yet.