Cross-Scenario Unified Modeling of User Interests at Billion Scale
Not on the map. Why?
Abstract (arXiv)
User interests on content platforms are inherently diverse, manifesting through complex behavioral patterns across heterogeneous scenarios such as search, feed browsing, and content discovery. Traditional recommendation systems typically prioritize business metric optimization within isolated specific scenarios, neglecting cross-scenario behavioral signals and struggling to integrate advanced techniques like LLMs at billion-scale deployments, which finally limits their ability to capture holistic user interests across platform touchpoints. We propose RED-Rec, an LLM-enhanced hierarchical Recommender Engine for Diversified scenarios, tailored for industry-level content recommendation systems. RED-Rec unifies user interest representations across multiple behavioral contexts by aggregating and synthesizing actions from varied scenarios, resulting in comprehensive item and user modeling. At its core, a two-tower LLM-powered framework enables nuanced, multifaceted representations with deployment efficiency, and a scenario-aware dense mixing and querying policy effectively fuses diverse behavioral signals to capture cross-scenario user intent patterns and express fine-grained, context-specific intents during serving. We validate RED-Rec through online A/B testing on hundreds of millions of users in RedNote through online A/B testing, showing substantial performance gains in both content recommendation and advertisement targeting tasks. We further introduce a million-scale sequential recommendation dataset, RED-MMU, for comprehensive offline training and evaluation. Our work advances unified user modeling, unlocking deeper personalization and fostering more meaningful user engagement in large-scale UGC platforms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 60 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
46 of 60 references.
References · 46
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Visual Instruction Tuningcited by 7,869
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2017Neural Collaborative Filteringcited by 1,111
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
34 more
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
- 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 305
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2019Multi-Interest Network with Dynamic Routing for Recommendation at Tmallcited by 114
- 2018Learning Tree-based Deep Model for Recommender Systemscited by 99
- 2020Controllable Multi-Interest Framework for Recommendationcited by 93
- 2021Global Context Enhanced Graph Neural Networks for Session-based Recommendationcited by 81
- 2022KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videoscited by 72
- 2024HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modelingcited by 63
- 2021Dynamic Graph Neural Networks for Sequential Recommendationcited by 57
- 2025MTGR: Industrial-Scale Generative Recommendation Framework in Meituancited by 49
- 2023Multi-Modal Self-Supervised Learning for Recommendationcited by 45
- 2021Personalized Transfer of User Preferences for Cross-domain Recommendationcited by 34
- 2022DGRec: Graph Neural Network for Recommendation with Diversified Embedding Generationcited by 33
- 2023Contrastive Cross-Domain Sequential Recommendationcited by 31
- 2021A Survey on Cross-domain Recommendation: Taxonomies, Methods, and Future Directionscited by 30
- 2021Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Networkcited by 28
- 2020Mixed Information Flow for Cross-domain Sequential Recommendationscited by 22
- 2023Cross-domain recommendation via user interest alignmentcited by 19
- 2024Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendationcited by 19
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
- 2024A Survey on Cross-Domain Sequential Recommendationcited by 16
- 2024Enhancing Item Tokenization for Generative Recommendation through Self-Improvementcited by 9
- 2024MLoRA: Multi-Domain Low-Rank Adaptive Network for CTR Predictioncited by 7
- 2024Preference Discerning with LLM-Enhanced Generative Retrievalcited by 6
- 2022Multi-Graph based Multi-Scenario Recommendation in Large-scale Online Video Servicescited by 5
- 2024Scene-wise Adaptive Network for Dynamic Cold-start Scenes Optimization in CTR Predictioncited by 4
- 2025Qilin: A Multimodal Information Retrieval Dataset with APP-level User Sessionscited by 4
- 2025HyMiRec: A Hybrid Multi-interest Learning Framework for LLM-based Sequential Recommendationcited by 4
- 2024A Unified Search and Recommendation Framework Based on Multi-Scenario Learning for Ranking in E-commercecited by 3
Built on by
Not cited yet.