mlsanityData to 14 Oct 2026

Cross-Scenario Unified Modeling of User Interests at Billion Scale

arXiv 2510.14788 ↗First posted 16 Oct 2025cs.IR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

User interests on content platforms are inherently diverse, manifesting through complex behavioral patterns across heterogeneous scenarios such as search, feed browsing, and content discovery. Traditional recommendation systems typically prioritize business metric optimization within isolated specific scenarios, neglecting cross-scenario behavioral signals and struggling to integrate advanced techniques like LLMs at billion-scale deployments, which finally limits their ability to capture holistic user interests across platform touchpoints. We propose RED-Rec, an LLM-enhanced hierarchical Recommender Engine for Diversified scenarios, tailored for industry-level content recommendation systems. RED-Rec unifies user interest representations across multiple behavioral contexts by aggregating and synthesizing actions from varied scenarios, resulting in comprehensive item and user modeling. At its core, a two-tower LLM-powered framework enables nuanced, multifaceted representations with deployment efficiency, and a scenario-aware dense mixing and querying policy effectively fuses diverse behavioral signals to capture cross-scenario user intent patterns and express fine-grained, context-specific intents during serving. We validate RED-Rec through online A/B testing on hundreds of millions of users in RedNote through online A/B testing, showing substantial performance gains in both content recommendation and advertisement targeting tasks. We further introduce a million-scale sequential recommendation dataset, RED-MMU, for comprehensive offline training and evaluation. Our work advances unified user modeling, unlocking deeper personalization and fostering more meaningful user engagement in large-scale UGC platforms.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 60 references that are in the map. First posted on arXiv 16 Oct 2025.

Builds on

46 of 60 references.

References · 46

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2018Self-Attentive Sequential Recommendationcited by 1,184
  7. 2017Neural Collaborative Filteringcited by 1,111
  8. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  9. 2015Image-based Recommendations on Styles and Substitutescited by 706
  10. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  11. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
  12. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
34 more
  1. 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
  2. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  3. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  4. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 305
  5. 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
  6. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
  7. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  8. 2019Multi-Interest Network with Dynamic Routing for Recommendation at Tmallcited by 114
  9. 2018Learning Tree-based Deep Model for Recommender Systemscited by 99
  10. 2020Controllable Multi-Interest Framework for Recommendationcited by 93
  11. 2021Global Context Enhanced Graph Neural Networks for Session-based Recommendationcited by 81
  12. 2022KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videoscited by 72
  13. 2024HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modelingcited by 63
  14. 2021Dynamic Graph Neural Networks for Sequential Recommendationcited by 57
  15. 2025MTGR: Industrial-Scale Generative Recommendation Framework in Meituancited by 49
  16. 2023Multi-Modal Self-Supervised Learning for Recommendationcited by 45
  17. 2021Personalized Transfer of User Preferences for Cross-domain Recommendationcited by 34
  18. 2022DGRec: Graph Neural Network for Recommendation with Diversified Embedding Generationcited by 33
  19. 2023Contrastive Cross-Domain Sequential Recommendationcited by 31
  20. 2021A Survey on Cross-domain Recommendation: Taxonomies, Methods, and Future Directionscited by 30
  21. 2021Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Networkcited by 28
  22. 2020Mixed Information Flow for Cross-domain Sequential Recommendationscited by 22
  23. 2023Cross-domain recommendation via user interest alignmentcited by 19
  24. 2024Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendationcited by 19
  25. 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
  26. 2024A Survey on Cross-Domain Sequential Recommendationcited by 16
  27. 2024Enhancing Item Tokenization for Generative Recommendation through Self-Improvementcited by 9
  28. 2024MLoRA: Multi-Domain Low-Rank Adaptive Network for CTR Predictioncited by 7
  29. 2024Preference Discerning with LLM-Enhanced Generative Retrievalcited by 6
  30. 2022Multi-Graph based Multi-Scenario Recommendation in Large-scale Online Video Servicescited by 5
  31. 2024Scene-wise Adaptive Network for Dynamic Cold-start Scenes Optimization in CTR Predictioncited by 4
  32. 2025Qilin: A Multimodal Information Retrieval Dataset with APP-level User Sessionscited by 4
  33. 2025HyMiRec: A Hybrid Multi-interest Learning Framework for LLM-based Sequential Recommendationcited by 4
  34. 2024A Unified Search and Recommendation Framework Based on Multi-Scenario Learning for Ranking in E-commercecited by 3

Built on by

Not cited yet.