LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation
Not on the map. Why?
Abstract (arXiv)
As the demand for more personalized recommendation grows and a dramatic boom in commercial scenarios arises, the study on multi-scenario recommendation (MSR) has attracted much attention, which uses the data from all scenarios to simultaneously improve their recommendation performance. However, existing methods tend to integrate insufficient scenario knowledge and neglect learning personalized cross-scenario preferences, thus leading to sub-optimal performance. Meanwhile, though large language model (LLM) has shown great capability of reasoning and capturing semantic information, the high inference latency and high computation cost of tuning hinder its implementation in industrial recommender systems. To fill these gaps, we propose an LLM-enhanced paradigm LLM4MSR in this work. Specifically, we first leverage LLM to uncover multi-level knowledge from the designed scenario- and user-level prompt without fine-tuning the LLM, then adopt hierarchical meta networks to generate multi-level meta layers to explicitly improve the scenario-aware and personalized recommendation capability. Our experiments on KuaiSAR-small, KuaiSAR, and Amazon datasets validate significant advantages of LLM4MSR: (i) the effectiveness and compatibility with different multi-scenario backbone models, (ii) high efficiency and deployability on industrial recommender systems, and (iii) improved interpretability. The implemented code and data is available to ease reproduction.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 18 Jun 2024.
Builds on
26 of 43 references.
References · 26
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
- 2023Is ChatGPT a Good Recommender? A Preliminary Studycited by 193
- 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
- 2022What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?cited by 150
14 more
- 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applicationscited by 111
- 2021One Model to Serve All: Star Topology Adaptive Recommender for Multi-Domain CTR Predictioncited by 78
- 2021Cross-Domain Recommendation: Challenges, Progress, and Prospectscited by 74
- 2023PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Informationcited by 60
- 2021Modeling the Sequential Dependence among Audience Multi-step Conversions with Multi-task Learning in Targeted Display Advertisingcited by 39
- 2023Multi-Task Deep Recommender Systems: A Surveycited by 30
- 2023ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Predictioncited by 27
- 2023Multi-Task Recommendations with Reinforcement Learningcited by 26
- 2023HAMUR: Hyper Adapter for Multi-Domain Recommendationcited by 21
- 2023STEM: Unleashing the Power of Embeddings for Multi-task Recommendationcited by 19
- 2022Leaving No One Behind: A Multi-Scenario Multi-Task Meta Learning Approach for Advertiser Modelingcited by 18
- 2023Heterogeneous Knowledge Fusion: A Novel Approach for Personalized Recommendation via LLMcited by 18
- 2023An Unified Search and Recommendation Foundation Model for Cold-Start Scenariocited by 12
- 2023Scenario-Aware Hierarchical Dynamic Network for Multi-Scenario Recommendationcited by 4
Built on by
Citing papers per year: 2024: 4; 2025: 13; 2026: 2.
19 papers.
Sort:
By area:
- 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyondcited by 26
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
- 2025Personalize Before Retrieve: LLM-based Personalized Query Expansion for User-Centric Retrievalcited by 11
- 2024Large Language Model Enhanced Recommender Systems: A Surveycited by 10
- 2025LLM-RecG: A Semantic Bias-Aware Framework for Zero-Shot Sequential Recommendationcited by 6
- 2025From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systemscited by 6
- 2024Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decodingcited by 5
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Predictioncited by 4
- 2025GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networkscited by 3
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matchingcited by 2
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDscited by 2
7 more
- 2025Database Normalization via Dual-LLM Self-Refinementcited by 1
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Modelscited by 1
- 2025LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Trainingcited by 1
- 2026TokenMinds: Pretrained User Tokens and Embeddings for User Understanding in Large Recommender Systemscited by 1
- 2025Leveraging Multimodal Data and Side Users for Diffusion Cross-Domain Recommendationcited by 0
- 2025Cross-Scenario Unified Modeling of User Interests at Billion Scalecited by 0
- 2026Fusion and Alignment Enhancement with Large Language Models for Tail-item Sequential Recommendationcited by 0
- 2026TokenMinds: Pretrained User Tokens and Embeddings for User Understanding in Large Recommender Systems23 Jun 2026
- 2026Fusion and Alignment Enhancement with Large Language Models for Tail-item Sequential Recommendation4 Apr 2026
- 2025LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Training25 Nov 2025
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Models20 Oct 2025
- 2025Cross-Scenario Unified Modeling of User Interests at Billion Scale16 Oct 2025
- 2025Personalize Before Retrieve: LLM-based Personalized Query Expansion for User-Centric Retrieval10 Oct 2025
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs2 Sep 2025
- 2025Database Normalization via Dual-LLM Self-Refinement25 Aug 2025
- 2025Leveraging Multimodal Data and Side Users for Diffusion Cross-Domain Recommendation5 Jul 2025
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matching23 Jun 2025
- 2025GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networks19 Jun 2025
- 2025From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systems5 Jun 2025
7 more
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Prediction20 May 2025
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation25 Apr 2025
- 2025LLM-RecG: A Semantic Bias-Aware Framework for Zero-Shot Sequential Recommendation31 Jan 2025
- 2024Large Language Model Enhanced Recommender Systems: A Survey18 Dec 2024
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models5 Dec 2024
- 2024Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decoding21 Oct 2024
- 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyond10 Oct 2024
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
- 2024Large Language Model Enhanced Recommender Systems: A Surveycited by 10
- 2025LLM-RecG: A Semantic Bias-Aware Framework for Zero-Shot Sequential Recommendationcited by 6
- 2025From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systemscited by 6
- 2024Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decodingcited by 5
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Predictioncited by 4
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matchingcited by 2
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDscited by 2
- 2025Database Normalization via Dual-LLM Self-Refinementcited by 1
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Modelscited by 1
- 2025LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Trainingcited by 1
12 most cited of 16 All 16 (JSON)
- 2026TokenMinds: Pretrained User Tokens and Embeddings for User Understanding in Large Recommender Systems23 Jun 2026
- 2026Fusion and Alignment Enhancement with Large Language Models for Tail-item Sequential Recommendation4 Apr 2026
- 2025LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Training25 Nov 2025
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Models20 Oct 2025
- 2025Cross-Scenario Unified Modeling of User Interests at Billion Scale16 Oct 2025
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs2 Sep 2025
- 2025Database Normalization via Dual-LLM Self-Refinement25 Aug 2025
- 2025Leveraging Multimodal Data and Side Users for Diffusion Cross-Domain Recommendation5 Jul 2025
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matching23 Jun 2025
- 2025From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systems5 Jun 2025
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Prediction20 May 2025
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation25 Apr 2025
12 newest of 16 All 16 (JSON)