mlsanityData to 14 Oct 2026

LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation

arXiv 2406.12529 ↗First posted 18 Jun 2024cs.IR cs.AIcited by 19

Not on the map. Why?

Abstract (arXiv)

As the demand for more personalized recommendation grows and a dramatic boom in commercial scenarios arises, the study on multi-scenario recommendation (MSR) has attracted much attention, which uses the data from all scenarios to simultaneously improve their recommendation performance. However, existing methods tend to integrate insufficient scenario knowledge and neglect learning personalized cross-scenario preferences, thus leading to sub-optimal performance. Meanwhile, though large language model (LLM) has shown great capability of reasoning and capturing semantic information, the high inference latency and high computation cost of tuning hinder its implementation in industrial recommender systems. To fill these gaps, we propose an LLM-enhanced paradigm LLM4MSR in this work. Specifically, we first leverage LLM to uncover multi-level knowledge from the designed scenario- and user-level prompt without fine-tuning the LLM, then adopt hierarchical meta networks to generate multi-level meta layers to explicitly improve the scenario-aware and personalized recommendation capability. Our experiments on KuaiSAR-small, KuaiSAR, and Amazon datasets validate significant advantages of LLM4MSR: (i) the effectiveness and compatibility with different multi-scenario backbone models, (ii) high efficiency and deployability on industrial recommender systems, and (iii) improved interpretability. The implemented code and data is available to ease reproduction.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

26 of 43 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  4. 2016Wide & Deep Learning for Recommender Systemscited by 747
  5. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
  6. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
  7. 2023Is ChatGPT a Good Recommender? A Preliminary Studycited by 193
  8. 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
  9. 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
  10. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
  11. 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
  12. 2022What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?cited by 150
14 more
  1. 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applicationscited by 111
  2. 2021One Model to Serve All: Star Topology Adaptive Recommender for Multi-Domain CTR Predictioncited by 78
  3. 2021Cross-Domain Recommendation: Challenges, Progress, and Prospectscited by 74
  4. 2023PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Informationcited by 60
  5. 2021Modeling the Sequential Dependence among Audience Multi-step Conversions with Multi-task Learning in Targeted Display Advertisingcited by 39
  6. 2023Multi-Task Deep Recommender Systems: A Surveycited by 30
  7. 2023ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Predictioncited by 27
  8. 2023Multi-Task Recommendations with Reinforcement Learningcited by 26
  9. 2023HAMUR: Hyper Adapter for Multi-Domain Recommendationcited by 21
  10. 2023STEM: Unleashing the Power of Embeddings for Multi-task Recommendationcited by 19
  11. 2022Leaving No One Behind: A Multi-Scenario Multi-Task Meta Learning Approach for Advertiser Modelingcited by 18
  12. 2023Heterogeneous Knowledge Fusion: A Novel Approach for Personalized Recommendation via LLMcited by 18
  13. 2023An Unified Search and Recommendation Foundation Model for Cold-Start Scenariocited by 12
  14. 2023Scenario-Aware Hierarchical Dynamic Network for Multi-Scenario Recommendationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 13; 2026: 2.

19 papers.

Sort:

By area:

  1. 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyondcited by 26
  2. 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
  3. 2025Personalize Before Retrieve: LLM-based Personalized Query Expansion for User-Centric Retrievalcited by 11
  4. 2024Large Language Model Enhanced Recommender Systems: A Surveycited by 10
  5. 2025LLM-RecG: A Semantic Bias-Aware Framework for Zero-Shot Sequential Recommendationcited by 6
  6. 2025From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systemscited by 6
  7. 2024Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decodingcited by 5
  8. 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
  9. 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Predictioncited by 4
  10. 2025GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networkscited by 3
  11. 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matchingcited by 2
  12. 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDscited by 2
7 more
  1. 2025Database Normalization via Dual-LLM Self-Refinementcited by 1
  2. 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Modelscited by 1
  3. 2025LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Trainingcited by 1
  4. 2026TokenMinds: Pretrained User Tokens and Embeddings for User Understanding in Large Recommender Systemscited by 1
  5. 2025Leveraging Multimodal Data and Side Users for Diffusion Cross-Domain Recommendationcited by 0
  6. 2025Cross-Scenario Unified Modeling of User Interests at Billion Scalecited by 0
  7. 2026Fusion and Alignment Enhancement with Large Language Models for Tail-item Sequential Recommendationcited by 0