A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges
Not on the map. Why?
Abstract (arXiv)
Recommender systems have traditionally followed modular architectures comprising candidate generation, multi-stage ranking, and re-ranking, each trained separately with supervised objectives and hand-engineered features. While effective in many domains, such systems face persistent challenges including sparse and noisy interaction data, cold-start problems, limited personalization depth, and inadequate semantic understanding of user and item content. The recent emergence of Large Language Models (LLMs) offers a new paradigm for addressing these limitations through unified, language-native mechanisms that can generalize across tasks, domains, and modalities. In this paper, we present a comprehensive technical survey of how LLMs can be leveraged to tackle key challenges in modern recommender systems. We examine the use of LLMs for prompt-driven candidate retrieval, language-native ranking, retrieval-augmented generation (RAG), and conversational recommendation, illustrating how these approaches enhance personalization, semantic alignment, and interpretability without requiring extensive task-specific supervision. LLMs further enable zero- and few-shot reasoning, allowing systems to operate effectively in cold-start and long-tail scenarios by leveraging external knowledge and contextual cues. We categorize these emerging LLM-driven architectures and analyze their effectiveness in mitigating core bottlenecks of conventional pipelines. In doing so, we provide a structured framework for understanding the design space of LLM-enhanced recommenders, and outline the trade-offs between accuracy, scalability, and real-time performance. Our goal is to demonstrate that LLMs are not merely auxiliary components but foundational enablers for building more adaptive, semantically rich, and user-centric recommender systems
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 124 of its 236 references that are in the map. First posted on arXiv 17 Jul 2025.
Builds on
124 of 236 references.
References · 124
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
38 more
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2017Neural Collaborative Filteringcited by 1,111
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2018Model Cards for Model Reportingcited by 1,080
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2021Scaling Vision with Sparse Mixture of Expertscited by 747
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 465
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 421
- 2022Multimodal Learning with Transformers: A Surveycited by 400
- 2023A Survey on Large Language Models for Recommendationcited by 379
- 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 302
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
- 2016Recommendations as Treatments: Debiasing Learning and Evaluationcited by 248
- 2017Neural Attentive Session-based Recommendationcited by 237
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
- 2018Top-K Off-Policy Correction for a REINFORCE Recommender Systemcited by 182
- 2024ProSA: Assessing and Understanding the Prompt Sensitivity of LLMscited by 149
- 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 148
- 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147
50 most cited of 124 All 124 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Beyond Pipelines: A Fundamental Study on the Rise of Generative-Retrieval Architectures in Web Researchcited by 0
- 2026LLM-generated personalized nudges for improving pro-environmental behavior: Field evidence from resource conservationcited by 0
- 2026Explainable Recommendations at Scale: LLM Rationales for YouTube Music Artist Discoverycited by 0
- 2026Explainable Recommendations at Scale: LLM Rationales for YouTube Music Artist Discovery20 Sep 2026
- 2026LLM-generated personalized nudges for improving pro-environmental behavior: Field evidence from resource conservation4 Apr 2026
- 2026Beyond Pipelines: A Fundamental Study on the Rise of Generative-Retrieval Architectures in Web Research19 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyond
- 2024All Roads Lead to Rome: Unveiling the Trajectory of Recommender Systems Across the LLM Era
- 2023How Can Recommender Systems Benefit from Large Language Models: A Survey
- 2024Aligning Large Language Models with Recommendation Knowledge
- 2025Generative Large Recommendation Models: Emerging Trends in LLMs for Recommendation
- 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferences
- 2023Empowering Few-Shot Recommender Systems with Large Language Models -- Enhanced Representations
- 2023PALR: Personalization Aware LLMs for Recommendation