mlsanityData to 14 Oct 2026

A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges

arXiv 2507.21117 ↗First posted 17 Jul 2025cs.IR cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Recommender systems have traditionally followed modular architectures comprising candidate generation, multi-stage ranking, and re-ranking, each trained separately with supervised objectives and hand-engineered features. While effective in many domains, such systems face persistent challenges including sparse and noisy interaction data, cold-start problems, limited personalization depth, and inadequate semantic understanding of user and item content. The recent emergence of Large Language Models (LLMs) offers a new paradigm for addressing these limitations through unified, language-native mechanisms that can generalize across tasks, domains, and modalities. In this paper, we present a comprehensive technical survey of how LLMs can be leveraged to tackle key challenges in modern recommender systems. We examine the use of LLMs for prompt-driven candidate retrieval, language-native ranking, retrieval-augmented generation (RAG), and conversational recommendation, illustrating how these approaches enhance personalization, semantic alignment, and interpretability without requiring extensive task-specific supervision. LLMs further enable zero- and few-shot reasoning, allowing systems to operate effectively in cold-start and long-tail scenarios by leveraging external knowledge and contextual cues. We categorize these emerging LLM-driven architectures and analyze their effectiveness in mitigating core bottlenecks of conventional pipelines. In doing so, we provide a structured framework for understanding the design space of LLM-enhanced recommenders, and outline the trade-offs between accuracy, scalability, and real-time performance. Our goal is to demonstrate that LLMs are not merely auxiliary components but foundational enablers for building more adaptive, semantically rich, and user-centric recommender systems

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 124 of its 236 references that are in the map. First posted on arXiv 17 Jul 2025.

Builds on

124 of 236 references.

References · 124

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  6. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  7. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  8. 2017Deep reinforcement learning from human preferencescited by 3,912
  9. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  10. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  11. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  12. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
38 more
  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  2. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  3. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  4. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  5. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
  6. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  7. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  8. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  9. 2018Self-Attentive Sequential Recommendationcited by 1,184
  10. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  11. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  12. 2017Neural Collaborative Filteringcited by 1,111
  13. 2023LIMA: Less Is More for Alignmentcited by 1,100
  14. 2018Model Cards for Model Reportingcited by 1,080
  15. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  16. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
  17. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
  18. 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
  19. 2016Wide & Deep Learning for Recommender Systemscited by 747
  20. 2021Scaling Vision with Sparse Mixture of Expertscited by 747
  21. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  22. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
  23. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
  24. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 465
  25. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
  26. 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 421
  27. 2022Multimodal Learning with Transformers: A Surveycited by 400
  28. 2023A Survey on Large Language Models for Recommendationcited by 379
  29. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  30. 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 302
  31. 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
  32. 2016Recommendations as Treatments: Debiasing Learning and Evaluationcited by 248
  33. 2017Neural Attentive Session-based Recommendationcited by 237
  34. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  35. 2018Top-K Off-Policy Correction for a REINFORCE Recommender Systemcited by 182
  36. 2024ProSA: Assessing and Understanding the Prompt Sensitivity of LLMscited by 149
  37. 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 148
  38. 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147

50 most cited of 124 All 124 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyond
  2. 2024All Roads Lead to Rome: Unveiling the Trajectory of Recommender Systems Across the LLM Era
  3. 2023How Can Recommender Systems Benefit from Large Language Models: A Survey
  4. 2024Aligning Large Language Models with Recommendation Knowledge
  5. 2025Generative Large Recommendation Models: Emerging Trends in LLMs for Recommendation
  6. 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferences
  7. 2023Empowering Few-Shot Recommender Systems with Large Language Models -- Enhanced Representations
  8. 2023PALR: Personalization Aware LLMs for Recommendation