Large Language Models Make Sample-Efficient Recommender Systems
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have achieved remarkable progress in the field of natural language processing (NLP), demonstrating remarkable abilities in producing text that resembles human language for various tasks. This opens up new opportunities for employing them in recommender systems (RSs). In this paper, we specifically examine the sample efficiency of LLM-enhanced recommender systems, which pertains to the model's capacity to attain superior performance with a limited quantity of training data. Conventional recommendation models (CRMs) often need a large amount of training data because of the sparsity of features and interactions. Hence, we propose and verify our core viewpoint: Large Language Models Make Sample-Efficient Recommender Systems. We propose a simple yet effective framework (i.e., Laser) to validate the viewpoint from two aspects: (1) LLMs themselves are sample-efficient recommenders; and (2) LLMs, as feature generators and encoders, make CRMs more sample-efficient. Extensive experiments on two public datasets show that Laser requires only a small fraction of training samples to match or even surpass CRMs that are trained on the entire training set, demonstrating superior sample efficiency.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 52 of its 62 references that are in the map. First posted on arXiv 4 Jun 2024.
Builds on
52 of 62 references.
References · 52
- 2023A Survey of Large Language Modelscited by 2,537
- 2017Deep Interest Network for Click-Through Rate Predictioncited by 541
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
- 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 356
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
- 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 307
- 2022Language Models are Realistic Tabular Data Generatorscited by 290
- 2023Is ChatGPT a Good Recommender? A Preliminary Studycited by 192
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 176
- 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
- 2023Uncovering ChatGPT's Capabilities in Recommender Systemscited by 160
- 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
38 more
- 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
- 2023How Can Recommender Systems Benefit from Large Language Models: A Surveycited by 141
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 120
- 2023Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendationcited by 113
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
- 2024Data-efficient Fine-tuning for LLM-based Recommendationcited by 103
- 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
- 2023PALR: Personalization Aware LLMs for Recommendationcited by 96
- 2023ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendationcited by 76
- 2021Cross-Domain Recommendation: Challenges, Progress, and Prospectscited by 74
- 2023Towards Open-World Recommendation with Knowledge Augmentation from Large Language Modelscited by 74
- 2023Zero-Shot Next-Item Recommendation using Large Pretrained Language Modelscited by 53
- 2023VIP5: Towards Multimodal Foundation Models for Recommendationcited by 45
- 2022TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations at Twittercited by 44
- 2023Exploring the Upper Limits of Text-Based Collaborative Filtering Using Large Language Models: Discoveries and Insightscited by 38
- 2023UP5: Unbiased Foundation Model for Fairness-aware Recommendationcited by 38
- 2023Large Language Model Augmented Narrative Driven Recommendationscited by 31
- 2022PTab: Using the Pre-trained Language Model for Modeling Tabular Datacited by 30
- 2023Exploring Adapter-based Transfer Learning for Recommender Systems: Empirical Studies and Practical Insightscited by 29
- 2022TransRec: Learning Transferable Recommendation from Mixture-of-Modality Feedbackcited by 27
- 2023ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Predictioncited by 27
- 2023Prompt Learning for News Recommendationcited by 25
- 2023Large Language Models for User Interest Journeyscited by 24
- 2023Generative Sequential Recommendation with GPTReccited by 21
- 2023UniTRec: A Unified Text-to-Text Transformer and Joint Contrastive Learning Framework for Text-based Recommendationcited by 20
- 2015Efficient Machine Learning for Big Data: A Reviewcited by 17
- 2021Tiny-NewsRec: Effective and Efficient PLM-based News Recommendationcited by 16
- 2023A Unified Framework for Multi-Domain CTR Prediction via Large Language Modelscited by 16
- 2024Towards Efficient and Effective Unlearning of Large Language Models for Recommendationcited by 16
- 2024Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competitioncited by 16
- 2022PTM4Tag: Sharpening Tag Recommendation of Stack Overflow Posts with Pre-trained Modelscited by 15
- 2023TagGPT: Large Language Models are Zero-shot Multimodal Taggerscited by 15
- 2023PBNR: Prompt-based News Recommender Systemcited by 14
- 2023FLIP: Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Predictioncited by 11
- 2023MAP: A Model-agnostic Pretraining Framework for Click-through Rate Predictioncited by 10
- 2023Improving Code Example Recommendations on Informal Documentation Using BERT and Query-Aware LSH: A Comparative Studycited by 7
- 2023Neuro Symbolic Reasoning for Planning: Counterexample Guided Inductive Synthesis using Large Language Models and Satisfiability Solvingcited by 6
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.