Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender System
Not on the map. Why?
Abstract (arXiv)
Collaborative filtering recommender systems (CF-RecSys) have shown successive results in enhancing the user experience on social media and e-commerce platforms. However, as CF-RecSys struggles under cold scenarios with sparse user-item interactions, recent strategies have focused on leveraging modality information of user/items (e.g., text or images) based on pre-trained modality encoders and Large Language Models (LLMs). Despite their effectiveness under cold scenarios, we observe that they underperform simple traditional collaborative filtering models under warm scenarios due to the lack of collaborative knowledge. In this work, we propose an efficient All-round LLM-based Recommender system, called A-LLMRec, that excels not only in the cold scenario but also in the warm scenario. Our main idea is to enable an LLM to directly leverage the collaborative knowledge contained in a pre-trained state-of-the-art CF-RecSys so that the emergent ability of the LLM as well as the high-quality user/item embeddings that are already trained by the state-of-the-art CF-RecSys can be jointly exploited. This approach yields two advantages: (1) model-agnostic, allowing for integration with various existing CF-RecSys, and (2) efficiency, eliminating the extensive fine-tuning typically required for LLM-based recommenders. Our extensive experiments on various real-world datasets demonstrate the superiority of A-LLMRec in various scenarios, including cold/warm, few-shot, cold user, and cross-domain scenarios. Beyond the recommendation task, we also show the potential of A-LLMRec in generating natural language outputs based on the understanding of the collaborative knowledge by performing a favorite genre prediction task. Our code is available at https://github.com/ghdtjr/A-LLMRec .
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Builds on 29 of its 51 references that are in the map. First posted on arXiv 17 Apr 2024.
Builds on
29 of 51 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2017Neural Collaborative Filteringcited by 1,108
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
17 more
- 2015Image-based Recommendations on Styles and Substitutescited by 702
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 517
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
- 2023A Survey on Large Language Models for Recommendationcited by 378
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 241
- 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
- 2023Large Language Models as Zero-Shot Conversational Recommenderscited by 126
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2018A Simple Convolutional Generative Network for Next Item Recommendationcited by 120
- 2021AutoDebias: Learning to Debias for Recommendationcited by 68
- 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferencescited by 66
- 2021Non-invasive Self-attention for Side Information Fusion in Sequential Recommendationcited by 39
- 2022LTE4G: Long-Tail Experts for Graph Neural Networkscited by 30
- 2023Task Relation-aware Continual User Representation Learningcited by 7
- 2023MUSE: Music Recommender System with Shuffle Play Recommendation Enhancementcited by 2
Built on by
Citing papers per year: 2024: 8; 2025: 29; 2026: 13.
50 papers.
Sort:
By area:
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 85
- 2024BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batchingcited by 31
- 2025ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendationcited by 18
- 2025The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exitcited by 10
- 2024Turning Generative Models Degenerate: The Power of Data Poisoning Attackscited by 9
- 2024A semantic embedding space based on large language models for modelling human beliefscited by 9
- 2025LLM-based User Profile Management for Recommender Systemcited by 9
- 2024STAR: A Simple Training-free Approach for Recommendations using Large Language Modelscited by 8
- 2024Beyond Retrieval: Generating Narratives in Conversational Recommender Systemscited by 8
- 2025Lost in Sequence: Do Large Language Models Understand Sequential Recommendation?cited by 8
- 2025CoMaPOI: A Collaborative Multi-Agent Framework for Next POI Prediction Bridging the Gap Between Trajectory and Languagecited by 8
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Modelscited by 7
38 more
- 2025Privacy Risks of LLM-Empowered Recommender Systems: An Inversion Attack Perspectivecited by 6
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling Viewcited by 6
- 2024Bridging Conversational and Collaborative Signals for Conversational Recommendationcited by 5
- 2024MoRE: A Mixture of Reflectors Framework for Large Language Model-Based Sequential Recommendationcited by 4
- 2025Disentangling and Generating Modalities for Recommendation in Missing Modality Scenarioscited by 4
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Predictioncited by 4
- 2025The Pitfalls of Growing Group Complexity: LLMs and Social Choice-Based Aggregation for Group Recommendationscited by 3
- 2026CPGRec+: A Balance-oriented Framework for Personalized Video Game Recommendationscited by 3
- 2025From Voices to Worlds: Developing an AI-Powered Framework for 3D Object Generation in Augmented Realitycited by 2
- 2025X-Cross: Dynamic Integration of Language Models for Cross-Domain Sequential Recommendationcited by 2
- 2025Tuning Language Models for Robust Prediction of Diverse User Behaviorscited by 2
- 2025Consistent Explainers or Unreliable Narrators? Understanding LLM-generated Group Recommendationscited by 2
- 2025Not Just What, But When: Integrating Irregular Intervals to LLM for Sequential Recommendationcited by 2
- 2025ItemRAG: Item-Based Retrieval-Augmented Generation for LLM-Based Recommendationcited by 2
- 2024Prevailing Research Areas for Music AI in the Era of Foundation Modelscited by 1
- 2025Tuning-Free LLM Can Build A Strong Recommender Under Sparse Connectivity And Knowledge Gap Via Extracting Intentcited by 1
- 2025Do LLMs Understand Collaborative Signals? Diagnosis and Repaircited by 1
- 2025Augment or Not? A Comparative Study of Pure and Augmented Large Language Model Recommenderscited by 1
- 2025M-LLM3REC: A Motivation-Aware User-Item Interaction Framework for Enhancing Recommendation Accuracy with LLMscited by 1
- 2026SAGE: Sequence-level Adaptive Gradient Evolution for Generative Recommendationcited by 1
- 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Modelscited by 1
- 2026Reasoning-guided Collaborative Filtering with Language Models for Explainable Recommendationcited by 1
- 2025Token-Efficient Item Representation via Images for LLM Recommender Systemscited by 0
- 2025Improving LLM Interpretability and Performance via Guided Embedding Refinement for Sequential Recommendationcited by 0
- 2025Universal Reusability in Recommender Systems: The Case for Dataset- and Task-Independent Frameworkscited by 0
- 2025CORONA: A Coarse-to-Fine Framework for Graph-based Recommendation with Large Language Modelscited by 0
- 2025Beyond Semantic Understanding: Preserving Collaborative Frequency Components in LLM-based Recommendationcited by 0
- 2025RecMind: LLM-Enhanced Graph Neural Networks for Personalized Consumer Recommendationscited by 0
- 2025Bridging Collaborative Filtering and Large Language Models with Dynamic Alignment, Multimodal Fusion and Evidence-grounded Explanationscited by 0
- 2026CoNRec: Context-Discerning Negative Recommendation with LLMscited by 0
- 2026SafeCRS: Personalized Safety Alignment for LLM-Based Conversational Recommender Systemscited by 0
- 2026Causal Direct Preference Optimization for Distributionally Robust Generative Recommendationcited by 0
- 2026Filling the Gaps: Selective Knowledge Augmentation for LLM Recommenderscited by 0
- 2026MedicalRec: Medical recommender system for image classification without retrainingcited by 0
- 2026Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenderscited by 0
- 2026RecPFN: Prior-Fitted Networks for In-Context-Based Recommendationscited by 0
- 2026GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendationcited by 0
- 2026Grounded Skill Synthesis from Code at Scale for Agentic Intelligencecited by 0
- 2026Grounded Skill Synthesis from Code at Scale for Agentic Intelligence4 Sep 2026
- 2026GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendation2 Sep 2026
- 2026RecPFN: Prior-Fitted Networks for In-Context-Based Recommendations20 Aug 2026
- 2026Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenders11 Jul 2026
- 2026MedicalRec: Medical recommender system for image classification without retraining23 May 2026
- 2026CPGRec+: A Balance-oriented Framework for Personalized Video Game Recommendations16 Apr 2026
- 2026Filling the Gaps: Selective Knowledge Augmentation for LLM Recommenders9 Apr 2026
- 2026Causal Direct Preference Optimization for Distributionally Robust Generative Recommendation21 Mar 2026
- 2026SafeCRS: Personalized Safety Alignment for LLM-Based Conversational Recommender Systems3 Mar 2026
- 2026Reasoning-guided Collaborative Filtering with Language Models for Explainable Recommendation5 Feb 2026
- 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Models30 Jan 2026
- 2026SAGE: Sequence-level Adaptive Gradient Evolution for Generative Recommendation29 Jan 2026
38 more
- 2026CoNRec: Context-Discerning Negative Recommendation with LLMs22 Jan 2026
- 2025ItemRAG: Item-Based Retrieval-Augmented Generation for LLM-Based Recommendation19 Nov 2025
- 2025Bridging Collaborative Filtering and Large Language Models with Dynamic Alignment, Multimodal Fusion and Evidence-grounded Explanations2 Oct 2025
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling View29 Sep 2025
- 2025RecMind: LLM-Enhanced Graph Neural Networks for Personalized Consumer Recommendations8 Sep 2025
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Models3 Sep 2025
- 2025M-LLM3REC: A Motivation-Aware User-Item Interaction Framework for Enhancing Recommendation Accuracy with LLMs21 Aug 2025
- 2025Beyond Semantic Understanding: Preserving Collaborative Frequency Components in LLM-based Recommendation14 Aug 2025
- 2025Not Just What, But When: Integrating Irregular Intervals to LLM for Sequential Recommendation31 Jul 2025
- 2025Privacy Risks of LLM-Empowered Recommender Systems: An Inversion Attack Perspective20 Jul 2025
- 2025Consistent Explainers or Unreliable Narrators? Understanding LLM-generated Group Recommendations18 Jul 2025
- 2025CORONA: A Coarse-to-Fine Framework for Graph-based Recommendation with Large Language Models14 Jun 2025
- 2025Universal Reusability in Recommender Systems: The Case for Dataset- and Task-Independent Frameworks3 Jun 2025
- 2025Augment or Not? A Comparative Study of Pure and Augmented Large Language Model Recommenders29 May 2025
- 2025CoMaPOI: A Collaborative Multi-Agent Framework for Next POI Prediction Bridging the Gap Between Trajectory and Language28 May 2025
- 2025Do LLMs Understand Collaborative Signals? Diagnosis and Repair27 May 2025
- 2025Tuning Language Models for Robust Prediction of Diverse User Behaviors23 May 2025
- 2025Field Matters: A Lightweight LLM-enhanced Method for CTR Prediction20 May 2025
- 2025Tuning-Free LLM Can Build A Strong Recommender Under Sparse Connectivity And Knowledge Gap Via Extracting Intent16 May 2025
- 2025The Pitfalls of Growing Group Complexity: LLMs and Social Choice-Based Aggregation for Group Recommendations8 May 2025
- 2025X-Cross: Dynamic Integration of Language Models for Cross-Domain Sequential Recommendation29 Apr 2025
- 2025Disentangling and Generating Modalities for Recommendation in Missing Modality Scenarios23 Apr 2025
- 2025Improving LLM Interpretability and Performance via Guided Embedding Refinement for Sequential Recommendation15 Apr 2025
- 2025Token-Efficient Item Representation via Images for LLM Recommender Systems8 Mar 2025
- 2025From Voices to Worlds: Developing an AI-Powered Framework for 3D Object Generation in Augmented Reality4 Mar 2025
- 2025LLM-based User Profile Management for Recommender System20 Feb 2025
- 2025Lost in Sequence: Do Large Language Models Understand Sequential Recommendation?19 Feb 2025
- 2025ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendation19 Feb 2025
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models21 Jan 2025
- 2025The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit4 Jan 2025
- 2024Bridging Conversational and Collaborative Signals for Conversational Recommendation9 Dec 2024
- 2024BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching29 Nov 2024
- 2024Beyond Retrieval: Generating Narratives in Conversational Recommender Systems22 Oct 2024
- 2024STAR: A Simple Training-free Approach for Recommendations using Large Language Models21 Oct 2024
- 2024Prevailing Research Areas for Music AI in the Era of Foundation Models14 Sep 2024
- 2024MoRE: A Mixture of Reflectors Framework for Large Language Model-Based Sequential Recommendation10 Sep 2024
- 2024A semantic embedding space based on large language models for modelling human beliefs13 Aug 2024
- 2024Turning Generative Models Degenerate: The Power of Data Poisoning Attacks17 Jul 2024
- 2024Beyond Retrieval: Generating Narratives in Conversational Recommender Systemscited by 8
- 2025ItemRAG: Item-Based Retrieval-Augmented Generation for LLM-Based Recommendationcited by 2
- 2026Reasoning-guided Collaborative Filtering with Language Models for Explainable Recommendationcited by 1
- 2025CORONA: A Coarse-to-Fine Framework for Graph-based Recommendation with Large Language Modelscited by 0
- 2026Reasoning-guided Collaborative Filtering with Language Models for Explainable Recommendation5 Feb 2026
- 2025ItemRAG: Item-Based Retrieval-Augmented Generation for LLM-Based Recommendation19 Nov 2025
- 2025CORONA: A Coarse-to-Fine Framework for Graph-based Recommendation with Large Language Models14 Jun 2025
- 2024Beyond Retrieval: Generating Narratives in Conversational Recommender Systems22 Oct 2024
- 2026Causal Direct Preference Optimization for Distributionally Robust Generative Recommendation21 Mar 2026
- 2026SafeCRS: Personalized Safety Alignment for LLM-Based Conversational Recommender Systems3 Mar 2026
- 2026SAGE: Sequence-level Adaptive Gradient Evolution for Generative Recommendation29 Jan 2026
- 2024BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batchingcited by 31
- 2025ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendationcited by 18
- 2024A semantic embedding space based on large language models for modelling human beliefscited by 9
- 2025LLM-based User Profile Management for Recommender Systemcited by 9
- 2024STAR: A Simple Training-free Approach for Recommendations using Large Language Modelscited by 8
- 2025Lost in Sequence: Do Large Language Models Understand Sequential Recommendation?cited by 8
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Modelscited by 7
- 2025Privacy Risks of LLM-Empowered Recommender Systems: An Inversion Attack Perspectivecited by 6
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling Viewcited by 6
- 2024Bridging Conversational and Collaborative Signals for Conversational Recommendationcited by 5
- 2024MoRE: A Mixture of Reflectors Framework for Large Language Model-Based Sequential Recommendationcited by 4
- 2025Disentangling and Generating Modalities for Recommendation in Missing Modality Scenarioscited by 4
12 most cited of 38 All 38 (JSON)
- 2026GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendation2 Sep 2026
- 2026RecPFN: Prior-Fitted Networks for In-Context-Based Recommendations20 Aug 2026
- 2026Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenders11 Jul 2026
- 2026MedicalRec: Medical recommender system for image classification without retraining23 May 2026
- 2026CPGRec+: A Balance-oriented Framework for Personalized Video Game Recommendations16 Apr 2026
- 2026Filling the Gaps: Selective Knowledge Augmentation for LLM Recommenders9 Apr 2026
- 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Models30 Jan 2026
- 2026CoNRec: Context-Discerning Negative Recommendation with LLMs22 Jan 2026
- 2025Bridging Collaborative Filtering and Large Language Models with Dynamic Alignment, Multimodal Fusion and Evidence-grounded Explanations2 Oct 2025
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling View29 Sep 2025
- 2025RecMind: LLM-Enhanced Graph Neural Networks for Personalized Consumer Recommendations8 Sep 2025
- 2025Knowledge Integration for Physics-informed Symbolic Regression Using Pre-trained Large Language Models3 Sep 2025
12 newest of 38 All 38 (JSON)