CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendation
Not on the map. Why?
Abstract (arXiv)
Leveraging Large Language Models as Recommenders (LLMRec) has gained significant attention and introduced fresh perspectives in user preference modeling. Existing LLMRec approaches prioritize text semantics, usually neglecting the valuable collaborative information from user-item interactions in recommendations. While these text-emphasizing approaches excel in cold-start scenarios, they may yield sub-optimal performance in warm-start situations. In pursuit of superior recommendations for both cold and warm start scenarios, we introduce CoLLM, an innovative LLMRec methodology that seamlessly incorporates collaborative information into LLMs for recommendation. CoLLM captures collaborative information through an external traditional model and maps it to the input token embedding space of LLM, forming collaborative embeddings for LLM usage. Through this external integration of collaborative information, CoLLM ensures effective modeling of collaborative information without modifying the LLM itself, providing the flexibility to employ various collaborative information modeling techniques. Extensive experiments validate that CoLLM adeptly integrates collaborative information into LLMs, resulting in enhanced recommendation performance. We release the code and data at https://github.com/zyang1580/CoLLM.
Key facts. Cited by 99 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Oct 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 32; 2025: 38; 2026: 29.
99 papers.
Sort:
By area:
- 2024On Softmax Direct Preference Optimization for Recommendationcited by 64
- 2024A Review of Modern Recommender Systems Using Generative Models (Gen-RecSys)cited by 58
- 2025Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendationcited by 56
- 2025A Survey on LLM-powered Agents for Recommender Systemscited by 49
- 2024CoRAL: Collaborative Retrieval-Augmented Large Language Models Improve Long-tail Recommendationcited by 44
- 2025Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalizationcited by 44
- 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendationcited by 35
- 2024Customizing Language Models with Instance-wise LoRA for Sequential Recommendationcited by 32
- 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyondcited by 26
- 2024LLM-Enhanced User-Item Interactions: Leveraging Edge Information for Optimized Recommendationscited by 24
- 2024Review-driven Personalized Preference Reasoning with Large Language Models for Recommendationcited by 20
- 2025Towards Next-Generation Recommender Systems: A Benchmark for Personalized Recommendation Assistant with LLMscited by 20
38 more
- 2025Latent Inter-User Difference Modeling for LLM Personalizationcited by 20
- 2024Stealthy Attack on Large Language Model based Recommendationcited by 19
- 2024SLMRec: Distilling Large Language Models into Small for Sequential Recommendationcited by 18
- 2024Language Representations Can be What Recommenders Need: Findings and Potentialscited by 18
- 2025ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendationcited by 18
- 2024Towards Efficient and Effective Unlearning of Large Language Models for Recommendationcited by 16
- 2024A Survey of Generative Search and Recommendation in the Era of Large Language Modelscited by 14
- 2024Towards Graph Foundation Models for Personalizationcited by 12
- 2025Uncertainty Quantification and Decomposition for LLM-based Recommendationcited by 12
- 2025DrunkAgent: Stealthy Memory Corruption in LLM-Powered Recommender Agentscited by 12
- 2024Exploring the Impact of Large Language Models on Recommender Systems: An Extensive Reviewcited by 11
- 2025LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendationcited by 11
- 2024EasyRec: Simple yet Effective Language Models for Recommendationcited by 10
- 2024End-to-end Training for Recommendation with Language-based User Profilescited by 10
- 2025CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendationcited by 10
- 2024Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenizationcited by 9
- 2024Causality-Enhanced Behavior Sequence Modeling in LLMs for Personalized Recommendationcited by 8
- 2025Lost in Sequence: Do Large Language Models Understand Sequential Recommendation?cited by 8
- 2025RecGPT-V2 Technical Reportcited by 8
- 2024Item-Language Model for Conversational Recommendationcited by 7
- 2024Generative Explore-Exploit: Training-free Optimization of Generative Recommender Systems using LLM Optimizerscited by 7
- 2024CoRA: Collaborative Information Perception by Large Language Model's Weights for Recommendationcited by 7
- 2024Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendationcited by 7
- 2025From Prompting to Alignment: A Generative Framework for Query Recommendationcited by 7
- 2025GRAM: Generative Recommendation via Semantic-aware Multi-granular Late Fusioncited by 7
- 2025TrackRec: Iterative Alternating Feedback with Chain-of-Thought via Preference Alignment for Recommendationcited by 7
- 2025Prompt-R1: Collaborative Automatic Prompting Framework via End-to-end Reinforcement Learningcited by 7
- 2024Towards Incremental Learning in Large Language Models: A Critical Reviewcited by 6
- 2025EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integrationcited by 6
- 2025Hierarchical Tree Search-based User Lifelong Behavior Modeling on Large Language Modelcited by 6
- 2024Enhancing Collaborative Semantics of Language Model-Driven Recommendations via Graph-Aware Learningcited by 5
- 2024Bridging Conversational and Collaborative Signals for Conversational Recommendationcited by 5
- 2025Fine-grained List-wise Alignment for Generative Medication Recommendationcited by 5
- 2025IGD: Token Decisiveness Modeling via Information Gain in LLMs for Personalized Recommendationcited by 5
- 2024Integrating Large Language Models with Graphical Session-Based Recommendationcited by 4
- 2024Collaborative Cross-modal Fusion with Large Language Model for Recommendationcited by 4
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
- 2025Large Language Model as Universal Retriever in Industrial-Scale Recommender Systemcited by 4
50 most cited of 99 All 99 (JSON)
- 2026Textual User Taste: Natural-Language User Context for Foundation-Model Recommender System at Scale28 Sep 2026
- 2026GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendation2 Sep 2026
- 2026When Memory Takes Gradients: Collaborative Vector Memory for Agentic Recommender Systems27 Aug 2026
- 2026rEDMRec: Distilling Large Language Model Reasoning into an Editable Experience Memory for Recommendation19 Aug 2026
- 2026MIDAS: Multi-LLM Iterative Data-Adaptive Summarization5 Aug 2026
- 2026Diffusion Language Model for Recommendation23 Jul 2026
- 2026TailorMind: Towards Preference-Aligned Multimodal Content Generation22 Jun 2026
- 2026Preference-Aware Rubric Learning for Personalized Evaluation29 May 2026
- 2026ProRL: Effective Reinforcement Learning for Proactive Recommendation via Rectified Policy Gradient Estimation27 May 2026
- 2026Mixture-of-Experts Knowledge Graph Retrieval-Augmented Generation for Multi-Agent LLM-based Recommendation27 May 2026
- 2026AgentGR: Semantic-aware Agentic Group Decision-Making Simulator for Group Recommendation11 May 2026
- 2026LLM Agents Enable User-Governed Personalization Beyond Platform Boundaries10 May 2026
38 more
- 2026RRCM: Ranking-Driven Retrieval over Collaborative and Meta Memories for LLM Recommendation8 May 2026
- 2026DynamicPO: Dynamic Preference Optimization for Recommendation1 May 2026
- 2026LLMs Reading the Rhythms of Daily Life: Aligned Understanding for Behavior Prediction and Generation26 Apr 2026
- 2026Decoupled Travel Planning with Behavior Forest23 Apr 2026
- 2026GraphLoRA: Structure-Aware Low-Rank Adaptation for Large Language Model Recommendation20 Apr 2026
- 2026CPGRec+: A Balance-oriented Framework for Personalized Video Game Recommendations16 Apr 2026
- 2026Lightweight Fairness for LLM-Based Recommendations via Kernelized Projection and Gated Adapters24 Mar 2026
- 2026Causal Direct Preference Optimization for Distributionally Robust Generative Recommendation21 Mar 2026
- 2026A Unified Language Model for Large Scale Search, Recommendation, and Reasoning18 Mar 2026
- 2026Verifiable Reasoning for LLM-based Generative Recommendation8 Mar 2026
- 2026Learning User Interests via Reasoning and Distillation for Cross-Domain News Recommendation16 Feb 2026
- 2026Benchmark Leakage Trap: Can We Trust LLM-based Recommendation?14 Feb 2026
- 2026Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendation13 Feb 2026
- 2026Hi-SAM: A Hierarchical Structure-Aware Multi-modal Framework for Large-Scale Recommendation12 Feb 2026
- 2026Reasoning-guided Collaborative Filtering with Language Models for Explainable Recommendation5 Feb 2026
- 2026Don't Start Over: A Cost-Effective Framework for Migrating Personalized Prompts Between LLMs17 Jan 2026
- 2026Do LLMs Benefit from User and Item Embeddings in Recommendation Tasks?8 Jan 2026
- 2025RecGPT-V2 Technical Report16 Dec 2025
- 2025CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendation27 Nov 2025
- 2025Prompt-R1: Collaborative Automatic Prompting Framework via End-to-end Reinforcement Learning2 Nov 2025
- 2025Reinforced Strategy Optimization for Conversational Recommender Systems via Network-of-Experts30 Sep 2025
- 2025Membership Inference Attack against Large Language Model-based Recommendation Systems: A New Distillation-based Paradigm16 Sep 2025
- 2025RecMind: LLM-Enhanced Graph Neural Networks for Personalized Consumer Recommendations8 Sep 2025
- 2025TrackRec: Iterative Alternating Feedback with Chain-of-Thought via Preference Alignment for Recommendation21 Aug 2025
- 2025Beyond Semantic Understanding: Preserving Collaborative Frequency Components in LLM-based Recommendation14 Aug 2025
- 2025Beyond Single Labels: Improving Conversational Recommendation through LLM-Powered Data Augmentation30 Jul 2025
- 2025Latent Inter-User Difference Modeling for LLM Personalization28 Jul 2025
- 2025Brownian Bridge Diffusion for Sequential Recommendation8 Jul 2025
- 2025When Transformers Meet Recommenders: Integrating Self-Attentive Sequential Recommendation with Fine-Tuned LLMs8 Jul 2025
- 2025LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendation22 Jun 2025
- 2025IGD: Token Decisiveness Modeling via Information Gain in LLMs for Personalized Recommendation16 Jun 2025
- 2025GeoCAD: Local Geometry-Controllable CAD Generation with Large Language Models12 Jun 2025
- 2025Fire360: A Benchmark for Robust Perception and Episodic Memory in Degraded 360-Degree Firefighting Videos2 Jun 2025
- 2025GRAM: Generative Recommendation via Semantic-aware Multi-granular Late Fusion2 Jun 2025
- 2025Resolving Knowledge Conflicts in Domain-specific Data Selection: A Case Study on Medical Instruction-tuning28 May 2025
- 2025Fine-grained List-wise Alignment for Generative Medication Recommendation26 May 2025
- 2025Hierarchical Tree Search-based User Lifelong Behavior Modeling on Large Language Model26 May 2025
- 2025Tuning Language Models for Robust Prediction of Diverse User Behaviors23 May 2025
50 newest of 99 All 99 (JSON)
- 2024CoRAL: Collaborative Retrieval-Augmented Large Language Models Improve Long-tail Recommendationcited by 44
- 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyondcited by 26
- 2024Review-driven Personalized Preference Reasoning with Large Language Models for Recommendationcited by 20
- 2024Exploring the Impact of Large Language Models on Recommender Systems: An Extensive Reviewcited by 11
- 2024Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenizationcited by 9
- 2025TrackRec: Iterative Alternating Feedback with Chain-of-Thought via Preference Alignment for Recommendationcited by 7
- 2025Hierarchical Tree Search-based User Lifelong Behavior Modeling on Large Language Modelcited by 6
- 2026Verifiable Reasoning for LLM-based Generative Recommendationcited by 2
- 2026A Unified Language Model for Large Scale Search, Recommendation, and Reasoningcited by 2
- 2026Reasoning-guided Collaborative Filtering with Language Models for Explainable Recommendationcited by 1
- 2026Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendationcited by 1
- 2026Learning User Interests via Reasoning and Distillation for Cross-Domain News Recommendationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026rEDMRec: Distilling Large Language Model Reasoning into an Editable Experience Memory for Recommendation19 Aug 2026
- 2026RRCM: Ranking-Driven Retrieval over Collaborative and Meta Memories for LLM Recommendation8 May 2026
- 2026A Unified Language Model for Large Scale Search, Recommendation, and Reasoning18 Mar 2026
- 2026Verifiable Reasoning for LLM-based Generative Recommendation8 Mar 2026
- 2026Learning User Interests via Reasoning and Distillation for Cross-Domain News Recommendation16 Feb 2026
- 2026Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendation13 Feb 2026
- 2026Reasoning-guided Collaborative Filtering with Language Models for Explainable Recommendation5 Feb 2026
- 2025TrackRec: Iterative Alternating Feedback with Chain-of-Thought via Preference Alignment for Recommendation21 Aug 2025
- 2025Hierarchical Tree Search-based User Lifelong Behavior Modeling on Large Language Model26 May 2025
- 2024Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenization18 Dec 2024
- 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyond10 Oct 2024
- 2024Review-driven Personalized Preference Reasoning with Large Language Models for Recommendation12 Aug 2024
12 newest of 14 All 14 (JSON)
- 2025A Survey on LLM-powered Agents for Recommender Systemscited by 49
- 2025DrunkAgent: Stealthy Memory Corruption in LLM-Powered Recommender Agentscited by 12
- 2025Cochain: Balancing Insufficient and Excessive Collaboration in LLM Agent Workflowscited by 2
- 2026LLM Agents Enable User-Governed Personalization Beyond Platform Boundariescited by 1
- 2026AgentGR: Semantic-aware Agentic Group Decision-Making Simulator for Group Recommendationcited by 0
- 2026When Memory Takes Gradients: Collaborative Vector Memory for Agentic Recommender Systemscited by 0
- 2026When Memory Takes Gradients: Collaborative Vector Memory for Agentic Recommender Systems27 Aug 2026
- 2026AgentGR: Semantic-aware Agentic Group Decision-Making Simulator for Group Recommendation11 May 2026
- 2026LLM Agents Enable User-Governed Personalization Beyond Platform Boundaries10 May 2026
- 2025Cochain: Balancing Insufficient and Excessive Collaboration in LLM Agent Workflows16 May 2025
- 2025DrunkAgent: Stealthy Memory Corruption in LLM-Powered Recommender Agents31 Mar 2025
- 2025A Survey on LLM-powered Agents for Recommender Systems14 Feb 2025
- 2024On Softmax Direct Preference Optimization for Recommendationcited by 64
- 2025From Prompting to Alignment: A Generative Framework for Query Recommendationcited by 7
- 2026Preference-Aware Rubric Learning for Personalized Evaluationcited by 2
- 2026Causal Direct Preference Optimization for Distributionally Robust Generative Recommendationcited by 0
- 2026DynamicPO: Dynamic Preference Optimization for Recommendationcited by 0
- 2026Preference-Aware Rubric Learning for Personalized Evaluation29 May 2026
- 2026DynamicPO: Dynamic Preference Optimization for Recommendation1 May 2026
- 2026Causal Direct Preference Optimization for Distributionally Robust Generative Recommendation21 Mar 2026
- 2025From Prompting to Alignment: A Generative Framework for Query Recommendation14 Apr 2025
- 2024On Softmax Direct Preference Optimization for Recommendation13 Jun 2024
- 2025Brownian Bridge Diffusion for Sequential Recommendationcited by 1
- 2026Diffusion Language Model for Recommendationcited by 0
- 2026Diffusion Language Model for Recommendation23 Jul 2026
- 2025Brownian Bridge Diffusion for Sequential Recommendation8 Jul 2025
- 2024A Review of Modern Recommender Systems Using Generative Models (Gen-RecSys)cited by 58
- 2025Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalizationcited by 44
- 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendationcited by 35
- 2024LLM-Enhanced User-Item Interactions: Leveraging Edge Information for Optimized Recommendationscited by 24
- 2025Towards Next-Generation Recommender Systems: A Benchmark for Personalized Recommendation Assistant with LLMscited by 20
- 2025Latent Inter-User Difference Modeling for LLM Personalizationcited by 20
- 2024Stealthy Attack on Large Language Model based Recommendationcited by 19
- 2024SLMRec: Distilling Large Language Models into Small for Sequential Recommendationcited by 18
- 2024Language Representations Can be What Recommenders Need: Findings and Potentialscited by 18
- 2025ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendationcited by 18
- 2024A Survey of Generative Search and Recommendation in the Era of Large Language Modelscited by 14
- 2024Towards Graph Foundation Models for Personalizationcited by 12
12 most cited of 65 All 65 (JSON)
- 2026Textual User Taste: Natural-Language User Context for Foundation-Model Recommender System at Scale28 Sep 2026
- 2026GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendation2 Sep 2026
- 2026MIDAS: Multi-LLM Iterative Data-Adaptive Summarization5 Aug 2026
- 2026TailorMind: Towards Preference-Aligned Multimodal Content Generation22 Jun 2026
- 2026ProRL: Effective Reinforcement Learning for Proactive Recommendation via Rectified Policy Gradient Estimation27 May 2026
- 2026LLMs Reading the Rhythms of Daily Life: Aligned Understanding for Behavior Prediction and Generation26 Apr 2026
- 2026Decoupled Travel Planning with Behavior Forest23 Apr 2026
- 2026GraphLoRA: Structure-Aware Low-Rank Adaptation for Large Language Model Recommendation20 Apr 2026
- 2026CPGRec+: A Balance-oriented Framework for Personalized Video Game Recommendations16 Apr 2026
- 2026Benchmark Leakage Trap: Can We Trust LLM-based Recommendation?14 Feb 2026
- 2026Hi-SAM: A Hierarchical Structure-Aware Multi-modal Framework for Large-Scale Recommendation12 Feb 2026
- 2026Don't Start Over: A Cost-Effective Framework for Migrating Personalized Prompts Between LLMs17 Jan 2026
12 newest of 65 All 65 (JSON)