mlsanityData to 7 Oct 2026

Do LLMs Benefit from User and Item Embeddings in Recommendation Tasks?

arXiv 2601.04690 ↗First posted 8 Jan 2026cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have emerged as promising recommendation systems, offering novel ways to model user preferences through generative approaches. However, many existing methods often rely solely on text semantics or incorporate collaborative signals in a limited manner, typically using only user or item embeddings. These methods struggle to handle multiple item embeddings representing user history, reverting to textual semantics and neglecting richer collaborative information. In this work, we propose a simple yet effective solution that projects user and item embeddings, learned from collaborative filtering, into the LLM token space via separate lightweight projector modules. A finetuned LLM then conditions on these projected embeddings alongside textual tokens to generate recommendations. Preliminary results show that this design effectively leverages structured user-item interaction data, improves recommendation performance over text-only LLM baselines, and offers a practical path for bridging traditional recommendation systems with modern LLMs.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 8 Jan 2026.

Builds on

26 of 30 references.

References · 26

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  6. 2024Qwen2 Technical Reportcited by 2,076
  7. 2018Self-Attentive Sequential Recommendationcited by 1,169
  8. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  9. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  10. 2016Wide & Deep Learning for Recommender Systemscited by 745
  11. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  12. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
14 more
  1. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  2. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
  3. 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
  4. 2023LLMRec: Large Language Models with Graph Augmentation for Recommendationcited by 171
  5. 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
  6. 2019Hierarchical Gating Networks for Sequential Recommendationcited by 101
  7. 2023CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendationcited by 99
  8. 2023LLM-Rec: Personalized Recommendation via Prompting Large Language Modelscited by 77
  9. 2021SimpleX: A Simple and Strong Baseline for Collaborative Filteringcited by 65
  10. 2024Text-like Encoding of Collaborative Information in Large Language Models for Recommendationcited by 25
  11. 2023OpenP5: An Open-Source Platform for Developing, Training, and Evaluating LLM-based Recommender Systemscited by 19
  12. 2023Demystifying Embedding Spaces using Large Language Modelscited by 17
  13. 2024Item-Language Model for Conversational Recommendationcited by 7
  14. 2025Enhancing LLM-based Recommendation through Semantic-Aligned Collaborative Knowledgecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.