mlsanityData to 7 Oct 2026

Enhancing High-order Interaction Awareness in LLM-based Recommender Model

arXiv 2409.19979 ↗First posted 30 Sep 2024cs.IR cs.CLcited by 8

On the map: LLM reasoning → LLM reasoning for recommendation

Abstract (arXiv)

Large language models (LLMs) have demonstrated prominent reasoning capabilities in recommendation tasks by transforming them into text-generation tasks. However, existing approaches either disregard or ineffectively model the user-item high-order interactions. To this end, this paper presents an enhanced LLM-based recommender (ELMRec). We enhance whole-word embeddings to substantially enhance LLMs' interpretation of graph-constructed interactions for recommendations, without requiring graph pre-training. This finding may inspire endeavors to incorporate rich knowledge graphs into LLM-based recommenders via whole-word embedding. We also found that LLMs often recommend items based on users' earlier interactions rather than recent ones, and present a reranking solution. Our ELMRec outperforms state-of-the-art (SOTA) methods in both direct and sequential recommendations.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in LLM reasoning for recommendation, one of 17 directions in LLM reasoning. Builds on 41 of its 56 references that are in the map. First posted on arXiv 30 Sep 2024.

Builds on

41 of 56 references.

References · 41

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  4. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  5. 2018Self-Attentive Sequential Recommendationcited by 1,169
  6. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  7. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  8. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  9. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  10. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
  11. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  12. 2020SIGN: Scalable Inception Graph Neural Networkscited by 283
29 more
  1. 2023Exploring the Potential of Large Language Models (LLMs) in Learning on Graphscited by 271
  2. 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 207
  3. 2023LLMRec: Large Language Models with Graph Augmentation for Recommendationcited by 171
  4. 2023Representation Learning with Large Language Models for Recommendationcited by 155
  5. 2023Recommender AI Agent: Integrating Large Language Models for Interactive Recommendationscited by 130
  6. 2023Large Language Models as Zero-Shot Conversational Recommenderscited by 126
  7. 2019Hierarchical Gating Networks for Sequential Recommendationcited by 101
  8. 2022Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learningcited by 86
  9. 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
  10. 2024Can GNN be Good Adapter for LLMs?cited by 71
  11. 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferencescited by 66
  12. 2021SimpleX: A Simple and Strong Baseline for Collaborative Filteringcited by 65
  13. 2022Towards Representation Alignment and Uniformity in Collaborative Filteringcited by 57
  14. 2023LlamaRec: Two-Stage Recommendation using Large Language Models for Rankingcited by 52
  15. 2023Leveraging Large Language Models for Pre-trained Recommender Systemscited by 42
  16. 2021A Simple and Effective Positional Encoding for Transformerscited by 37
  17. 2023Graph Positional Encoding via Random Feature Propagationcited by 30
  18. 2024LLM-Enhanced User-Item Interactions: Leveraging Edge Information for Optimized Recommendationscited by 24
  19. 2024CALRec: Contrastive Alignment of Generative LLMs for Sequential Recommendationcited by 23
  20. 2022Multi-view Intent Disentangle Graph Networks for Bundle Recommendationcited by 22
  21. 2024RDRec: Rationale Distillation for LLM-based Recommendationcited by 21
  22. 2023Explainable Recommendation with Personalized Review Retrieval and Aspect Learningcited by 19
  23. 2023Large Language Model Can Interpret Latent Space of Sequential Recommendercited by 19
  24. 2023DataFinder: Scientific Dataset Recommendation from Natural Language Descriptionscited by 15
  25. 2024Towards Graph Foundation Models for Personalizationcited by 12
  26. 2024Large Language Model with Graph Convolution for Recommendationcited by 10
  27. 2024RA-Rec: An Efficient ID Representation Alignment Framework for LLM-based Recommendationcited by 7
  28. 2024NFARec: A Negative Feedback-Aware Recommender Modelcited by 3
  29. 2024CaDRec: Contextualized and Debiased Recommender Modelcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 2.

8 papers.

  1. 2025Towards Agentic Recommender Systems in the Era of Multimodal Large Language Modelscited by 25
  2. 2025GRAM: Generative Recommendation via Semantic-aware Multi-granular Late Fusioncited by 7
  3. 2024EF-LLM: Energy Forecasting LLM with AI-assisted Automation, Enhanced Sparse Prediction, Hallucination Detectioncited by 6
  4. 2025Graph Foundation Models for Recommendation: A Comprehensive Surveycited by 3
  5. 2025eSASRec: Enhancing Transformer-based Recommendations in a Modular Fashioncited by 3
  6. 2025Enhancing Time Awareness in Generative Recommendationcited by 2
  7. 2026Structuring and Tokenizing Distributed User Interest Context for Generative Recommendationcited by 0
  8. 2026P3Rec: Distilling Prior--Posterior Preference Reasoning for LLM-based Recommendationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges
  2. 2024Large Language Models Enhanced Collaborative Filtering
  3. 2024Aligning Large Language Models with Recommendation Knowledge
  4. 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyond
  5. 2025LlamaRec-LKG-RAG: A Single-Pass, Learnable Knowledge Graph-RAG Framework for LLM-Based Ranking
  6. 2023How Can Recommender Systems Benefit from Large Language Models: A Survey
  7. 2025CORONA: A Coarse-to-Fine Framework for Graph-based Recommendation with Large Language Models
  8. 2024All Roads Lead to Rome: Unveiling the Trajectory of Recommender Systems Across the LLM Era