mlsanityData to 14 Oct 2026

What Makes LLMs Effective Sequential Recommenders? A Study on Preference Intensity and Temporal Context

arXiv 2506.02261 ↗First posted 2 Jun 2025cs.IR cs.LGcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Preference alignment for recommenders and RAG

Abstract (arXiv)

What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that existing preference-alignment approaches largely rely on binary pairwise comparisons, overlooking two critical factors: preference intensity (the structured strength of affinity or aversion) and temporal context (the extent to which recent interactions better reflect a user's current intent). Through controlled experiments, we show that leveraging comprehensive feedback with structured preference signals substantially improves recommendation performance, indicating that binary modeling discards essential information. Motivated by these findings, we propose RecPO, a unified preference optimization framework that maps both explicit and implicit feedback into a common preference signal and constructs adaptive reward margins that jointly account for preference intensity and interaction recency. Experiments across five datasets show that RecPO consistently outperforms state-of-the-art baselines while exhibiting behavioral patterns aligned with human decision-making, including favoring immediate satisfaction, maintaining preference coherence, and avoiding dispreferred items. Our results highlight that preference intensity and temporal context are fundamental ingredients for effective LLM-based recommendation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Preference alignment for recommenders and RAG, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 33 of its 61 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

33 of 61 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024On Softmax Direct Preference Optimization for Recommendation13 Jun

Other references · 32

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2020Learning to summarize from human feedbackcited by 2,588
  6. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  7. 2018Self-Attentive Sequential Recommendationcited by 1,184
  8. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  9. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
  10. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
  11. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  12. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
20 more
  1. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
  2. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
  3. 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
  4. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  5. 2020Self-supervised Graph Learning for Recommendationcited by 305
  6. 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 242
  7. 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
  8. 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
  9. 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
  10. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  11. 2024Direct Preference Optimization with an Offsetcited by 122
  12. 2022Intent Contrastive Learning for Sequential Recommendationcited by 91
  13. 2021Sequential Recommendation with Graph Neural Networkscited by 89
  14. 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
  15. 2020TAGNN: Target Attentive Graph Neural Networks for Session-based Recommendationcited by 33
  16. 2024CALRec: Contrastive Alignment of Generative LLMs for Sequential Recommendationcited by 24
  17. 2025Superficial Self-Improved Reasoners Benefit from Model Mergingcited by 16
  18. 2025Pretrained Image-Text Models are Secretly Video Captionerscited by 11
  19. 2024ELCoRec: Enhance Language Understanding with Co-Propagation of Numerical and Categorical Features for Recommendationcited by 2
  20. 2025Scaled Supervision is an Implicit Lipschitz Regularizercited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Toward User Preference Alignment in LLM Recommendation via Explicit Context Feedback
  2. 2024Direct Preference Optimization for LLM-Enhanced Recommendation Systems
  3. 2025User Feedback Alignment for LLM-powered Exploration in Large-scale Recommendation Systems
  4. 2024SLMRec: Distilling Large Language Models into Small for Sequential Recommendation
  5. 2024Preference Discerning with LLM-Enhanced Generative Retrieval
  6. 2026Aligning Multimodal Sequential Recommendations via Robust Direct Preference Optimization with Sparse MoE
  7. 2025Effectiveness of LLMs in Temporal User Profiling for Recommendation
  8. 2026P3Rec: Distilling Prior--Posterior Preference Reasoning for LLM-based Recommendation