What Makes LLMs Effective Sequential Recommenders? A Study on Preference Intensity and Temporal Context
On the map: LLM alignment / RLHF / preference optimisation → Preference alignment for recommenders and RAG
Abstract (arXiv)
What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that existing preference-alignment approaches largely rely on binary pairwise comparisons, overlooking two critical factors: preference intensity (the structured strength of affinity or aversion) and temporal context (the extent to which recent interactions better reflect a user's current intent). Through controlled experiments, we show that leveraging comprehensive feedback with structured preference signals substantially improves recommendation performance, indicating that binary modeling discards essential information. Motivated by these findings, we propose RecPO, a unified preference optimization framework that maps both explicit and implicit feedback into a common preference signal and constructs adaptive reward margins that jointly account for preference intensity and interaction recency. Experiments across five datasets show that RecPO consistently outperforms state-of-the-art baselines while exhibiting behavioral patterns aligned with human decision-making, including favoring immediate satisfaction, maintaining preference coherence, and avoiding dispreferred items. Our results highlight that preference intensity and temporal context are fundamental ingredients for effective LLM-based recommendation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Preference alignment for recommenders and RAG, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 33 of its 61 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
33 of 61 references.
Closest ancestors · 1
Same direction, newest first
Other references · 32
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020Learning to summarize from human feedbackcited by 2,588
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
- 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
20 more
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2020Self-supervised Graph Learning for Recommendationcited by 305
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 242
- 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
- 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
- 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2024Direct Preference Optimization with an Offsetcited by 122
- 2022Intent Contrastive Learning for Sequential Recommendationcited by 91
- 2021Sequential Recommendation with Graph Neural Networkscited by 89
- 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
- 2020TAGNN: Target Attentive Graph Neural Networks for Session-based Recommendationcited by 33
- 2024CALRec: Contrastive Alignment of Generative LLMs for Sequential Recommendationcited by 24
- 2025Superficial Self-Improved Reasoners Benefit from Model Mergingcited by 16
- 2025Pretrained Image-Text Models are Secretly Video Captionerscited by 11
- 2024ELCoRec: Enhance Language Understanding with Co-Propagation of Numerical and Categorical Features for Recommendationcited by 2
- 2025Scaled Supervision is an Implicit Lipschitz Regularizercited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Behavior Knowledge Merge in Reinforced Agentic Modelscited by 11
- 2026Behavior Knowledge Merge in Reinforced Agentic Models20 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Toward User Preference Alignment in LLM Recommendation via Explicit Context Feedback
- 2024Direct Preference Optimization for LLM-Enhanced Recommendation Systems
- 2025User Feedback Alignment for LLM-powered Exploration in Large-scale Recommendation Systems
- 2024SLMRec: Distilling Large Language Models into Small for Sequential Recommendation
- 2024Preference Discerning with LLM-Enhanced Generative Retrieval
- 2026Aligning Multimodal Sequential Recommendations via Robust Direct Preference Optimization with Sparse MoE
- 2025Effectiveness of LLMs in Temporal User Profiling for Recommendation
- 2026P3Rec: Distilling Prior--Posterior Preference Reasoning for LLM-based Recommendation