Fusion and Alignment Enhancement with Large Language Models for Tail-item Sequential Recommendation
Not on the map. Why?
Abstract (arXiv)
Sequential Recommendation (SR) learns user preferences from their historical interaction sequences and provides personalized suggestions. In real-world scenarios, most items exhibit sparse interactions, known as the tail-item problem. This issue limits the model's ability to accurately capture item transition patterns. To tackle this, large language models (LLMs) offer a promising solution by capturing semantic relationships between items. Despite previous efforts to leverage LLM-derived embeddings for enriching tail items, they still face the following limitations: 1) They struggle to effectively fuse collaborative signals with semantic knowledge, leading to suboptimal item embedding quality. 2) Existing methods overlook the structural inconsistency between the ID and LLM embedding spaces, causing conflicting signals that degrade recommendation accuracy. In this work, we propose a Fusion and Alignment Enhancement framework with LLMs for Tail-item Sequential Recommendation (FAERec), which improves item representations by generating coherently-fused and structurally consistent embeddings. For the information fusion challenge, we design an adaptive gating mechanism that dynamically fuses ID and LLM embeddings. Then, we propose a dual-level alignment approach to mitigate structural inconsistency. The item-level alignment establishes correspondences between ID and LLM embeddings of the same item through contrastive learning, while the feature-level alignment constrains the correlation patterns between corresponding dimensions across the two embedding spaces. Furthermore, the weights of the two alignments are adjusted by a curriculum learning scheduler to avoid premature optimization of the complex feature-level objective. Extensive experiments across three widely used datasets with multiple representative SR backbones demonstrate the effectiveness and generalizability of our framework.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 71 references that are in the map. First posted on arXiv 4 Apr 2026.
Builds on
45 of 71 references.
References · 45
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
- 2021Pay Attention to MLPscited by 368
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
33 more
- 2020Whitening for Self-Supervised Representation Learningcited by 279
- 2017Automated Curriculum Learning for Neural Networkscited by 257
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 242
- 2017Neural Attentive Session-based Recommendationcited by 237
- 2023Representation Learning with Large Language Models for Recommendationcited by 155
- 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
- 2018A Simple Convolutional Generative Network for Next Item Recommendationcited by 120
- 2022Filter-enhanced MLP is All You Need for Sequential Recommendationcited by 96
- 2015Inferring Networks of Substitutable and Complementary Productscited by 92
- 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
- 2024LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendationcited by 47
- 2023Exploring Large Language Model for Graph Data Understanding in Online Job Recommendationscited by 45
- 2023A Survey on Popularity Bias in Recommender Systemscited by 43
- 2020Long-tail Session-based Recommendationcited by 33
- 2023Linear Recurrent Units for Sequential Recommendationcited by 32
- 2025FedSWA: Improving Generalization in Federated Learning with Highly Heterogeneous Data via Momentum-Based Stochastic Controlled Weight Averagingcited by 25
- 2024CALRec: Contrastive Alignment of Generative LLMs for Sequential Recommendationcited by 24
- 2024AlignRec: Aligning and Training in Multimodal Recommendationscited by 21
- 2023Cross-domain recommendation via user interest alignmentcited by 19
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
- 2023MELT: Mutual Enhancement of Long-Tailed User and Item for Sequential Recommendationcited by 18
- 2022Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendationcited by 16
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
- 2025FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Modelscited by 15
- 2024RecDCL: Dual Contrastive Learning for Recommendationcited by 11
- 2025AlphaFuse: Learn ID Embeddings for Sequential Recommendation in Null Space of Language Embeddingscited by 10
- 2025Data Augmentation as Free Lunch: Exploring the Test-Time Augmentation for Sequential Recommendationcited by 9
- 2021CITIES: Contextual Inference of Tail-Item Embeddings for Sequential Recommendationcited by 8
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
- 2020CmnRec: Sequential Recommendations with Chunk-accelerated Memory Networkcited by 3
- 2025Listwise Preference Alignment Optimization for Tail Item Recommendationcited by 2
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDscited by 2
- 2025Grounded by Experience: Generative Healthcare Prediction Augmented with Hierarchical Agentic Retrievalcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Improving LLM Interpretability and Performance via Guided Embedding Refinement for Sequential Recommendation
- 2025LLMDiRec: LLM-Enhanced Intent Diffusion for Sequential Recommendation ↗
- 2024Unleash LLMs Potential for Sequential Recommendation by Coordinating Dual Dynamic Index Mechanism
- 2025LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Training
- 2024SLMRec: Distilling Large Language Models into Small for Sequential Recommendation
- 2024Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenization
- 2024Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendation
- 2025Bidirectional Knowledge Distillation for Enhancing Sequential Recommendation with Large Language Models