Efficient Sequential Recommendation for Long Term User Interest Via Personalization
Not on the map. Why?
Abstract (arXiv)
Recent years have witnessed success of sequential modeling, generative recommender, and large language model for recommendation. Though the scaling law has been validated for sequential models, it showed inefficiency in computational capacity when considering real-world applications like recommendation, due to the non-linear(quadratic) increasing nature of the transformer model. To improve the efficiency of the sequential model, we introduced a novel approach to sequential recommendation that leverages personalization techniques to enhance efficiency and performance. Our method compresses long user interaction histories into learnable tokens, which are then combined with recent interactions to generate recommendations. This approach significantly reduces computational costs while maintaining high recommendation accuracy. Our method could be applied to existing transformer based recommendation models, e.g., HSTU and HLLM. Extensive experiments on multiple sequential models demonstrate its versatility and effectiveness. Source code is available at hrefhttps://github.com/facebookresearch/PerSRechttps://github.com/facebookresearch/PerSRec.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 43 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
36 of 43 references.
References · 36
- 2017Attention Is All You Needcited by 60,361
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 717
24 more
- 2023Ring Attention with Blockwise Transformers for Near-Infinite Contextcited by 457
- 2023Learning to Compress Prompts with Gist Tokenscited by 390
- 2023A Survey on Large Language Models for Recommendationcited by 379
- 2023Adapting Language Models to Compress Contextscited by 356
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 309
- 2023In-context Autoencoder for Context Compression in a Large Language Modelcited by 199
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
- 2024HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modelingcited by 63
- 2023LlamaRec: Two-Stage Recommendation using Large Language Models for Rankingcited by 53
- 2025LONGER: Scaling Up Long Sequence Modeling in Industrial Recommenderscited by 47
- 2024NoteLLM-2: Multimodal Large Representation Models for Recommendationcited by 44
- 2023TWIN: TWo-stage Interest Network for Lifelong User Behavior Modeling in CTR Prediction at Kuaishoucited by 41
- 2024SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separatorcited by 41
- 2024LLM4Rerank: LLM-based Auto-Reranking Framework for Recommendationscited by 40
- 2024NoteLLM: A Retrievable Large Language Model for Note Recommendationcited by 33
- 2024TWIN V2: Scaling Ultra-Long User Behavior Sequence Modeling for Enhanced CTR Prediction at Kuaishoucited by 30
- 2024A Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compressioncited by 17
- 2024Multi-Behavior Generative Recommendationcited by 15
- 2024EB-NeRD: A Large-Scale Dataset for News Recommendationcited by 12
- 2024Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendationcited by 7
- 2024MerRec: A Large-scale Multipurpose Mercari Dataset for Consumer-to-Consumer Recommendation Systemscited by 6
- 2024KuaiFormer: Transformer-Based Retrieval at Kuaishoucited by 6
- 2023Sim2Rec: A Simulator-based Decision-making Approach to Optimize Real-World Long-term User Engagement in Sequential Recommender Systemscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.