mlsanityData to 14 Oct 2026

Compositions of Variant Experts for Integrating Short-Term and Long-Term Preferences

arXiv 2506.23170 ↗First posted 29 Jun 2025cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In the online digital realm, recommendation systems are ubiquitous and play a crucial role in enhancing user experience. These systems leverage user preferences to provide personalized recommendations, thereby helping users navigate through the paradox of choice. This work focuses on personalized sequential recommendation, where the system considers not only a user's immediate, evolving session context, but also their cumulative historical behavior to provide highly relevant and timely recommendations. Through an empirical study conducted on diverse real-world datasets, we have observed and quantified the existence and impact of both short-term (immediate and transient) and long-term (enduring and stable) preferences on users' historical interactions. Building on these insights, we propose a framework that combines short- and long-term preferences to enhance recommendation performance, namely Compositions of Variant Experts (CoVE). This novel framework dynamically integrates short- and long-term preferences through the use of different specialized recommendation models (i.e., experts). Extensive experiments showcase the effectiveness of the proposed methods and ablation studies further investigate the impact of variant expert types.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 83 references that are in the map. First posted on arXiv 29 Jun 2025.

Builds on

44 of 83 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  4. 2018Self-Attentive Sequential Recommendationcited by 1,184
  5. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  6. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  7. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  8. 2022Mixture-of-Experts with Expert Choice Routingcited by 623
  9. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
  10. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
  11. 2022Unified Scaling Laws for Routed Language Modelscited by 253
  12. 2017Neural Attentive Session-based Recommendationcited by 237
32 more
  1. 2017Recurrent Neural Networks with Top-k Gains for Session-based Recommendationscited by 165
  2. 2023Representation Learning with Large Language Models for Recommendationcited by 155
  3. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  4. 2018A Simple Convolutional Generative Network for Next Item Recommendationcited by 120
  5. 2021DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learningcited by 115
  6. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
  7. 2017Fast Matrix Factorization for Online Recommendation with Implicit Feedbackcited by 101
  8. 2017Joint Deep Modeling of Users and Items Using Reviews for Recommendationcited by 84
  9. 2017Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networkscited by 84
  10. 2017Translation-based Recommendationcited by 71
  11. 2018RepeatNet: A Repeat Aware Neural Recommendation Machine for Session-based Recommendationcited by 51
  12. 2022Multi-Behavior Hypergraph-Enhanced Transformer for Sequential Recommendationcited by 42
  13. 2023Exploring the Upper Limits of Text-Based Collaborative Filtering Using Large Language Models: Discoveries and Insightscited by 38
  14. 2019CosRec: 2D Convolutional Neural Networks for Sequential Recommendationcited by 37
  15. 2023Turning Dross Into Gold Loss: is BERT4Rec really better than SASRec?cited by 30
  16. 2023gSASRec: Reducing Overconfidence in Sequential Recommendation Trained with Negative Samplingcited by 29
  17. 2018Multi-Pointer Co-Attention Networks for Recommendationcited by 25
  18. 2021A Case Study on Sampling Strategies for Evaluating Neural Sequential Item Recommendation Modelscited by 25
  19. 2022A Systematic Review and Replicability Study of BERT4Rec for Sequential Recommendationcited by 22
  20. 2023Widespread Flaws in Offline Evaluation of Recommender Systemscited by 22
  21. 2021Session-based Recommendation with Hypergraph Attention Networkscited by 19
  22. 2023OpenP5: An Open-Source Platform for Developing, Training, and Evaluating LLM-based Recommender Systemscited by 19
  23. 2024A Survey on Cross-Domain Sequential Recommendationcited by 16
  24. 2020Session-aware Recommendation: A Surprising Quest for the State-of-the-artcited by 15
  25. 2023The Effect of Third Party Implementations on Reproducibilitycited by 10
  26. 2025Lost in Sequence: Do Large Language Models Understand Sequential Recommendation?cited by 8
  27. 2023A Survey on Multi-Behavior Sequential Recommendationcited by 7
  28. 2024Graph and Sequential Neural Networks in Session-based Recommendation: A Surveycited by 7
  29. 2024Enhancing Sequential Music Recommendation with Personalized Popularity Awarenesscited by 7
  30. 2024Revisiting BPR: A Replicability Study of a Common Recommender System Baselinecited by 3
  31. 2025Efficient Recommendation with Millions of Items by Dynamic Pruning of Sub-Item Embeddingscited by 3
  32. 2024Enhancing ID-based Recommendation with Large Language Modelscited by 2

Built on by

Not cited yet.