mlsanityData to 14 Oct 2026

CAST: Modeling Semantic-Level Transitions for Complementary-Aware Sequential Recommendation

arXiv 2604.19414 ↗First posted 21 Apr 2026cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Sequential Recommendation (SR) aims to predict the next interaction of a user based on their behavior sequence, where complementary relations often provide essential signals for predicting the next item. However, mainstream models relying on sparse co-purchase statistics often mistake spurious correlations (e.g., due to popularity bias) for true complementary relations. Identifying true complementary relations requires capturing the fine-grained item semantics (e.g., specifications) that simple cooccurrence statistics would be unable to model. While recent semantics-based methods utilize discrete semantic codes to represent items, they typically aggregate semantic codes into coarse item representations. This aggregation process blurs specific semantic details required to identify complementarity. To address these critical limitations and effectively leverage semantics for capturing reliable complementary relations, we propose a Complementary-Aware Semantic Transition (CAST) framework that introduces a new modeling paradigm built upon semantic-level transitions. Specifically, a semantic-level transition module is designed to model dynamic transitions directly in the discrete semantic code space, effectively capturing fine-grained semantic dependencies often lost in aggregated item representations. Then, a complementary prior injection module is designed to incorporate LLM-verified complementary priors into the attention mechanism, thereby prioritizing complementary patterns over co-occurrence statistics. Experiments on multiple e-commerce datasets demonstrate that CAST consistently outperforms the state-of-the-art approaches, achieving up to 17.6% Recall and 16.0% NDCG gains with 65x training acceleration. This validates its effectiveness and efficiency in uncovering latent item complementarity beyond statistics. The code will be released upon acceptance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 21 Apr 2026.

Builds on

18 of 36 references.

References · 18

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2017Billion-scale similarity search with GPUscited by 2,497
  4. 2018Self-Attentive Sequential Recommendationcited by 1,184
  5. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  6. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  7. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
  8. 2016Recommendations as Treatments: Debiasing Learning and Evaluationcited by 248
  9. 2023LLMRec: Large Language Models with Graph Augmentation for Recommendationcited by 172
  10. 2021Contrastive Learning for Representation Degeneration Problem in Sequential Recommendationcited by 121
  11. 2021Causal Intervention for Leveraging Popularity Bias in Recommendationcited by 116
  12. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
6 more
  1. 2021Sequential Recommendation with Graph Neural Networkscited by 89
  2. 2023Frequency Enhanced Hybrid Attention Network for Sequential Recommendationcited by 52
  3. 2021Sparse-Interest Network for Sequential Recommendationcited by 38
  4. 2022CORE: Simple and Effective Session-based Recommendation within Consistent Representation Spacecited by 37
  5. 2024Sequence-level Semantic Representation Fusion for Recommender Systemscited by 10
  6. 2024Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential Recommendationcited by 8

Built on by

Not cited yet.