mlsanityData to 7 Oct 2026

Rethinking Convolutional Networks for Attribute-Aware Sequential Recommendation

arXiv 2605.04723 ↗First posted 6 May 2026cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Attribute-aware sequential recommendation entails predicting the next item a user will interact with based on a chronologically ordered history of past interactions, enriched with item attributes. Existing methods typically leverage self-attention mechanisms to aggregate the entire sequence into a unified representation used for next-item prediction. While effective, these models often suffer from high computational complexity and memory consumption, limiting their ability to process long user histories. This constraint restricts the model's capacity to fully capture long-term user preferences. In some scenarios, modeling item interactions purely through attention may also not be the most effective approach to extract sequential patterns. In this work, we propose ConvRec, an alternative method with linear computational and memory complexity that employs convolutional layers in a hierarchical, down-scaled fashion to generate compact, yet expressive sequence representations. To further enhance the model's ability to capture diverse sequential patterns, each layer aggregates the neighboring items gradually to reach a comprehensive sequence representation. Extensive experiments on four real-world datasets demonstrate that our approach outperforms state-of-the-art sequential recommendation models, highlighting the potential of convolution-based architectures for efficient and effective sequence modeling in recommendation systems. Our implementation code and datasets are available here https://github.com/ismll-research/ConvRec.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

19 of 33 references.

References · 19

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  5. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  6. 2018Self-Attentive Sequential Recommendationcited by 1,169
  7. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  8. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  9. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  10. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  11. 2017Recurrent Neural Networks with Top-k Gains for Session-based Recommendationscited by 165
  12. 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 113
7 more
  1. 2021Contrastive Self-supervised Sequential Recommendation with Robust Augmentationcited by 56
  2. 2021Non-invasive Self-attention for Side Information Fusion in Sequential Recommendationcited by 39
  3. 2019CosRec: 2D Convolutional Neural Networks for Sequential Recommendationcited by 37
  4. 2022Decoupled Side Information Fusion for Sequential Recommendationcited by 30
  5. 2022CARCA: Context and Attribute-Aware Next-Item Recommendation via Cross-Attentioncited by 22
  6. 2022End-to-End Image-Based Fashion Recommendationcited by 5
  7. 2023Proxy-based Item Representation for Attribute and Context-aware Recommendationcited by 2

Built on by

Not cited yet.