Sequential Modeling with Multiple Attributes for Watchlist Recommendation in E-Commerce
Not on the map. Why?
Abstract (arXiv)
In e-commerce, the watchlist enables users to track items over time and has emerged as a primary feature, playing an important role in users' shopping journey. Watchlist items typically have multiple attributes whose values may change over time (e.g., price, quantity). Since many users accumulate dozens of items on their watchlist, and since shopping intents change over time, recommending the top watchlist items in a given context can be valuable. In this work, we study the watchlist functionality in e-commerce and introduce a novel watchlist recommendation task. Our goal is to prioritize which watchlist items the user should pay attention to next by predicting the next items the user will click. We cast this task as a specialized sequential recommendation task and discuss its characteristics. Our proposed recommendation model, Trans2D, is built on top of the Transformer architecture, where we further suggest a novel extended attention mechanism (Attention2D) that allows to learn complex item-item, attribute-attribute and item-attribute patterns from sequential-data with multiple item attributes. Using a large-scale watchlist dataset from eBay, we evaluate our proposed model, where we demonstrate its superiority compared to multiple state-of-the-art baselines, many of which are adapted for this task.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 18 Oct 2021.
Builds on
19 of 33 references.
References · 19
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Layer Normalizationcited by 5,669
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2019Behavior Sequence Transformer for E-commerce Recommendation in Alibabacited by 130
- 2019Sequential Recommender Systems: Challenges, Progress and Prospectscited by 115
7 more
- 2016Improved Recurrent Neural Networks for Session-based Recommendationscited by 86
- 2017Translation-based Recommendationcited by 71
- 2017ATRank: An Attention-Based User Behavior Modeling Framework for Recommendationcited by 45
- 2020Sequential Recommendation with Self-Attentive Multi-Adversarial Networkcited by 26
- 2019Sequence-Aware Factorization Machines for Temporal Predictive Analyticscited by 17
- 2017Contextual Sequence Modeling for Recommendation with Recurrent Neural Networkscited by 11
- 2021PreSizE: Predicting Size in E-Commerce using Transformerscited by 5
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 1; 2025: 3.
7 papers.
- 2025Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendationcited by 51
- 2024LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendationcited by 47
- 2023Diffusion Augmentation for Sequential Recommendationcited by 38
- 2023A Survey on User Behavior Modeling in Recommender Systemscited by 26
- 2025X-Cross: Dynamic Integration of Language Models for Cross-Domain Sequential Recommendationcited by 2
- 2022Human Pose Driven Object Effects Recommendationcited by 1
- 2025BiCoRec: Bias-Mitigated Context-Aware Sequential Recommendation Modelcited by 0
- 2025BiCoRec: Bias-Mitigated Context-Aware Sequential Recommendation Model15 Dec 2025
- 2025X-Cross: Dynamic Integration of Language Models for Cross-Domain Sequential Recommendation29 Apr 2025
- 2025Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation28 Mar 2025
- 2024LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation31 May 2024
- 2023Diffusion Augmentation for Sequential Recommendation22 Sep 2023
- 2023A Survey on User Behavior Modeling in Recommender Systems22 Feb 2023
- 2022Human Pose Driven Object Effects Recommendation17 Sep 2022