Multi-Behavior Sequential Modeling with Transition-Aware Graph Attention Network for E-Commerce Recommendation
Not on the map. Why?
Abstract (arXiv)
User interactions on e-commerce platforms are inherently diverse, involving behaviors such as clicking, favoriting, adding to cart, and purchasing. The transitions between these behaviors offer valuable insights into user-item interactions, serving as a key signal for understanding evolving preferences. Consequently, there is growing interest in leveraging multi-behavior data to better capture user intent. Recent studies have explored sequential modeling of multi-behavior data, many relying on transformer-based architectures with polynomial time complexity. While effective, these approaches often incur high computational costs, limiting their applicability in large-scale industrial systems with long user sequences. To address this challenge, we propose the Transition-Aware Graph Attention Network (TGA), a linear-complexity approach for modeling multi-behavior transitions. Unlike traditional transformers that treat all behavior pairs equally, TGA constructs a structured sparse graph by identifying informative transitions from three perspectives: (a) item-level transitions, (b) category-level transitions, and (c) neighbor-level transitions. Built upon the structured graph, TGA employs a transition-aware graph Attention mechanism that jointly models user-item interactions and behavior transition types, enabling more accurate capture of sequential patterns while maintaining computational efficiency. Experiments show that TGA outperforms all state-of-the-art models while significantly reducing computational cost. Notably, TGA has been deployed in a large-scale industrial production environment, where it leads to impressive improvements in key business metrics.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
15 of 22 references.
References · 15
- 2017Attention Is All You Needcited by 59,932
- 2017Graph Attention Networkscited by 8,854
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2020Reformer: The Efficient Transformercited by 1,658
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2018Session-based Recommendation with Graph Neural Networkscited by 312
- 2022Multi-Behavior Hypergraph-Enhanced Transformer for Sequential Recommendationcited by 42
- 2023TWIN: TWo-stage Interest Network for Lifelong User Behavior Modeling in CTR Prediction at Kuaishoucited by 40
- 2018Learning from History and Present: Next-item Recommendation via Discriminatively Exploiting User Behaviorscited by 27
- 2020Beyond Clicks: Modeling Multi-Relational Item Graph for Session-Based Target Behavior Predictioncited by 21
Built on by
Not cited yet.