mlsanityData to 7 Oct 2026

Multi-Behavior Sequential Modeling with Transition-Aware Graph Attention Network for E-Commerce Recommendation

arXiv 2601.14955 ↗First posted 21 Jan 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

User interactions on e-commerce platforms are inherently diverse, involving behaviors such as clicking, favoriting, adding to cart, and purchasing. The transitions between these behaviors offer valuable insights into user-item interactions, serving as a key signal for understanding evolving preferences. Consequently, there is growing interest in leveraging multi-behavior data to better capture user intent. Recent studies have explored sequential modeling of multi-behavior data, many relying on transformer-based architectures with polynomial time complexity. While effective, these approaches often incur high computational costs, limiting their applicability in large-scale industrial systems with long user sequences. To address this challenge, we propose the Transition-Aware Graph Attention Network (TGA), a linear-complexity approach for modeling multi-behavior transitions. Unlike traditional transformers that treat all behavior pairs equally, TGA constructs a structured sparse graph by identifying informative transitions from three perspectives: (a) item-level transitions, (b) category-level transitions, and (c) neighbor-level transitions. Built upon the structured graph, TGA employs a transition-aware graph Attention mechanism that jointly models user-item interactions and behavior transition types, enabling more accurate capture of sequential patterns while maintaining computational efficiency. Experiments show that TGA outperforms all state-of-the-art models while significantly reducing computational cost. Notably, TGA has been deployed in a large-scale industrial production environment, where it leads to impressive improvements in key business metrics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

15 of 22 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Graph Attention Networkscited by 8,854
  3. 2020Longformer: The Long-Document Transformercited by 3,362
  4. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  5. 2020Reformer: The Efficient Transformercited by 1,658
  6. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  7. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  8. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  9. 2022Multi-Behavior Hypergraph-Enhanced Transformer for Sequential Recommendationcited by 42
  10. 2023TWIN: TWo-stage Interest Network for Lifelong User Behavior Modeling in CTR Prediction at Kuaishoucited by 40
  11. 2018Learning from History and Present: Next-item Recommendation via Discriminatively Exploiting User Behaviorscited by 27
  12. 2020Beyond Clicks: Modeling Multi-Relational Item Graph for Session-Based Target Behavior Predictioncited by 21
3 more
  1. 2024END4Rec: Efficient Noise-Decoupling for Multi-Behavior Sequential Recommendationcited by 19
  2. 2024Personalized Behavior-Aware Transformer for Multi-Behavior Sequential Recommendationcited by 15
  3. 2023Dynamic Multi-Behavior Sequence Modeling for Next Item Recommendationcited by 4

Built on by

Not cited yet.