mlsanityData to 7 Oct 2026

Lightweight yet Efficient: An External Attentive Graph Convolutional Network with Positional Prompts for Sequential Recommendation

arXiv 2502.15331 ↗First posted 21 Feb 2025cs.IR cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph-based Sequential Recommender systems (GSRs) have gained significant research attention due to their ability to simultaneously handle user-item interactions and sequential relationships between items. Current GSRs often utilize composite or in-depth structures for graph encoding (e.g., the Graph Transformer). Nevertheless, they have high computational complexity, hindering the deployment on resource-constrained edge devices. Moreover, the relative position encoding in Graph Transformer has difficulty in considering the complicated positional dependencies within sequence. To this end, we propose an External Attentive Graph convolutional network with Positional prompts for Sequential recommendation, namely EA-GPS. Specifically, we first introduce an external attentive graph convolutional network that linearly measures the global associations among nodes via two external memory units. Then, we present a positional prompt-based decoder that explicitly treats the absolute item positions as external prompts. By introducing length-adaptive sequential masking and a soft attention network, such a decoder facilitates the model to capture the long-term positional dependencies and contextual relationships within sequences. Extensive experimental results on five real-world datasets demonstrate that the proposed EA-GPS outperforms the state-of-the-art methods. Remarkably, it achieves the superior performance while maintaining a smaller parameter size and lower training overhead. The implementation of this work is publicly available at https://github.com/ZZY-GraphMiningLab/EA-GPS.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 61 references that are in the map. First posted on arXiv 21 Feb 2025.

Builds on

37 of 61 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  5. 2018Self-Attentive Sequential Recommendationcited by 1,169
  6. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  7. 2018Self-Attention with Relative Position Representationscited by 1,112
  8. 2017Neural Collaborative Filteringcited by 1,108
  9. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  10. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  11. 2019Neural Graph Collaborative Filteringcited by 660
  12. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
25 more
  1. 2020Self-supervised Graph Learning for Recommendationcited by 305
  2. 2021Rethinking and Improving Relative Position Encoding for Vision Transformercited by 206
  3. 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
  4. 2021Sequential Recommendation with Graph Neural Networkscited by 89
  5. 2017Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networkscited by 84
  6. 2020Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendationcited by 75
  7. 2018NAIS: Neural Attentive Item Similarity Model for Recommendationcited by 52
  8. 2021From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformerscited by 38
  9. 2023Debiased Contrastive Learning for Sequential Recommendationcited by 38
  10. 2023Graph Transformer for Recommendationcited by 28
  11. 2023AutoMLP: Automated MLP for Sequential Recommendationscited by 25
  12. 2023Prompt Learning for News Recommendationcited by 25
  13. 2021Lightweight Self-Attentive Sequential Recommendationcited by 22
  14. 2022Multi-Behavior Sequential Recommendation with Temporal Graph Transformercited by 20
  15. 2023Denoising and Prompt-Tuning for Multi-Behavior Recommendationcited by 18
  16. 2021RetaGNN: Relational Temporal Attentive Graph Neural Networks for Holistic Sequential Recommendationcited by 15
  17. 2021Position-enhanced and Time-aware Graph Convolutional Network for Sequential Recommendationscited by 7
  18. 2022Time Interval-enhanced Graph Neural Network for Shared-account Cross-domain Sequential Recommendationcited by 6
  19. 2023Timestamps as Prompts for Geography-Aware Location Recommendationcited by 6
  20. 2024Dual Contrastive Transformer for Hierarchical Preference Modeling in Sequential Recommendationcited by 6
  21. 2023Contrastive Enhanced Slide Filter Mixer for Sequential Recommendationcited by 4
  22. 2023Enhancing Transformers without Self-supervised Learning: A Loss Landscape Perspective in Sequential Recommendationcited by 3
  23. 2023A Lightweight Method for Modeling Confidence in Recommendations with Learned Beta Distributionscited by 2
  24. 2024Prompt-based Multi-interest Learning Method for Sequential Recommendationcited by 2
  25. 2022Beyond Double Ascent via Recurrent Neural Tangent Kernel in Sequential Recommendationcited by 1

Built on by

Not cited yet.