mlsanityData to 14 Oct 2026

Exploiting Session Information in BERT-based Session-aware Sequential Recommendation

arXiv 2204.10851 ↗First posted 22 Apr 2022cs.IR cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

In recommendation systems, utilizing the user interaction history as sequential information has resulted in great performance improvement. However, in many online services, user interactions are commonly grouped by sessions that presumably share preferences, which requires a different approach from ordinary sequence representation techniques. To this end, sequence representation models with a hierarchical structure or various viewpoints have been developed but with a rather complex network structure. In this paper, we propose three methods to improve recommendation performance by exploiting session information while minimizing additional parameters in a BERT-based sequential recommendation model: using session tokens, adding session segment embeddings, and a time-aware self-attention. We demonstrate the feasibility of the proposed methods through experiments on widely used recommendation datasets.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 38 of its 65 references that are in the map. First posted on arXiv 22 Apr 2022.

Builds on

38 of 65 references.

References · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  5. 2017Decoupled Weight Decay Regularizationcited by 1,831
  6. 2018Self-Attentive Sequential Recommendationcited by 1,184
  7. 2017Neural Collaborative Filteringcited by 1,111
  8. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  9. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
  10. 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 432
  11. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  12. 2017Neural Attentive Session-based Recommendationcited by 237
26 more
  1. 2019Hierarchical Gating Networks for Sequential Recommendationcited by 101
  2. 2020Controllable Multi-Interest Framework for Recommendationcited by 93
  3. 2022Intent Contrastive Learning for Sequential Recommendationcited by 91
  4. 2017Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networkscited by 84
  5. 2021Continuous-Time Sequential Recommendation with Temporal Graph Collaborative Transformercited by 69
  6. 2018Sequence-Aware Recommender Systemscited by 58
  7. 2021Dynamic Graph Neural Networks for Sequential Recommendationcited by 57
  8. 2019Self-attention with Functional Time Representation Learningcited by 52
  9. 2018RepeatNet: A Repeat Aware Neural Recommendation Machine for Session-based Recommendationcited by 51
  10. 2022Sequential Recommendation via Stochastic Self-Attentioncited by 37
  11. 2020Sequential Recommendation with Self-Attentive Multi-Adversarial Networkcited by 26
  12. 2021Lightweight Self-Attentive Sequential Recommendationcited by 22
  13. 2020MEANTIME: Mixture of Attention Mechanisms with Multi-temporal Embeddings for Sequential Recommendationcited by 17
  14. 2019Towards Neural Mixture Recommender for Long Range Dependent User Sequencescited by 15
  15. 2020Session-aware Recommendation: A Surprising Quest for the State-of-the-artcited by 15
  16. 2019Personalized Graph Neural Networks with Attention Mechanism for Session-Aware Recommendationcited by 10
  17. 2017Session-aware Information Embedding for E-commerce Product Recommendationcited by 9
  18. 2022Multi-head Temporal Attention-Augmented Bilinear Network for Financial time series predictioncited by 8
  19. 2021Unsupervised Proxy Selection for Session-based Recommender Systemscited by 7
  20. 2021Exploiting Positional Information for Session-based Recommendationcited by 6
  21. 2021Rethinking Lifelong Sequential Recommendation with Incremental Multi-Interest Attentioncited by 5
  22. 2021Temporal Attention Augmented Transformer Hawkes Processcited by 5
  23. 2019Regularized Adversarial Sampling and Deep Time-aware Attention for Click-Through Rate Predictioncited by 4
  24. 2019Balancing Multi-level Interactions for Session-based Recommendationcited by 3
  25. 2020Modeling Long-Term and Short-Term Interests with Parallel Attentions for Session-based Recommendationcited by 2
  26. 2020Modeling Online Behavior in Recommender Systems: The Importance of Temporal Contextcited by 2

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 1; 2024: 0; 2025: 1.

4 papers.

  1. 2022Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendationcited by 16
  2. 2023Proxy-based Item Representation for Attribute and Context-aware Recommendationcited by 2
  3. 2025Not Just What, But When: Integrating Irregular Intervals to LLM for Sequential Recommendationcited by 2
  4. 2022BERT4Loc: BERT for Location -- POI Recommender Systemcited by 1