TTT4Rec: A Test-Time Training Approach for Rapid Adaption in Sequential Recommendation
Not on the map. Why?
Abstract (arXiv)
Sequential recommendation tasks, which aim to predict the next item a user will interact with, typically rely on models trained solely on historical data. However, in real-world scenarios, user behavior can fluctuate in the long interaction sequences, and training data may be limited to model this dynamics. To address this, Test-Time Training (TTT) offers a novel approach by using self-supervised learning during inference to dynamically update model parameters. This allows the model to adapt to new user interactions in real-time, leading to more accurate recommendations. In this paper, we propose TTT4Rec, a sequential recommendation framework that integrates TTT to better capture dynamic user behavior. By continuously updating model parameters during inference, TTT4Rec is particularly effective in scenarios where user interaction sequences are long, training data is limited, or user behavior is highly variable. We evaluate TTT4Rec on three widely-used recommendation datasets, demonstrating that it achieves performance on par with or exceeding state-of-the-art models. The codes are available at https://github.com/ZhaoqiZachYang/TTT4Rec.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 16 references that are in the map. First posted on arXiv 27 Sep 2024.
Builds on
12 of 16 references.
References · 12
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2015Image-based Recommendations on Styles and Substitutescited by 702
- 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 696
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2017Neural Attentive Session-based Recommendationcited by 237
- 2016Improved Recurrent Neural Networks for Session-based Recommendationscited by 86
- 2021NormFormer: Improved Transformer Pretraining with Extra Normalizationcited by 83
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.