mlsanityData to 14 Oct 2026

Sequential Data Augmentation for Generative Recommendation

arXiv 2509.13648 ↗First posted 17 Sep 2025cs.LG cs.IRcited by 2

Not on the map. Why?

Abstract (arXiv)

Generative recommendation plays a crucial role in personalized systems, predicting users' future interactions from their historical behavior sequences. A critical yet underexplored factor in training these models is data augmentation, the process of constructing training data from user interaction histories. By shaping the training distribution, data augmentation directly and often substantially affects model generalization and performance. Nevertheless, in much of the existing work, this process is simplified, applied inconsistently, or treated as a minor design choice, without a systematic and principled understanding of its effects. Motivated by our empirical finding that different augmentation strategies can yield large performance disparities, we conduct an in-depth analysis of how they reshape training distributions and influence alignment with future targets and generalization to unseen inputs. To systematize this design space, we propose GenPAS, a generalized and principled framework that models augmentation as a stochastic sampling process over input-target pairs with three bias-controlled steps: sequence sampling, target sampling, and input sampling. This formulation unifies widely used strategies as special cases and enables flexible control of the resulting training distribution. Our extensive experiments on benchmark and industrial datasets demonstrate that GenPAS yields superior accuracy, data efficiency, and parameter efficiency compared to existing strategies, providing practical guidance for principled training data construction in generative recommendation. Our code is available at https://github.com/snap-research/GenPAS.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 31 of its 44 references that are in the map. First posted on arXiv 17 Sep 2025.

Builds on

31 of 44 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2023Qwen Technical Reportcited by 3,344
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  6. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  7. 2018Self-Attentive Sequential Recommendationcited by 1,184
  8. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  9. 2015Image-based Recommendations on Styles and Substitutescited by 706
  10. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  11. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
  12. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
19 more
  1. 2023Recommender Systems with Generative Retrievalcited by 198
  2. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
  3. 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
  4. 2023How Can Recommender Systems Benefit from Large Language Models: A Surveycited by 142
  5. 2022Intent Contrastive Learning for Sequential Recommendationcited by 91
  6. 2021Sequential Recommendation with Graph Neural Networkscited by 89
  7. 2021Contrastive Self-supervised Sequential Recommendation with Robust Augmentationcited by 56
  8. 2023Better Generalization with Semantic IDs: A Case Study in Ranking for Recommendationscited by 52
  9. 2017Neural Rating Regression with Abstractive Tips Generation for Recommendationcited by 50
  10. 2021CauseRec: Counterfactual User Sequence Synthesis for Sequential Recommendationcited by 46
  11. 2022RecBole 2.0: Towards a More Up-to-Date Recommendation Librarycited by 39
  12. 2023Language Models As Semantic Indexerscited by 20
  13. 2022AdaMCT: Adaptive Mixture of CNN-Transformer for Sequential Recommendationcited by 11
  14. 2024Enhancing Item Tokenization for Generative Recommendation through Self-Improvementcited by 9
  15. 2025Data Augmentation as Free Lunch: Exploring the Test-Time Augmentation for Sequential Recommendationcited by 9
  16. 2024Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential Recommendationcited by 8
  17. 2025GRAM: Generative Recommendation via Semantic-aware Multi-granular Late Fusioncited by 7
  18. 2025GENIUS: A Generative Framework for Universal Multimodal Searchcited by 5
  19. 2022Data Augmentation Strategies for Improving Sequential Recommender Systemscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.