mlsanityData to 14 Oct 2026

From Past To Path: Masked History Learning for Next-Item Prediction in Generative Recommendation

arXiv 2509.23649 ↗First posted 28 Sep 2025cs.IR cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Generative recommendation, which directly generates item identifiers, has emerged as a promising paradigm for recommendation systems. However, its potential is fundamentally constrained by the reliance on purely autoregressive training. This approach focuses solely on predicting the next item while ignoring the rich internal structure of a user's interaction history, thus failing to grasp the underlying intent. To address this limitation, we propose Masked History Learning (MHL), a novel training framework that shifts the objective from simple next-step prediction to deep comprehension of history. MHL augments the standard autoregressive objective with an auxiliary task of reconstructing masked historical items, compelling the model to understand ``why'' an item path is formed from the user's past behaviors, rather than just ``what'' item comes next. We introduce two key contributions to enhance this framework: (1) an entropy-guided masking policy that intelligently targets the most informative historical items for reconstruction, and (2) a curriculum learning scheduler that progressively transitions from history reconstruction to future prediction. Experiments on three public datasets show that our method significantly outperforms state-of-the-art generative models, highlighting that a comprehensive understanding of the past is crucial for accurately predicting a user's future path.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 45 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

34 of 45 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018Self-Attentive Sequential Recommendationcited by 1,184
  3. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  4. 2015Image-based Recommendations on Styles and Substitutescited by 706
  5. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  6. 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
  7. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
  8. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 463
  9. 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
  10. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  11. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  12. 2022Transformer Memory as a Differentiable Search Indexcited by 247
22 more
  1. 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 242
  2. 2017Neural Attentive Session-based Recommendationcited by 237
  3. 2024Generative Representational Instruction Tuningcited by 233
  4. 2023Recommender Systems with Generative Retrievalcited by 198
  5. 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
  6. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  7. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
  8. 2022A Neural Corpus Indexer for Document Retrievalcited by 111
  9. 2024Learnable Item Tokenization for Generative Recommendationcited by 110
  10. 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
  11. 2019Hierarchical Gating Networks for Sequential Recommendationcited by 101
  12. 2014Collaborative Deep Learning for Recommender Systemscited by 95
  13. 2021Sequential Recommendation with Graph Neural Networkscited by 89
  14. 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
  15. 2023Linear Recurrent Units for Sequential Recommendationcited by 32
  16. 2025Generating Long Semantic IDs in Parallel for Recommendationcited by 30
  17. 2024User Modeling and User Profiling: A Comprehensive Surveycited by 29
  18. 2023A Survey on User Behavior Modeling in Recommender Systemscited by 26
  19. 2024CommonIT: Commonality-Aware Instruction Tuning for Large Language Models via Data Partitionscited by 14
  20. 2023RecJPQ: Training Large-Catalogue Sequential Recommenderscited by 8
  21. 2025Dynamic Sampling that Adapts: Self-Aware Iterative Data Persistent Optimization for Mathematical Reasoningcited by 8
  22. 2024A Survey on Deep Neural Networks in Collaborative Filtering Recommendation Systemscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.