Efficient Dataset Selection for Continual Adaptation of Generative Recommenders
Not on the map. Why?
Abstract (arXiv)
Recommendation systems must continuously adapt to evolving user behavior, yet the volume of data generated in large-scale streaming environments makes frequent full retraining impractical. This work investigates how targeted data selection can mitigate performance degradation caused by temporal distributional drift while maintaining scalability. We evaluate a range of representation choices and sampling strategies for curating small but informative subsets of user interaction data. Our results demonstrate that gradient-based representations, coupled with distribution-matching, improve downstream model performance, achieving training efficiency gains while preserving robustness to drift. These findings highlight data curation as a practical mechanism for scalable monitoring and adaptive model updates in production-scale recommendation systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 25 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
20 of 25 references.
References · 20
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 565
- 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 514
- 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 381
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
- 2023Data Selection for Language Models via Importance Resamplingcited by 322
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 184
- 2024MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Modelscited by 96
- 2022Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Timecited by 85
- 2022PinnerFormer: Sequence Modeling for User Representation at Pinterestcited by 57
8 more
- 2024Capturing the Temporal Dependence of Training Data Influencecited by 34
- 2024Multi-Behavior Generative Recommendationcited by 15
- 2025PinRec: Unified Generative Retrieval for Pinterest Recommender Systemscited by 8
- 2025When to retrain a machine learning modelcited by 8
- 2025DV365: Extremely Long User History Modeling at Instagramcited by 8
- 2024Efficient user history modeling with amortized inference for deep learning recommendation modelscited by 5
- 2025DATE-LM: Benchmarking Data Attribution Evaluation for Large Language Modelscited by 5
- 2024Sliding Window Training -- Utilizing Historical Recommender Systems Data for Foundation Modelscited by 3
Built on by
Not cited yet.