mlsanityData to 14 Oct 2026

MEGG: Replay via Maximally Extreme GGscore in Incremental Learning for Neural Recommendation Models

arXiv 2509.07319 ↗First posted 9 Sep 2025cs.IR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural Collaborative Filtering models are widely used in recommender systems but are typically trained under static settings, assuming fixed data distributions. This limits their applicability in dynamic environments where user preferences evolve. Incremental learning offers a promising solution, yet conventional methods from computer vision or NLP face challenges in recommendation tasks due to data sparsity and distinct task paradigms. Existing approaches for neural recommenders remain limited and often lack generalizability. To address this, we propose MEGG, Replay Samples with Maximally Extreme GGscore, an experience replay based incremental learning framework. MEGG introduces GGscore, a novel metric that quantifies sample influence, enabling the selective replay of highly influential samples to mitigate catastrophic forgetting. Being model-agnostic, MEGG integrates seamlessly across architectures and frameworks. Experiments on three neural models and four benchmark datasets show superior performance over state-of-the-art baselines, with strong scalability, efficiency, and robustness. Implementation will be released publicly upon acceptance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 79 references that are in the map. First posted on arXiv 9 Sep 2025.

Builds on

41 of 79 references.

References · 41

  1. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  2. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  3. 2020Knowledge Distillation: A Surveycited by 1,603
  4. 2017Continual Learning with Deep Generative Replaycited by 1,158
  5. 2017Neural Collaborative Filteringcited by 1,111
  6. 2016Wide & Deep Learning for Recommender Systemscited by 747
  7. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
  8. 2019Three scenarios for continual learningcited by 614
  9. 2018End-to-End Incremental Learningcited by 597
  10. 2017Deep Interest Network for Click-Through Rate Predictioncited by 544
  11. 2017Deep & Cross Network for Ad Click Predictionscited by 393
  12. 2019Online Continual Learning with Maximally Interfered Retrievalcited by 379
29 more
  1. 2017Measuring Catastrophic Forgetting in Neural Networkscited by 360
  2. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  3. 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 309
  4. 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
  5. 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
  6. 2017Incremental Learning of Object Detectors without Catastrophic Forgettingcited by 208
  7. 2023Data-centric Artificial Intelligence: A Surveycited by 203
  8. 2017Neural Factorization Machines for Sparse Predictive Analyticscited by 183
  9. 2021Towards Continual Knowledge Learning of Language Modelscited by 174
  10. 2020Continual Lifelong Learning in Natural Language Processing: A Surveycited by 152
  11. 2022Dataset Pruning: Reducing Training Data by Examining Generalization Influencecited by 133
  12. 2019A continual learning survey: Defying forgetting in classification taskscited by 118
  13. 2020A Comprehensive Study of Class Incremental Learning Algorithms for Visual Taskscited by 107
  14. 2023LLM-Rec: Personalized Recommendation via Prompting Large Language Modelscited by 77
  15. 2019Data Cleansing for Models Trained with SGDcited by 67
  16. 2021Recent Advances of Continual Learning in Computer Vision: An Overviewcited by 55
  17. 2020How to Retrain Recommender System? A Sequential Meta-Learning Methodcited by 42
  18. 2020GraphSAIL: Graph Structure Aware Incremental Learning for Recommender Systemscited by 42
  19. 2021Interpretable Data-Based Explanations for Fairness Debuggingcited by 30
  20. 2023Selective and Collaborative Influence Function for Efficient Recommendation Unlearningcited by 26
  21. 2020ADER: Adaptively Distilled Exemplar Replay Towards Continual Learning for Session-based Recommendationcited by 22
  22. 2018Revisiting Distillation and Incremental Classifier Learningcited by 19
  23. 2024ERAGent: Enhancing Retrieval-Augmented Language Models with Improved Accuracy, Efficiency, and Personalizationcited by 15
  24. 2021Causal Incremental Graph Convolution for Recommender System Retrainingcited by 14
  25. 2020A Practical Incremental Method to Train Deep CTR Modelscited by 10
  26. 2022An Incremental Learning framework for Large-scale CTR Predictioncited by 5
  27. 2024A Learnable Agent Collaboration Network Framework for Personalized Multimodal AI Search Enginecited by 5
  28. 2016Incremental Factorization Machines for Persistently Cold-starting Online Item Recommendationcited by 1
  29. 2021Incremental Learning for Personalized Recommender Systemscited by 1

Built on by

Not cited yet.