mlsanityData to 7 Oct 2026

Efficient Content-based Recommendation Model Training via Noise-aware Coreset Selection

arXiv 2601.10067 ↗First posted 15 Jan 2026cs.LG cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Content-based recommendation systems (CRSs) utilize content features to predict user-item interactions, serving as essential tools for helping users navigate information-rich web services. However, ensuring the effectiveness of CRSs requires large-scale and even continuous model training to accommodate diverse user preferences, resulting in significant computational costs and resource demands. A promising approach to this challenge is coreset selection, which identifies a small but representative subset of data samples that preserves model quality while reducing training overhead. Yet, the selected coreset is vulnerable to the pervasive noise in user-item interactions, particularly when it is minimally sized. To this end, we propose Noise-aware Coreset Selection (NaCS), a specialized framework for CRSs. NaCS constructs coresets through submodular optimization based on training gradients, while simultaneously correcting noisy labels using a progressively trained model. Meanwhile, we refine the selected coreset by filtering out low-confidence samples through uncertainty quantification, thereby avoid training with unreliable interactions. Through extensive experiments, we show that NaCS produces higher-quality coresets for CRSs while achieving better efficiency than existing coreset selection techniques. Notably, NaCS recovers 93-95% of full-dataset training performance using merely 1% of the training data. The source code is available at hrefhttps://github.com/chenxing1999/nacshttps://github.com/chenxing1999/nacs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 84 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

44 of 84 references.

References · 44

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  3. 2016Wide & Deep Learning for Recommender Systemscited by 745
  4. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
  5. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 669
  6. 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 529
  7. 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 337
  8. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  9. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 326
  10. 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 323
  11. 2020GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learningcited by 224
  12. 2020Coresets via Bilevel Optimization for Continual Learning and Streamingcited by 191
32 more
  1. 2022DeepCore: A Comprehensive Library for Coreset Selection in Deep Learningcited by 146
  2. 2024Data-efficient Fine-tuning for LLM-based Recommendationcited by 103
  3. 2014Lazier Than Lazy Greedycited by 97
  4. 2020Denoising Implicit Feedback for Recommendationcited by 80
  5. 2021RETRIEVE: Coreset Selection for Efficient and Robust Semi-Supervised Learningcited by 72
  6. 2022BARS: Towards Open Benchmarking for Recommender Systemscited by 54
  7. 2020Clicks can be Cheating: Counterfactual Recommendation for Mitigating Clickbait Issuecited by 48
  8. 2023Towards Sustainable Learning: Coresets for Data-efficient Deep Learningcited by 44
  9. 2019Semantic Redundancies in Image-Classification Datasets: The 10% You Don't Needcited by 43
  10. 2023FinalMLP: An Enhanced Two-Stream MLP Model for CTR Predictioncited by 37
  11. 2020ProSelfLC: Progressive Self Label Correction for Training Robust Deep Neural Networkscited by 33
  12. 2022On-Device Next-Item Recommendation with Self-Supervised Knowledge Distillationcited by 21
  13. 2022Infinite Recommendation Networks: A Data-Centric Approachcited by 20
  14. 2024Double Correction Framework for Denoising Recommendationcited by 19
  15. 2024Mini-batch Coresets for Memory-efficient Language Model Training on Data Mixturescited by 12
  16. 2022BagPipe: Accelerating Deep Recommendation Model Trainingcited by 10
  17. 2025HMamba: Hyperbolic Mamba for Sequential Recommendationcited by 10
  18. 2023Continuous Input Embedding Size Search For Recommender Systemscited by 7
  19. 2023Budgeted Embedding Table For Recommender Systemscited by 6
  20. 2024D2K: Turning Historical Data into Retrievable Knowledge for Recommender Systemscited by 6
  21. 2022ProSelfLC: Progressive Self Label Correction Towards A Low-Temperature Entropy Statecited by 5
  22. 2024Lightweight Embeddings for Graph Collaborative Filteringcited by 5
  23. 2024A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systemscited by 4
  24. 2022Boosting Factorization Machines via Saliency-Guided Mixupcited by 3
  25. 2024Sparser Training for On-Device Recommendation Systemscited by 3
  26. 2025Shapley Value-driven Data Pruning for Recommender Systemscited by 3
  27. 2023Learning Compact Compositional Embeddings via Regularized Pruning for Recommendationcited by 2
  28. 2024On-device Content-based Recommendation with Single-shot Embedding Pruning: A Cooperative Game Perspectivecited by 2
  29. 2024Legommenders: A Comprehensive Content-Based Recommendation Library with LLM Supportcited by 2
  30. 2025Efficient Multimodal Streaming Recommendation via Expandable Side Mixture-of-Expertscited by 2
  31. 2025Lightweight Embeddings with Graph Rewiring for Collaborative Filteringcited by 1
  32. 2025Relational Database Distillation: From Structured Tables to Condensed Graph Datacited by 1

Built on by

Not cited yet.