Efficient Content-based Recommendation Model Training via Noise-aware Coreset Selection
Not on the map. Why?
Abstract (arXiv)
Content-based recommendation systems (CRSs) utilize content features to predict user-item interactions, serving as essential tools for helping users navigate information-rich web services. However, ensuring the effectiveness of CRSs requires large-scale and even continuous model training to accommodate diverse user preferences, resulting in significant computational costs and resource demands. A promising approach to this challenge is coreset selection, which identifies a small but representative subset of data samples that preserves model quality while reducing training overhead. Yet, the selected coreset is vulnerable to the pervasive noise in user-item interactions, particularly when it is minimally sized. To this end, we propose Noise-aware Coreset Selection (NaCS), a specialized framework for CRSs. NaCS constructs coresets through submodular optimization based on training gradients, while simultaneously correcting noisy labels using a progressively trained model. Meanwhile, we refine the selected coreset by filtering out low-confidence samples through uncertainty quantification, thereby avoid training with unreliable interactions. Through extensive experiments, we show that NaCS produces higher-quality coresets for CRSs while achieving better efficiency than existing coreset selection techniques. Notably, NaCS recovers 93-95% of full-dataset training performance using merely 1% of the training data. The source code is available at hrefhttps://github.com/chenxing1999/nacshttps://github.com/chenxing1999/nacs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 84 references that are in the map. First posted on arXiv 15 Jan 2026.
Builds on
44 of 84 references.
References · 44
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Wide & Deep Learning for Recommender Systemscited by 745
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 669
- 2021Deep Learning on a Data Diet: Finding Important Examples Early in Trainingcited by 529
- 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 337
- 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
- 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 326
- 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 323
- 2020GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learningcited by 224
- 2020Coresets via Bilevel Optimization for Continual Learning and Streamingcited by 191
32 more
- 2022DeepCore: A Comprehensive Library for Coreset Selection in Deep Learningcited by 146
- 2024Data-efficient Fine-tuning for LLM-based Recommendationcited by 103
- 2014Lazier Than Lazy Greedycited by 97
- 2020Denoising Implicit Feedback for Recommendationcited by 80
- 2021RETRIEVE: Coreset Selection for Efficient and Robust Semi-Supervised Learningcited by 72
- 2022BARS: Towards Open Benchmarking for Recommender Systemscited by 54
- 2020Clicks can be Cheating: Counterfactual Recommendation for Mitigating Clickbait Issuecited by 48
- 2023Towards Sustainable Learning: Coresets for Data-efficient Deep Learningcited by 44
- 2019Semantic Redundancies in Image-Classification Datasets: The 10% You Don't Needcited by 43
- 2023FinalMLP: An Enhanced Two-Stream MLP Model for CTR Predictioncited by 37
- 2020ProSelfLC: Progressive Self Label Correction for Training Robust Deep Neural Networkscited by 33
- 2022On-Device Next-Item Recommendation with Self-Supervised Knowledge Distillationcited by 21
- 2022Infinite Recommendation Networks: A Data-Centric Approachcited by 20
- 2024Double Correction Framework for Denoising Recommendationcited by 19
- 2024Mini-batch Coresets for Memory-efficient Language Model Training on Data Mixturescited by 12
- 2022BagPipe: Accelerating Deep Recommendation Model Trainingcited by 10
- 2025HMamba: Hyperbolic Mamba for Sequential Recommendationcited by 10
- 2023Continuous Input Embedding Size Search For Recommender Systemscited by 7
- 2023Budgeted Embedding Table For Recommender Systemscited by 6
- 2024D2K: Turning Historical Data into Retrievable Knowledge for Recommender Systemscited by 6
- 2022ProSelfLC: Progressive Self Label Correction Towards A Low-Temperature Entropy Statecited by 5
- 2024Lightweight Embeddings for Graph Collaborative Filteringcited by 5
- 2024A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systemscited by 4
- 2022Boosting Factorization Machines via Saliency-Guided Mixupcited by 3
- 2024Sparser Training for On-Device Recommendation Systemscited by 3
- 2025Shapley Value-driven Data Pruning for Recommender Systemscited by 3
- 2023Learning Compact Compositional Embeddings via Regularized Pruning for Recommendationcited by 2
- 2024On-device Content-based Recommendation with Single-shot Embedding Pruning: A Cooperative Game Perspectivecited by 2
- 2024Legommenders: A Comprehensive Content-Based Recommendation Library with LLM Supportcited by 2
- 2025Efficient Multimodal Streaming Recommendation via Expandable Side Mixture-of-Expertscited by 2
- 2025Lightweight Embeddings with Graph Rewiring for Collaborative Filteringcited by 1
- 2025Relational Database Distillation: From Structured Tables to Condensed Graph Datacited by 1
Built on by
Not cited yet.