# Double Correction Framework for Denoising Recommendation

arXiv: https://arxiv.org/abs/2405.11272 · HTML: https://mlsanity.com/paper/2405.11272/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 51 references that are in the map.
- First posted on arXiv 18 May 2024.

## Builds on (most cited first, 25 of 25)

- [LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation](https://mlsanity.com/paper/2002.02126/) (2020)
- [Neural Collaborative Filtering](https://mlsanity.com/paper/1708.05031/) (2017)
- [Neural Graph Collaborative Filtering](https://mlsanity.com/paper/1905.08108/) (2019)
- [Training Region-based Object Detectors with Online Hard Example Mining](https://mlsanity.com/paper/1604.03540/) (2016)
- [Denoising Implicit Feedback for Recommendation](https://mlsanity.com/paper/2006.04153/) (2020)
- [A Neural Influence Diffusion Model for Social Recommendation](https://mlsanity.com/paper/1904.10322/) (2019)
- [Modeling User Exposure in Recommendation](https://mlsanity.com/paper/1510.07025/) (2015)
- [A Loss Curvature Perspective on Training Instability in Deep Learning](https://mlsanity.com/paper/2110.04369/) (2021)
- [Simplify and Robustify Negative Sampling for Implicit Collaborative Filtering](https://mlsanity.com/paper/2009.03376/) (2020)
- [PU Learning for Matrix Completion](https://mlsanity.com/paper/1411.6081/) (2014)
- [LightFR: Lightweight Federated Recommendation with Privacy-preserving Matrix Factorization](https://mlsanity.com/paper/2206.11743/) (2022)
- [Self-Guided Learning to Denoise for Robust Recommendation](https://mlsanity.com/paper/2204.06832/) (2022)
- [AutoDenoise: Automatic Data Instance Denoising for Recommendations](https://mlsanity.com/paper/2303.06611/) (2023)
- [M2GRL: A Multi-task Multi-view Graph Representation Learning Framework for Web-scale Recommender Systems](https://mlsanity.com/paper/2005.10110/) (2020)
- [Efficient Bi-Level Optimization for Recommendation Denoising](https://mlsanity.com/paper/2210.10321/) (2022)
- [Denoising Self-attentive Sequential Recommendation](https://mlsanity.com/paper/2212.04120/) (2022)
- [On the Theories Behind Hard Negative Sampling for Recommendation](https://mlsanity.com/paper/2302.03472/) (2023)
- [Learning Robust Recommenders through Cross-Model Agreement](https://mlsanity.com/paper/2105.09605/) (2021)
- [Sampler Design for Bayesian Personalized Ranking by Leveraging View Data](https://mlsanity.com/paper/1809.08162/) (2018)
- [Neighborhood-Enhanced Supervised Contrastive Learning for Collaborative Filtering](https://mlsanity.com/paper/2402.11523/) (2024)
- [Knowledge-refined Denoising Network for Robust Recommendation](https://mlsanity.com/paper/2304.14987/) (2023)
- [Denoised Self-Augmented Learning for Social Recommendation](https://mlsanity.com/paper/2305.12685/) (2023)
- [Intersectional Two-sided Fairness in Recommendation](https://mlsanity.com/paper/2402.02816/) (2024)
- [Improving Implicit Feedback-Based Recommendation through Multi-Behavior Alignment](https://mlsanity.com/paper/2305.05585/) (2023)
- [Collaborative-Enhanced Prediction of Spending on Newly Downloaded Mobile Games under Consumption Uncertainty](https://mlsanity.com/paper/2404.08301/) (2024)

## Built on by (most cited first, 19 of 19)

- [Topology-aware Reinforcement Feature Space Reconstruction for Graph Data](https://mlsanity.com/paper/2411.05742/) (2024)
- [Popularity-Aware Alignment and Contrast for Mitigating Popularity Bias](https://mlsanity.com/paper/2405.20718/) (2024)
- [Teaching Time Series to See and Speak: Forecasting with Aligned Visual and Textual Perspectives](https://mlsanity.com/paper/2506.24124/) (2025)
- [LLM-ML Teaming: Integrated Symbolic Decoding and Gradient Search for Valid and Stable Generative Feature Transformation](https://mlsanity.com/paper/2506.09085/) (2025)
- [Bridging the Domain Gap in Equation Distillation with Reinforcement Feedback](https://mlsanity.com/paper/2505.15572/) (2025)
- [Large Language Model Enhanced Hard Sample Identification for Denoising Recommendation](https://mlsanity.com/paper/2409.10343/) (2024)
- [PageLLM: A Multi-Grained Reward Framework for Whole-Page Optimization with Large Language Models](https://mlsanity.com/paper/2506.09084/) (2025)
- [Adaptive Long-term Embedding with Denoising and Augmentation for Recommendation](https://mlsanity.com/paper/2504.13614/) (2025)
- [RMBRec: Robust Multi-Behavior Recommendation towards Target Behaviors](https://mlsanity.com/paper/2601.08705/) (2026)
- [When SparseMoE Meets Noisy Interactions: An Ensemble View on Denoising Recommendation](https://mlsanity.com/paper/2409.12730/) (2024)
- [From Entity Reliability to Clean Feedback: An Entity-Aware Denoising Framework Beyond Interaction-Level Signals](https://mlsanity.com/paper/2508.10851/) (2025)
- [Empowering Denoising Sequential Recommendation with Large Language Model Embeddings](https://mlsanity.com/paper/2510.04239/) (2025)
- [Hard vs. Noise: Resolving Hard-Noisy Sample Confusion in Recommender Systems via Large Language Models](https://mlsanity.com/paper/2511.07295/) (2025)
- [Diversity Recommendation via Causal Deconfounding of Co-purchase Relations and Counterfactual Exposure](https://mlsanity.com/paper/2512.17733/) (2025)
- [Efficient Content-based Recommendation Model Training via Noise-aware Coreset Selection](https://mlsanity.com/paper/2601.10067/) (2026)
- [TFPS: A Temporal Filtration-enhanced Positive Sample Set Construction Method for Implicit Collaborative Filtering](https://mlsanity.com/paper/2602.22521/) (2026)
- [Learning Robust Recommenders from Noisy Implicit Feedback via GMM-Weighted Bayesian Transition Matrix](https://mlsanity.com/paper/2605.20721/) (2026)
- [ANCHOR: Agentic Noise Creation Framework for Human Simulation and Denoising Recommendation](https://mlsanity.com/paper/2606.05621/) (2026)
- [Denoising Implicit Feedback for Cold-start Recommendation](https://mlsanity.com/paper/2606.19658/) (2026)

## Abstract (arXiv)

As its availability and generality in online services, implicit feedback is more commonly used in recommender systems. However, implicit feedback usually presents noisy samples in real-world recommendation scenarios (such as misclicks or non-preferential behaviors), which will affect precise user preference learning. To overcome the noisy samples problem, a popular solution is based on dropping noisy samples in the model training phase, which follows the observation that noisy samples have higher training losses than clean samples. Despite the effectiveness, we argue that this solution still has limits. (1) High training losses can result from model optimization instability or hard samples, not just noisy samples. (2) Completely dropping of noisy samples will aggravate the data sparsity, which lacks full data exploitation. To tackle the above limitations, we propose a Double Correction Framework for Denoising Recommendation (DCF), which contains two correction components from views of more precise sample dropping and avoiding more sparse data. In the sample dropping correction component, we use the loss value of the samples over time to determine whether it is noise or not, increasing dropping stability. Instead of averaging directly, we use the damping function to reduce the bias effect of outliers. Furthermore, due to the higher variance exhibited by hard samples, we derive a lower bound for the loss through concentration inequality to identify and reuse hard samples. In progressive label correction, we iteratively re-label highly deterministic noisy samples and retrain them to further improve performance. Finally, extensive experimental results on three datasets and four backbones demonstrate the effectiveness and generalization of our proposed framework.
