Breaker: Removing Shortcut Cues with User Clustering for Single-slot Recommendation System
Not on the map. Why?
Abstract (arXiv)
In a single-slot recommendation system, users are only exposed to one item at a time, and the system cannot collect user feedback on multiple items simultaneously. Therefore, only pointwise modeling solutions can be adopted, focusing solely on modeling the likelihood of clicks or conversions for items by users to learn user-item preferences, without the ability to capture the ranking information among different items directly. However, since user-side information is often much more abundant than item-side information, the model can quickly learn the differences in user intrinsic tendencies, which are independent of the items they are exposed to. This can cause these intrinsic tendencies to become a shortcut bias for the model, leading to insufficient mining of the most concerned user-item preferences. To solve this challenge, we introduce the Breaker model. Breaker integrates an auxiliary task of user representation clustering with a multi-tower structure for cluster-specific preference modeling. By clustering user representations, we ensure that users within each cluster exhibit similar characteristics, which increases the complexity of the pointwise recommendation task on the user side. This forces the multi-tower structure with cluster-driven parameter learning to better model user-item preferences, ultimately eliminating shortcut biases related to user intrinsic tendencies. In terms of training, we propose a delayed parameter update mechanism to enhance training stability and convergence, enabling end-to-end joint training of the auxiliary clustering and classification tasks. Both offline and online experiments demonstrate that our method surpasses the baselines. It has already been deployed and is actively serving tens of millions of users daily on Meituan, one of the most popular e-commerce platforms for services.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 1 Jun 2025.
Builds on
26 of 37 references.
References · 26
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2017Neural Collaborative Filteringcited by 1,111
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2017Deep Interest Network for Click-Through Rate Predictioncited by 544
- 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
- 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
- 2018xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systemscited by 278
- 2020Bias and Debias in Recommender System: A Survey and Future Directionscited by 240
- 2020No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problemscited by 209
- 2017Deep Learning based Recommender System: A Survey and New Perspectivescited by 136
- 2019FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Predictioncited by 83
14 more
- 2021Which Shortcut Cues Will DNNs Choose? A Study from the Parameter-Space Perspectivecited by 57
- 2022XCon: Learning with Experts for Fine-grained Category Discoverycited by 50
- 2021MaskNet: Introducing Feature-Wise Multiplication to CTR Ranking Models by Instance-Guided Maskcited by 48
- 2017Uplift Modeling with Multiple Treatments and General Response Typescited by 41
- 2021Modeling the Sequential Dependence among Audience Multi-step Conversions with Multi-task Learning in Targeted Display Advertisingcited by 39
- 2020An Embedding Learning Framework for Numerical Features in CTR Predictioncited by 37
- 2022TwHIN: Embedding the Twitter Heterogeneous Information Network for Personalized Recommendationcited by 25
- 2022Enhancing CTR Prediction with Context-Aware Feature Representation Learningcited by 17
- 2021Sliding Spectrum Decomposition for Diversified Recommendationcited by 15
- 2022Equivariance and Invariance Inductive Bias for Learning from Insufficient Datacited by 14
- 2020Spending Money Wisely: Online Electronic Coupon Allocation based on Real-Time User Intent Detectioncited by 13
- 2023Disentangled Causal Embedding With Contrastive Learning For Recommender Systemcited by 10
- 2021XCrossNet: Feature Structure-Oriented Learning for Click-Through Rate Predictioncited by 6
- 2022Reweighting Clicks with Dwell Time in Recommendationcited by 6
Built on by
Not cited yet.