Combining Reward and Rank Signals for Slate Recommendation
Not on the map. Why?
Abstract (arXiv)
We consider the problem of slate recommendation, where the recommender system presents a user with a collection or slate composed of K recommended items at once. If the user finds the recommended items appealing then the user may click and the recommender system receives some feedback. Two pieces of information are available to the recommender system: was the slate clicked? (the reward), and if the slate was clicked, which item was clicked? (rank). In this paper, we formulate several Bayesian models that incorporate the reward signal (Reward model), the rank signal (Rank model), or both (Full model), for non-personalized slate recommendation. In our experiments, we analyze performance gains of the Full model and show that it achieves significantly lower error as the number of products in the catalog grows or as the slate size increases.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 5 of its 17 references that are in the map. First posted on arXiv 26 Jul 2021.
Builds on
5 of 17 references.
References · 5
- 2019Introduction to Multi-Armed Banditscited by 475
- 2016Off-policy evaluation for slate recommendationcited by 102
- 2018Seq2Slate: Re-ranking and Slate Optimization with RNNscited by 39
- 2018Beyond Greedy Ranking: Slate Optimization via List-CVAEcited by 21
- 2020Algorithms for slate bandits with non-separable reward functionscited by 6
Built on by
Citing papers per year: 2022: 3; 2023: 1.
4 papers.
- 2023Exponential Smoothing for Off-Policy Learningcited by 15
- 2022Probabilistic Rank and Reward: A Scalable Model for Slate Recommendationcited by 7
- 2022Offline Evaluation of Reward-Optimizing Recommender Systems: The Case of Simulationcited by 1
- 2022SlateFree: a Model-Free Decomposition for Reinforcement Learning with Slate Actionscited by 0
- 2023Exponential Smoothing for Off-Policy Learning25 May 2023
- 2022Offline Evaluation of Reward-Optimizing Recommender Systems: The Case of Simulation18 Sep 2022
- 2022SlateFree: a Model-Free Decomposition for Reinforcement Learning with Slate Actions5 Sep 2022
- 2022Probabilistic Rank and Reward: A Scalable Model for Slate Recommendation10 Aug 2022
Similar, not cited
Close in wording, no citation either way
- 2026Robust Post-Training for Generative Recommenders: Why Exponential Reward-Weighted SFT Outperforms RLHF
- 2025MTRec: Learning to Align with User Preferences via Mental Reward Models
- 2025What Makes LLMs Effective Sequential Recommenders? A Study on Preference Intensity and Temporal Context
- 2025HiGR: Industrial-Scale Hierarchical Generative Slate Recommendation Framework in Tencent
- 2026FlexRec: Adapting LLM-based Recommenders for Flexible Needs via Reinforcement Learning
- 2026RecRM-Bench: Benchmarking Multidimensional Reward Modeling for Agentic Recommender Systems
- 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion
- 2018Recommendation Through Mixtures of Heterogeneous Item Relationships