Learned Ranking Function: From Short-term Behavior Predictions to Long-term User Satisfaction
Not on the map. Why?
Abstract (arXiv)
We present the Learned Ranking Function (LRF), a system that takes short-term user-item behavior predictions as input and outputs a slate of recommendations that directly optimizes for long-term user satisfaction. Most previous work is based on optimizing the hyperparameters of a heuristic function. We propose to model the problem directly as a slate optimization problem with the objective of maximizing long-term user satisfaction. We also develop a novel constraint optimization algorithm that stabilizes objective trade-offs for multi-objective optimization. We evaluate our approach with live experiments and describe its deployment on YouTube.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 5 of its 22 references that are in the map. First posted on arXiv 12 Aug 2024.
Builds on
5 of 22 references.
References · 5
- 2014A Survey of Multi-Objective Sequential Decision-Makingcited by 229
- 2018Top-K Off-Policy Correction for a REINFORCE Recommender Systemcited by 181
- 2022Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systemscited by 22
- 2023Reinforcing User Retention in a Billion Scale Short Video Recommender Systemcited by 15
- 2022Reward Shaping for User Satisfaction in a REINFORCE Recommendercited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026Self-Evolving Recommendation System: End-To-End Autonomous Model Optimization With LLM Agentscited by 19
- 2025ACT: Automated Constraint Targeting for Multi-Objective Recommender Systemscited by 1
- 2026Lightweight Ranking Heads: Accelerating Multi-Task Experimentation in Production Recommender Systemscited by 0
- 2026Learned Cross-Task Relationships in Multi-Task Modelscited by 0
- 2026Learned Cross-Task Relationships in Multi-Task Models23 Sep 2026
- 2026Lightweight Ranking Heads: Accelerating Multi-Task Experimentation in Production Recommender Systems21 Sep 2026
- 2026Self-Evolving Recommendation System: End-To-End Autonomous Model Optimization With LLM Agents10 Feb 2026
- 2025ACT: Automated Constraint Targeting for Multi-Objective Recommender Systems3 Sep 2025