mlsanityData to 7 Oct 2026

Revisiting Fairness-aware Interactive Recommendation: Item Lifecycle as a Control Knob

arXiv 2511.16248 ↗First posted 20 Nov 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper revisits fairness-aware interactive recommendation (e.g., TikTok, KuaiShou) by introducing a novel control knob, i.e., the lifecycle of items. We make threefold contributions. First, we conduct a comprehensive empirical analysis and uncover that item lifecycles in short-video platforms follow a compressed three-phase pattern, i.e., rapid growth, transient stability, and sharp decay, which significantly deviates from the classical four-stage model (introduction, growth, maturity, decline). Second, we introduce LHRL, a lifecycle-aware hierarchical reinforcement learning framework that dynamically harmonizes fairness and accuracy by leveraging phase-specific exposure dynamics. LHRL consists of two key components: (1) PhaseFormer, a lightweight encoder combining STL decomposition and attention mechanisms for robust phase detection; (2) a two-level HRL agent, where the high-level policy imposes phase-aware fairness constraints, and the low-level policy optimizes immediate user engagement. This decoupled optimization allows for effective reconciliation between long-term equity and short-term utility. Third, experiments on multiple real-world interactive recommendation datasets demonstrate that LHRL significantly improves both fairness and user engagement. Furthermore, the integration of lifecycle-aware rewards into existing RL-based models consistently yields performance gains, highlighting the generalizability and practical value of our approach.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

15 of 22 references.

References · 15

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2015Continuous control with deep reinforcement learningcited by 3,279
  3. 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
  4. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
  5. 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,227
  6. 2022A Survey on the Fairness of Recommender Systemscited by 102
  7. 2020Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender Systemcited by 94
  8. 2021Towards Long-term Fairness in Recommendationcited by 77
  9. 2022KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videoscited by 69
  10. 2020Controlling Fairness and Bias in Dynamic Learning-to-Rankcited by 67
  11. 2020Self-Supervised Reinforcement Learning for Recommender Systemscited by 49
  12. 2023Alleviating Matthew Effect of Offline Reinforcement Learning in Interactive Recommendationcited by 38
3 more
  1. 2024Large Language Models are Learnable Planners for Long-Term Recommendationcited by 24
  2. 2021Fairness Through Regularization for Learning to Rankcited by 8
  3. 2021Balancing Accuracy and Fairness for Interactive Recommendation with Reinforcement Learningcited by 7

Built on by

Not cited yet.