Deep Reinforcement Learning for Page-wise Recommendations
Not on the map. Why?
Abstract (arXiv)
Recommender systems can mitigate the information overload problem by suggesting users' personalized items. In real-world recommendations such as e-commerce, a typical interaction between the system and its users is -- users are recommended a page of items and provide feedback; and then the system recommends a new page of items. To effectively capture such interaction for recommendations, we need to solve two key problems -- (1) how to update recommending strategy according to user's textitreal-time feedback, and 2) how to generate a page of items with proper display, which pose tremendous challenges to traditional recommender systems. In this paper, we study the problem of page-wise recommendations aiming to address aforementioned two challenges simultaneously. In particular, we propose a principled approach to jointly generate a set of complementary items and the corresponding strategy to display them in a 2-D page; and propose a novel page-wise recommendation framework based on deep reinforcement learning, DeepPage, which can optimize a page of items with proper display based on real-time feedback from users. The experimental results based on a real-world e-commerce dataset demonstrate the effectiveness of the proposed framework.
Key facts. Cited by 100 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 14; 2023: 15; 2024: 17; 2025: 23; 2026: 7.
100 papers.
Sort:
By area:
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
- 2025Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learningcited by 70
- 2021A Provably Efficient Algorithm for Linear Markov Decision Process with Low Switching Costcited by 40
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2021AutoLoss: Automated Loss Function Search in Recommendationscited by 31
- 2021Provably Efficient Black-Box Action Poisoning Attacks Against Reinforcement Learningcited by 29
- 2025A Survey of Personalization: From RAG to Agentcited by 27
- 2021Reward Poisoning in Reinforcement Learning: Attacks Against Unknown Learners in Unknown Environmentscited by 26
- 2023Multi-Task Recommendations with Reinforcement Learningcited by 26
- 2024Large Language Models are Learnable Planners for Long-Term Recommendationcited by 24
- 2021User Tampering in Reinforcement Learning Recommender Systemscited by 23
- 2022Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systemscited by 22
38 more
- 2021Reinforced Imitative Graph Representation Learning for Mobile User Profiling: An Adversarial Training Perspectivecited by 21
- 2021RecSim NG: Toward Principled Uncertainty Modeling for Recommender Ecosystemscited by 21
- 2021A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directionscited by 21
- 2022Understanding the Limits of Poisoning Attacks in Episodic Reinforcement Learningcited by 21
- 2023A General Offline Reinforcement Learning Framework for Interactive Recommendationcited by 18
- 2023Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-agent LLMcited by 18
- 2021Accelerating Offline Reinforcement Learning Application in Real-Time Bidding and Recommendation: Potential Use of Simulationcited by 16
- 2021Variational Quantum Soft Actor-Criticcited by 15
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
- 2021Blockchain-based Recommender Systems: Applications, Challenges and Future Opportunitiescited by 11
- 2023Causal Decision Transformer for Recommender Systems via Offline Reinforcement Learningcited by 11
- 2025Personalize Before Retrieve: LLM-based Personalized Query Expansion for User-Centric Retrievalcited by 11
- 2023On the Opportunities and Challenges of Offline Reinforcement Learning for Recommender Systemscited by 10
- 2021Model-free Policy Learning with Reward Gradientscited by 9
- 2021Reinforcement Learning to Optimize Lifetime Value in Cold-Start Recommendationcited by 9
- 2022Local Policy Improvement for Recommender Systemscited by 9
- 2023Multi-agent Attacks for Black-box Social Recommendationscited by 9
- 2024EasyRL4Rec: An Easy-to-use Library for Reinforcement Learning Based Recommender Systemscited by 9
- 2022Modeling Users' Contextualized Page-wise Feedback for Click-Through Rate Prediction in E-commerce Searchcited by 8
- 2022Probabilistic Rank and Reward: A Scalable Model for Slate Recommendationcited by 8
- 2023Optimizing Audio Recommendations for the Long-Term: A Reinforcement Learning Perspectivecited by 8
- 2022Reward Shaping for User Satisfaction in a REINFORCE Recommendercited by 6
- 2021MARL with General Utilities via Decentralized Shadow Reward Actor-Criticcited by 5
- 2021Reinforcement Learning with a Disentangled Universal Value Function for Item Recommendationcited by 4
- 2021Value Penalized Q-Learning for Recommender Systemscited by 4
- 2024DNS-Rec: Data-aware Neural Architecture Search for Recommender Systemscited by 4
- 2024Evolutionary Reinforcement Learning: A Systematic Review and Future Directionscited by 4
- 2024ROLeR: Effective Reward Shaping in Offline Reinforcement Learning for Recommender Systemscited by 4
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
- 2025SampleLLM: Optimizing Tabular Data Synthesis in Recommendationscited by 4
- 2026Exploring Recommender System Evaluation: A Multi-Modal User Agent Framework for A/B Testingcited by 4
- 2022BCRLSP: An Offline Reinforcement Learning Framework for Sequential Targeted Promotioncited by 3
- 2024Retentive Decision Transformer with Adaptive Masking for Reinforcement Learning based Recommendation Systemscited by 3
- 2024Minimizing Live Experiments in Recommender Systems: User Simulation to Evaluate Preference Elicitation Policiescited by 3
- 2024Mitigating Suboptimality of Deterministic Policy Gradients in Complex Q-functionscited by 3
- 2024An Investigation of Offline Reinforcement Learning in Factorisable Action Spacescited by 3
- 2025Time-Constrained Recommendations: Reinforcement Learning Strategies for E-Commercecited by 3
- 2026AgentOS: From Application Silos to a Natural Language-Driven Data Ecosystemcited by 3
50 most cited of 100 All 100 (JSON)
- 2026Learning to Allocate Incentives for Incentivized Advertising via Offline Model-Based Reinforcement Learning28 Aug 2026
- 2026Generative Optimization for Incentivized Advertising with Global Level Constraints5 Aug 2026
- 2026Empowering Cross-Domain Sequential Recommendation with Hybrid Tokenization and Serial-Parallel Decoding21 Jul 2026
- 2026A Production-Ready RL Framework for Personalized Utility Tuning with Pareto Sweeping in Pinterest Recommender Systems8 May 2026
- 2026AgentOS: From Application Silos to a Natural Language-Driven Data Ecosystem9 Mar 2026
- 2026Exploring Recommender System Evaluation: A Multi-Modal User Agent Framework for A/B Testing8 Jan 2026
- 2026Improving and Accelerating Offline RL in Large Discrete Action Spaces with Structured Policy Initialization7 Jan 2026
- 2025Time-Constrained Recommendations: Reinforcement Learning Strategies for E-Commerce13 Dec 2025
- 2025Learning a Single Token to Replace Long System Prompts in LLMs28 Nov 2025
- 2025LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Training25 Nov 2025
- 2025Grounded by Experience: Generative Healthcare Prediction Augmented with Hierarchical Agentic Retrieval17 Nov 2025
- 2025Provably Invincible Adversarial Attacks on Reinforcement Learning Systems: A Rate-Distortion Information-Theoretic Approach15 Oct 2025
38 more
- 2025Personalize Before Retrieve: LLM-based Personalized Query Expansion for User-Centric Retrieval10 Oct 2025
- 2025Energy-Guided Diffusion Sampling for Long-Term User Behavior Prediction in Reinforcement Learning-based Recommendation9 Oct 2025
- 2025Empowering Denoising Sequential Recommendation with Large Language Model Embeddings5 Oct 2025
- 2025Deep Reinforcement Learning for Ranking Utility Tuning in the Ad Recommender System at Pinterest5 Sep 2025
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs2 Sep 2025
- 2025Breaking the Cold-Start Barrier: Reinforcement Learning with Double and Dueling DQNs28 Aug 2025
- 2025A Tutorial: An Intuitive Explanation of Offline Reinforcement Learning Theory11 Aug 2025
- 2025KLAN: Kuaishou Landing-page Adaptive Navigator31 Jul 2025
- 2025Multi-task Offline Reinforcement Learning for Online Advertising in Recommender Systems29 Jun 2025
- 2025A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs17 Jun 2025
- 2025Model Merging for Knowledge Editing14 Jun 2025
- 2025Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learning20 May 2025
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation25 Apr 2025
- 2025A Survey of Personalization: From RAG to Agent14 Apr 2025
- 2025MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning1 Apr 2025
- 2025Group Fairness in Multi-Task Reinforcement Learning10 Mar 2025
- 2025SampleLLM: Optimizing Tabular Data Synthesis in Recommendations27 Jan 2025
- 2025On the Statistical Complexity for Offline and Low-Adaptive Reinforcement Learning with Structures3 Jan 2025
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models5 Dec 2024
- 2024An Investigation of Offline Reinforcement Learning in Factorisable Action Spaces17 Nov 2024
- 2024Mitigating Suboptimality of Deterministic Policy Gradients in Complex Q-functions15 Oct 2024
- 2024Minimizing Live Experiments in Recommender Systems: User Simulation to Evaluate Preference Elicitation Policies26 Sep 2024
- 2024Hierarchical Reinforcement Learning for Temporal Abstraction of Listwise Recommendation11 Sep 2024
- 2024Cooperative Multi-Agent Deep Reinforcement Learning in Content Ranking Optimization8 Aug 2024
- 2024ROLeR: Effective Reward Shaping in Offline Reinforcement Learning for Recommender Systems18 Jul 2024
- 2024Retentive Decision Transformer with Adaptive Masking for Reinforcement Learning based Recommendation Systems26 Mar 2024
- 2024Large Language Models are Learnable Planners for Long-Term Recommendation29 Feb 2024
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations27 Feb 2024
- 2024EasyRL4Rec: An Easy-to-use Library for Reinforcement Learning Based Recommender Systems23 Feb 2024
- 2024GenSERP: Large Language Models for Whole Page Presentation22 Feb 2024
- 2024Evolutionary Reinforcement Learning: A Systematic Review and Future Directions20 Feb 2024
- 2024DNS-Rec: Data-aware Neural Architecture Search for Recommender Systems1 Feb 2024
- 2024UOEP: User-Oriented Exploration Policy for Enhancing Long-Term User Experiences in Recommender Systems17 Jan 2024
- 2024Towards Off-Policy Reinforcement Learning for Ranking Policies with Human Feedback17 Jan 2024
- 2024MultiSlot ReRanker: A Generic Model-based Re-Ranking Framework in Recommendation Systems11 Jan 2024
- 2023Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-agent LLM24 Dec 2023
- 2023Multi-agent Attacks for Black-box Social Recommendations13 Nov 2023
- 2023Optimal Cost Constrained Adversarial Attacks For Multiple Agent Systems1 Nov 2023
50 newest of 100 All 100 (JSON)
- 2022Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systemscited by 22
- 2023A General Offline Reinforcement Learning Framework for Interactive Recommendationcited by 18
- 2021Accelerating Offline Reinforcement Learning Application in Real-Time Bidding and Recommendation: Potential Use of Simulationcited by 16
- 2023Causal Decision Transformer for Recommender Systems via Offline Reinforcement Learningcited by 11
- 2023On the Opportunities and Challenges of Offline Reinforcement Learning for Recommender Systemscited by 10
- 2021Value Penalized Q-Learning for Recommender Systemscited by 4
- 2022BCRLSP: An Offline Reinforcement Learning Framework for Sequential Targeted Promotioncited by 3
- 2024Retentive Decision Transformer with Adaptive Masking for Reinforcement Learning based Recommendation Systemscited by 3
- 2024An Investigation of Offline Reinforcement Learning in Factorisable Action Spacescited by 3
- 2021Interpretable performance analysis towards offline reinforcement learning: A dataset perspectivecited by 2
- 2025Multi-task Offline Reinforcement Learning for Online Advertising in Recommender Systemscited by 2
- 2025On the Statistical Complexity for Offline and Low-Adaptive Reinforcement Learning with Structurescited by 1
12 most cited of 15 All 15 (JSON)
- 2026Learning to Allocate Incentives for Incentivized Advertising via Offline Model-Based Reinforcement Learning28 Aug 2026
- 2026Improving and Accelerating Offline RL in Large Discrete Action Spaces with Structured Policy Initialization7 Jan 2026
- 2025A Tutorial: An Intuitive Explanation of Offline Reinforcement Learning Theory11 Aug 2025
- 2025Multi-task Offline Reinforcement Learning for Online Advertising in Recommender Systems29 Jun 2025
- 2025On the Statistical Complexity for Offline and Low-Adaptive Reinforcement Learning with Structures3 Jan 2025
- 2024An Investigation of Offline Reinforcement Learning in Factorisable Action Spaces17 Nov 2024
- 2024Retentive Decision Transformer with Adaptive Masking for Reinforcement Learning based Recommendation Systems26 Mar 2024
- 2023A General Offline Reinforcement Learning Framework for Interactive Recommendation1 Oct 2023
- 2023On the Opportunities and Challenges of Offline Reinforcement Learning for Recommender Systems22 Aug 2023
- 2023Causal Decision Transformer for Recommender Systems via Offline Reinforcement Learning17 Apr 2023
- 2022Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systems9 Aug 2022
- 2022BCRLSP: An Offline Reinforcement Learning Framework for Sequential Targeted Promotion16 Jul 2022
12 newest of 15 All 15 (JSON)
- 2024EasyRL4Rec: An Easy-to-use Library for Reinforcement Learning Based Recommender Systemscited by 9
- 2024Evolutionary Reinforcement Learning: A Systematic Review and Future Directionscited by 4
- 2024Mitigating Suboptimality of Deterministic Policy Gradients in Complex Q-functionscited by 3
- 2025Time-Constrained Recommendations: Reinforcement Learning Strategies for E-Commercecited by 3
- 2024Towards Off-Policy Reinforcement Learning for Ranking Policies with Human Feedbackcited by 2
- 2024UOEP: User-Oriented Exploration Policy for Enhancing Long-Term User Experiences in Recommender Systemscited by 2
- 2024Hierarchical Reinforcement Learning for Temporal Abstraction of Listwise Recommendationcited by 1
- 2025Deep Reinforcement Learning for Ranking Utility Tuning in the Ad Recommender System at Pinterestcited by 1
- 2025Group Fairness in Multi-Task Reinforcement Learningcited by 0
- 2025Breaking the Cold-Start Barrier: Reinforcement Learning with Double and Dueling DQNscited by 0
- 2025Provably Invincible Adversarial Attacks on Reinforcement Learning Systems: A Rate-Distortion Information-Theoretic Approachcited by 0
- 2025Time-Constrained Recommendations: Reinforcement Learning Strategies for E-Commerce13 Dec 2025
- 2025Provably Invincible Adversarial Attacks on Reinforcement Learning Systems: A Rate-Distortion Information-Theoretic Approach15 Oct 2025
- 2025Deep Reinforcement Learning for Ranking Utility Tuning in the Ad Recommender System at Pinterest5 Sep 2025
- 2025Breaking the Cold-Start Barrier: Reinforcement Learning with Double and Dueling DQNs28 Aug 2025
- 2025Group Fairness in Multi-Task Reinforcement Learning10 Mar 2025
- 2024Mitigating Suboptimality of Deterministic Policy Gradients in Complex Q-functions15 Oct 2024
- 2024Hierarchical Reinforcement Learning for Temporal Abstraction of Listwise Recommendation11 Sep 2024
- 2024EasyRL4Rec: An Easy-to-use Library for Reinforcement Learning Based Recommender Systems23 Feb 2024
- 2024Evolutionary Reinforcement Learning: A Systematic Review and Future Directions20 Feb 2024
- 2024UOEP: User-Oriented Exploration Policy for Enhancing Long-Term User Experiences in Recommender Systems17 Jan 2024
- 2024Towards Off-Policy Reinforcement Learning for Ranking Policies with Human Feedback17 Jan 2024
- 2023Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-agent LLMcited by 18
- 2026Exploring Recommender System Evaluation: A Multi-Modal User Agent Framework for A/B Testingcited by 4
- 2025Grounded by Experience: Generative Healthcare Prediction Augmented with Hierarchical Agentic Retrievalcited by 1
- 2026Exploring Recommender System Evaluation: A Multi-Modal User Agent Framework for A/B Testing8 Jan 2026
- 2025Grounded by Experience: Generative Healthcare Prediction Augmented with Hierarchical Agentic Retrieval17 Nov 2025
- 2023Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-agent LLM24 Dec 2023
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
- 2021A Provably Efficient Algorithm for Linear Markov Decision Process with Low Switching Costcited by 40
- 2022A Comprehensive Survey on Trustworthy Recommender Systemscited by 32
- 2021AutoLoss: Automated Loss Function Search in Recommendationscited by 31
- 2021Provably Efficient Black-Box Action Poisoning Attacks Against Reinforcement Learningcited by 29
- 2021Reward Poisoning in Reinforcement Learning: Attacks Against Unknown Learners in Unknown Environmentscited by 26
- 2023Multi-Task Recommendations with Reinforcement Learningcited by 26
- 2024Large Language Models are Learnable Planners for Long-Term Recommendationcited by 24
- 2021User Tampering in Reinforcement Learning Recommender Systemscited by 23
- 2021Reinforced Imitative Graph Representation Learning for Mobile User Profiling: An Adversarial Training Perspectivecited by 21
- 2021RecSim NG: Toward Principled Uncertainty Modeling for Recommender Ecosystemscited by 21
- 2021A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directionscited by 21
12 most cited of 63 All 63 (JSON)
- 2026Generative Optimization for Incentivized Advertising with Global Level Constraints5 Aug 2026
- 2026A Production-Ready RL Framework for Personalized Utility Tuning with Pareto Sweeping in Pinterest Recommender Systems8 May 2026
- 2026AgentOS: From Application Silos to a Natural Language-Driven Data Ecosystem9 Mar 2026
- 2025Learning a Single Token to Replace Long System Prompts in LLMs28 Nov 2025
- 2025LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Training25 Nov 2025
- 2025Empowering Denoising Sequential Recommendation with Large Language Model Embeddings5 Oct 2025
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs2 Sep 2025
- 2025KLAN: Kuaishou Landing-page Adaptive Navigator31 Jul 2025
- 2025A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs17 Jun 2025
- 2025Model Merging for Knowledge Editing14 Jun 2025
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation25 Apr 2025
- 2025MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning1 Apr 2025
12 newest of 63 All 63 (JSON)