Multi-Task Recommendations with Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications. However, current MTL-based recommendation models tend to disregard the session-wise patterns of user-item interactions because they are predominantly constructed based on item-wise datasets. Moreover, balancing multiple objectives has always been a challenge in this field, which is typically avoided via linear estimations in existing works. To address these issues, in this paper, we propose a Reinforcement Learning (RL) enhanced MTL framework, namely RMTL, to combine the losses of different recommendation tasks using dynamic weights. To be specific, the RMTL structure can address the two aforementioned issues by (i) constructing an MTL environment from session-wise interactions and (ii) training multi-task actor-critic network structure, which is compatible with most existing MTL-based recommendation models, and (iii) optimizing and fine-tuning the MTL loss function using the weights generated by critic networks. Experiments on two real-world public datasets demonstrate the effectiveness of RMTL with a higher AUC against state-of-the-art MTL-based recommendation models. Additionally, we evaluate and validate RMTL's compatibility and transferability across various MTL models.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 30 of its 63 references that are in the map. First posted on arXiv 7 Feb 2023.
Builds on
30 of 63 references.
References · 30
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017A Survey on Multi-Task Learningcited by 838
- 2016Wide & Deep Learning for Recommender Systemscited by 745
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
- 2016Cross-stitch Networks for Multi-task Learningcited by 466
- 2021Reinforcement learning based recommender systems: A surveycited by 187
- 2018Top-K Off-Policy Correction for a REINFORCE Recommender Systemcited by 181
- 2018Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Ratecited by 172
- 2015Deep Reinforcement Learning in Large Discrete Action Spacescited by 158
- 2017Deep Learning based Recommender System: A Survey and New Perspectivescited by 136
- 2018Conversational Recommender Systemcited by 115
- 2018Deep Reinforcement Learning for Page-wise Recommendationscited by 99
18 more
- 2015Multi-task Sequence to Sequence Learningcited by 94
- 2019RecSim: A Configurable Simulation Platform for Recommender Systemscited by 91
- 2019Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systemscited by 90
- 2018Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learningcited by 71
- 2016Deep Multi-task Representation Learning: A Tensor Factorisation Approachcited by 69
- 2022KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videoscited by 69
- 2019DEAR: Deep Reinforcement Learning for Online Advertising Impression in Recommender Systemscited by 44
- 2017Deep Reinforcement Learning for List-wise Recommendationscited by 35
- 2019Model-Based Reinforcement Learning with Adversarial Training for Online Recommendationcited by 33
- 2019Security and Privacy on Blockchaincited by 32
- 2018Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions Modelingcited by 31
- 2018Large-scale Interactive Recommendation with Tree-structured Policy Gradientcited by 30
- 2018Learning to Collaborate: Multi-Scenario Ranking via Multi-Agent Reinforcement Learningcited by 23
- 2018Deep reinforcement learning for search, recommendation, and online advertising: a surveycited by 23
- 2022Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systemscited by 22
- 2020Kalman Filtering Attention for User Behavior Modeling in CTR Predictioncited by 15
- 2018Rank and Rate: Multi-task Learning for Recommender Systemscited by 12
- 2020AliExpress Learning-To-Rank: Maximizing Online Model Performance without Going Onlinecited by 3
Built on by
Citing papers per year: 2023: 3; 2024: 12; 2025: 8; 2026: 3.
26 papers.
Sort:
By area:
- 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applicationscited by 110
- 2025Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learningcited by 68
- 2024LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendationcited by 47
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Frameworkcited by 32
- 2025Generative Auto-Bidding with Value-Guided Explorationscited by 23
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
- 2024SIGMA: Selective Gated Mamba for Sequential Recommendationcited by 10
- 2024Efficient and Robust Regularized Federated Recommendationcited by 4
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
- 2025SampleLLM: Optimizing Tabular Data Synthesis in Recommendationscited by 4
- 2024Masked Multi-Domain Network: Multi-Type and Multi-Scenario Conversion Rate Prediction with a Single Modelcited by 3
14 more
- 2024EulerFormer: Sequential User Behavior Modeling with Complex Vector Attentioncited by 3
- 2024GPRec: Bi-level User Modeling for Deep Recommenderscited by 3
- 2025Multi-task Offline Reinforcement Learning for Online Advertising in Recommender Systemscited by 2
- 2023AutoAssign+: Automatic Shared Embedding Assignment in Streaming Recommendationcited by 1
- 2023Model-enhanced Contrastive Reinforcement Learning for Sequential Recommendationcited by 1
- 2024Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learningcited by 1
- 2024Goal-Conditioned Supervised Learning for Multi-Objective Recommendationcited by 1
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Modelscited by 1
- 2026Generative Archetype-Grounded Item Representations for Sequential Recommendationcited by 1
- 2026Long-term User Engagement Optimization through Model-agnostic Downstream Rewards Learningcited by 1
- 2024Advancements in Recommender Systems: A Comprehensive Analysis Based on Data, Algorithms, and Evaluationcited by 0
- 2025Hyperproperty-Constrained Secure Reinforcement Learningcited by 0
- 2025SEGB: Self-Evolved Generative Bidding with Local Autoregressive Diffusioncited by 0
- 2026Empowering Cross-Domain Sequential Recommendation with Hybrid Tokenization and Serial-Parallel Decodingcited by 0
- 2026Empowering Cross-Domain Sequential Recommendation with Hybrid Tokenization and Serial-Parallel Decoding21 Jul 2026
- 2026Long-term User Engagement Optimization through Model-agnostic Downstream Rewards Learning15 Jul 2026
- 2026Generative Archetype-Grounded Item Representations for Sequential Recommendation9 Jun 2026
- 2025SEGB: Self-Evolved Generative Bidding with Local Autoregressive Diffusion31 Dec 2025
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Models20 Oct 2025
- 2025Hyperproperty-Constrained Secure Reinforcement Learning31 Jul 2025
- 2025Multi-task Offline Reinforcement Learning for Online Advertising in Recommender Systems29 Jun 2025
- 2025Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learning20 May 2025
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation25 Apr 2025
- 2025Generative Auto-Bidding with Value-Guided Explorations20 Apr 2025
- 2025SampleLLM: Optimizing Tabular Data Synthesis in Recommendations27 Jan 2025
- 2024Goal-Conditioned Supervised Learning for Multi-Objective Recommendation12 Dec 2024
14 more
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models5 Dec 2024
- 2024Efficient and Robust Regularized Federated Recommendation3 Nov 2024
- 2024GPRec: Bi-level User Modeling for Deep Recommenders28 Oct 2024
- 2024SIGMA: Selective Gated Mamba for Sequential Recommendation21 Aug 2024
- 2024Advancements in Recommender Systems: A Comprehensive Analysis Based on Data, Algorithms, and Evaluation10 Jul 2024
- 2024Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learning24 Jun 2024
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation18 Jun 2024
- 2024LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation31 May 2024
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework29 Apr 2024
- 2024EulerFormer: Sequential User Behavior Modeling with Complex Vector Attention26 Mar 2024
- 2024Masked Multi-Domain Network: Multi-Type and Multi-Scenario Conversion Rate Prediction with a Single Model26 Mar 2024
- 2023Model-enhanced Contrastive Reinforcement Learning for Sequential Recommendation25 Oct 2023
- 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications21 Oct 2023
- 2023AutoAssign+: Automatic Shared Embedding Assignment in Streaming Recommendation14 Aug 2023
- 2024SIGMA: Selective Gated Mamba for Sequential Recommendationcited by 10
- 2024SIGMA: Selective Gated Mamba for Sequential Recommendation21 Aug 2024
- 2024LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendationcited by 47
- 2025Generative Auto-Bidding with Value-Guided Explorationscited by 23
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
- 2024Efficient and Robust Regularized Federated Recommendationcited by 4
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
- 2024Masked Multi-Domain Network: Multi-Type and Multi-Scenario Conversion Rate Prediction with a Single Modelcited by 3
- 2024EulerFormer: Sequential User Behavior Modeling with Complex Vector Attentioncited by 3
- 2024GPRec: Bi-level User Modeling for Deep Recommenderscited by 3
- 2023AutoAssign+: Automatic Shared Embedding Assignment in Streaming Recommendationcited by 1
- 2024Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learningcited by 1
- 2024Goal-Conditioned Supervised Learning for Multi-Objective Recommendationcited by 1
12 most cited of 18 All 18 (JSON)
- 2026Long-term User Engagement Optimization through Model-agnostic Downstream Rewards Learning15 Jul 2026
- 2026Generative Archetype-Grounded Item Representations for Sequential Recommendation9 Jun 2026
- 2025SEGB: Self-Evolved Generative Bidding with Local Autoregressive Diffusion31 Dec 2025
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Models20 Oct 2025
- 2025Hyperproperty-Constrained Secure Reinforcement Learning31 Jul 2025
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation25 Apr 2025
- 2025Generative Auto-Bidding with Value-Guided Explorations20 Apr 2025
- 2024Goal-Conditioned Supervised Learning for Multi-Objective Recommendation12 Dec 2024
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models5 Dec 2024
- 2024Efficient and Robust Regularized Federated Recommendation3 Nov 2024
- 2024GPRec: Bi-level User Modeling for Deep Recommenders28 Oct 2024
- 2024Advancements in Recommender Systems: A Comprehensive Analysis Based on Data, Algorithms, and Evaluation10 Jul 2024
12 newest of 18 All 18 (JSON)