Multi-Task Deep Recommender Systems: A Survey
Not on the map. Why?
Abstract (arXiv)
Multi-task learning (MTL) aims at learning related tasks in a unified model to achieve mutual improvement among tasks considering their shared knowledge. It is an important topic in recommendation due to the demand for multi-task prediction considering performance and efficiency. Although MTL has been well studied and developed, there is still a lack of systematic review in the recommendation community. To fill the gap, we provide a comprehensive review of existing multi-task deep recommender systems (MTDRS) in this survey. To be specific, the problem definition of MTDRS is first given, and it is compared with other related areas. Next, the development of MTDRS is depicted and the taxonomy is introduced from the task relation and methodology aspects. Specifically, the task relation is categorized into parallel, cascaded, and auxiliary with main, while the methodology is grouped into parameter sharing, optimization, and training mechanism. The survey concludes by summarizing the application and public datasets of MTDRS and highlighting the challenges and future directions of the field.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Feb 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 3; 2024: 10; 2025: 13; 2026: 3.
29 papers.
Sort:
By area:
- 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applicationscited by 110
- 2024Representation Surgery for Multi-Task Model Mergingcited by 95
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Frameworkcited by 32
- 2023Dual-Balancing for Multi-Task Learningcited by 27
- 2025Generative Auto-Bidding with Value-Guided Explorationscited by 23
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
- 2024SIGMA: Selective Gated Mamba for Sequential Recommendationcited by 10
- 2025Training-free LLM Merging for Multi-task Learningcited by 5
- 2024Efficient and Robust Regularized Federated Recommendationcited by 4
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
- 2024GPRec: Bi-level User Modeling for Deep Recommenderscited by 3
17 more
- 2025The Evolution of Embedding Table Optimization and Multi-Epoch Training in Pinterest Ads Conversioncited by 3
- 2025MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuningcited by 2
- 2025Macro Graph of Experts for Billion-Scale Multi-Task Recommendationcited by 2
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matchingcited by 2
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDscited by 2
- 2023Alleviating Behavior Data Imbalance for Multi-Behavior Graph Collaborative Filteringcited by 1
- 2024BMLP: Behavior-aware MLP for Heterogeneous Sequential Recommendationcited by 1
- 2024Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learningcited by 1
- 2024No More Tuning: Prioritized Multi-Task Learning with Lagrangian Differential Multiplier Methodscited by 1
- 2025A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphscited by 1
- 2025GRADE: Personalized Multi-Task Fusion via Group-relative Reinforcement Learning with Adaptive Dirichlet Explorationcited by 1
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Modelscited by 1
- 2025Efficient Multi-Task Modeling through Automated Fusion of Trained Modelscited by 0
- 2025Personalized Product Search Ranking: A Multi-Task Learning Approach with Tabular and Non-Tabular Datacited by 0
- 2026Q-Regularized Generative Auto-Bidding: From Suboptimal Trajectories to Optimal Policiescited by 0
- 2026MDL: A Unified Multi-Distribution Learner in Large-scale Industrial Recommendation through Tokenizationcited by 0
- 2026Action-Aware Generative Sequence Modeling for Short Video Recommendationcited by 0
- 2026Action-Aware Generative Sequence Modeling for Short Video Recommendation28 Apr 2026
- 2026MDL: A Unified Multi-Distribution Learner in Large-scale Industrial Recommendation through Tokenization7 Feb 2026
- 2026Q-Regularized Generative Auto-Bidding: From Suboptimal Trajectories to Optimal Policies6 Jan 2026
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Models20 Oct 2025
- 2025GRADE: Personalized Multi-Task Fusion via Group-relative Reinforcement Learning with Adaptive Dirichlet Exploration9 Oct 2025
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs2 Sep 2025
- 2025Personalized Product Search Ranking: A Multi-Task Learning Approach with Tabular and Non-Tabular Data13 Aug 2025
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matching23 Jun 2025
- 2025A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs17 Jun 2025
- 2025Training-free LLM Merging for Multi-task Learning14 Jun 2025
- 2025Macro Graph of Experts for Billion-Scale Multi-Task Recommendation12 Jun 2025
- 2025The Evolution of Embedding Table Optimization and Multi-Epoch Training in Pinterest Ads Conversion8 May 2025
17 more
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendation25 Apr 2025
- 2025Generative Auto-Bidding with Value-Guided Explorations20 Apr 2025
- 2025Efficient Multi-Task Modeling through Automated Fusion of Trained Models14 Apr 2025
- 2025MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning1 Apr 2025
- 2024No More Tuning: Prioritized Multi-Task Learning with Lagrangian Differential Multiplier Methods16 Dec 2024
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models5 Dec 2024
- 2024Efficient and Robust Regularized Federated Recommendation3 Nov 2024
- 2024GPRec: Bi-level User Modeling for Deep Recommenders28 Oct 2024
- 2024SIGMA: Selective Gated Mamba for Sequential Recommendation21 Aug 2024
- 2024Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learning24 Jun 2024
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation18 Jun 2024
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework29 Apr 2024
- 2024BMLP: Behavior-aware MLP for Heterogeneous Sequential Recommendation20 Feb 2024
- 2024Representation Surgery for Multi-Task Model Merging5 Feb 2024
- 2023Alleviating Behavior Data Imbalance for Multi-Behavior Graph Collaborative Filtering12 Nov 2023
- 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications21 Oct 2023
- 2023Dual-Balancing for Multi-Task Learning23 Aug 2023
- 2024SIGMA: Selective Gated Mamba for Sequential Recommendationcited by 10
- 2024SIGMA: Selective Gated Mamba for Sequential Recommendation21 Aug 2024
- 2024Representation Surgery for Multi-Task Model Mergingcited by 95
- 2023Dual-Balancing for Multi-Task Learningcited by 27
- 2025Generative Auto-Bidding with Value-Guided Explorationscited by 23
- 2024LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendationcited by 19
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
- 2025Training-free LLM Merging for Multi-task Learningcited by 5
- 2024Efficient and Robust Regularized Federated Recommendationcited by 4
- 2024Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Modelscited by 4
- 2024GPRec: Bi-level User Modeling for Deep Recommenderscited by 3
- 2025The Evolution of Embedding Table Optimization and Multi-Epoch Training in Pinterest Ads Conversioncited by 3
- 2025MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuningcited by 2
- 2025Macro Graph of Experts for Billion-Scale Multi-Task Recommendationcited by 2
12 most cited of 26 All 26 (JSON)
- 2026Action-Aware Generative Sequence Modeling for Short Video Recommendation28 Apr 2026
- 2026MDL: A Unified Multi-Distribution Learner in Large-scale Industrial Recommendation through Tokenization7 Feb 2026
- 2026Q-Regularized Generative Auto-Bidding: From Suboptimal Trajectories to Optimal Policies6 Jan 2026
- 2025Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Models20 Oct 2025
- 2025GRADE: Personalized Multi-Task Fusion via Group-relative Reinforcement Learning with Adaptive Dirichlet Exploration9 Oct 2025
- 2025Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs2 Sep 2025
- 2025Personalized Product Search Ranking: A Multi-Task Learning Approach with Tabular and Non-Tabular Data13 Aug 2025
- 2025PERSCEN: Learning Personalized Interaction Pattern and Scenario Preference for Multi-Scenario Matching23 Jun 2025
- 2025A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs17 Jun 2025
- 2025Training-free LLM Merging for Multi-task Learning14 Jun 2025
- 2025Macro Graph of Experts for Billion-Scale Multi-Task Recommendation12 Jun 2025
- 2025The Evolution of Embedding Table Optimization and Multi-Epoch Training in Pinterest Ads Conversion8 May 2025
12 newest of 26 All 26 (JSON)