Goal-Conditioned Supervised Learning for Multi-Objective Recommendation
Not on the map. Why?
Abstract (arXiv)
Multi-objective learning endeavors to concurrently optimize multiple objectives using a single model, aiming to achieve high and balanced performance across diverse objectives. However, this often entails a complex optimization problem to balance the learning of potentially conflicting objectives, leading to solutions with higher memory requirements and computational complexity. This paper introduces a Multi-Objective Goal-Conditioned Supervised Learning (MOGCSL) framework for automatically learning to achieve multiple objectives from offline sequential data. MOGCSL extends the conventional GCSL method to multi-objective scenarios by redefining goals from one-dimensional scalars to multi-dimensional vectors. It benefits from naturally eliminating the need for complex architectures and optimization constraints. Moreover, MOGCSL inherently disentangles uninformative or noisy training instances that fail to achieve desirable long-term rewards across multiple objectives. We also introduce a novel goal-selection algorithm for MOGCSL to model and identify desired and achievable goals for inference. In this paper, we focus on its application to the next action prediction problem in commercial-grade recommender systems. In this context, any viable solution needs to be reasonably scalable and also be robust to large amounts of noisy data that is characteristic of this application space. We show that MOGCSL performs admirably on both counts by extensive experiments. Also, analysis and experiments are included to explain its strength in discounting the noisier portions of training data in recommender systems with multiple objectives.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 41 references that are in the map. First posted on arXiv 12 Dec 2024.
Builds on
29 of 41 references.
References · 29
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2020Gradient Surgery for Multi-Task Learningcited by 1,210
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2017A Survey on Multi-Task Learningcited by 838
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 636
- 2018End-to-End Multi-Task Learning with Attentioncited by 533
17 more
- 2016Cross-stitch Networks for Multi-task Learningcited by 466
- 2014A Survey of Multi-Objective Sequential Decision-Makingcited by 229
- 2022Multi-Task Learning as a Bargaining Gamecited by 209
- 2022Online Decision Transformercited by 194
- 2022Goal-Conditioned Reinforcement Learning: Problems and Solutionscited by 145
- 2022Q-learning Decision Transformer: Leveraging Dynamic Programming for Conditional Sequence Modelling in Offline RLcited by 103
- 2022Rethinking Goal-conditioned Supervised Learning and Its Connection to Offline RLcited by 89
- 2023FAMO: Fast Adaptive Multitask Optimizationcited by 74
- 2020Self-Supervised Reinforcement Learning for Recommender Systemscited by 49
- 2022Tenrec: A Large-scale Multipurpose Benchmark Dataset for Recommender Systemscited by 31
- 2023Multi-Task Recommendations with Reinforcement Learningcited by 26
- 2024Reinformer: Max-Return Sequence Modeling for Offline RLcited by 25
- 2021Choosing the Best of Both Worlds: Diverse and Novel Recommendations through Multi-Objective Reinforcement Learningcited by 14
- 2022Rethinking Reinforcement Learning for Recommendation: A Prompt Perspectivecited by 10
- 2023Robust Recommender System: A Survey and Future Directionscited by 7
- 2023Pareto-based Multi-Objective Recommender System with Forgetting Curvecited by 7
- 2022Constrained Reinforcement Learning for Short Video Recommendationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Recommendation World Models for Future-State Controlcited by 0
- 2026Recommendation World Models for Future-State Control25 Sep 2026