mlsanityData to 7 Oct 2026

Collaborative Pareto Set Learning in Multiple Multi-Objective Optimization Problems

arXiv 2404.01224 ↗First posted 1 Apr 2024cs.LG math.OCcited by 1

Not on the map. Why?

Abstract (arXiv)

Pareto Set Learning (PSL) is an emerging research area in multi-objective optimization, focusing on training neural networks to learn the mapping from preference vectors to Pareto optimal solutions. However, existing PSL methods are limited to addressing a single Multi-objective Optimization Problem (MOP) at a time. When faced with multiple MOPs, this limitation results in significant inefficiencies and hinders the ability to exploit potential synergies across varying MOPs. In this paper, we propose a Collaborative Pareto Set Learning (CoPSL) framework, which learns the Pareto sets of multiple MOPs simultaneously in a collaborative manner. CoPSL particularly employs an architecture consisting of shared and MOP-specific layers. The shared layers are designed to capture commonalities among MOPs collaboratively, while the MOP-specific layers tailor these general insights to generate solution sets for individual MOPs. This collaborative approach enables CoPSL to efficiently learn the Pareto sets of multiple MOPs in a single execution while leveraging the potential relationships among various MOPs. To further understand these relationships, we experimentally demonstrate that shareable representations exist among MOPs. Leveraging these shared representations effectively improves the capability to approximate Pareto sets. Extensive experiments underscore the superior efficiency and robustness of CoPSL in approximating Pareto sets compared to state-of-the-art approaches on a variety of synthetic and real-world MOPs. Code is available at https://github.com/ckshang/CoPSL.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 1 Apr 2024.

Builds on

13 of 32 references.

References · 13

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Convex optimizationcited by 2,479
  3. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  4. 2018End-to-End Multi-Task Learning with Attentioncited by 533
  5. 2016Cross-stitch Networks for Multi-task Learningcited by 466
  6. 2016UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memorycited by 200
  7. 2020Learning the Pareto Front with Hypernetworkscited by 122
  8. 2020An Easy-to-use Real-world Multi-objective Optimization Problem Suitecited by 71
  9. 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
  10. 2022Pareto Set Learning for Expensive Multi-Objective Optimizationcited by 51
  11. 2021Scalable Pareto Front Approximation for Deep Multi-Objective Learningcited by 45
  12. 2022Improving Pareto Front Learning via Multi-Sample Hypernetworkscited by 16
1 more
  1. 2023A Framework for Controllable Pareto Front Learning with Completed Scalarization Functions and its Applicationscited by 13

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.