mlsanityData to 7 Oct 2026

Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimization

arXiv 2405.19650 ↗First posted 30 May 2024cs.LG cs.AI cs.NEcited by 15

Not on the map. Why?

Abstract (arXiv)

Multi-objective optimization can be found in many real-world applications where some conflicting objectives can not be optimized by a single solution. Existing optimization methods often focus on finding a set of Pareto solutions with different optimal trade-offs among the objectives. However, the required number of solutions to well approximate the whole Pareto optimal set could be exponentially large with respect to the number of objectives, which makes these methods unsuitable for handling many optimization objectives. In this work, instead of finding a dense set of Pareto solutions, we propose a novel Tchebycheff set scalarization method to find a few representative solutions (e.g., 5) to cover a large number of objectives (e.g., >100) in a collaborative and complementary manner. In this way, each objective can be well addressed by at least one solution in the small solution set. In addition, we further develop a smooth Tchebycheff set scalarization approach for efficient optimization with good theoretical guarantees. Experimental studies on different problems with many optimization objectives demonstrate the effectiveness of our proposed method.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 31 of its 75 references that are in the map. First posted on arXiv 30 May 2024.

Builds on

31 of 75 references.

References · 31

  1. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  2. 2021Convex optimizationcited by 2,479
  3. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  4. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
  5. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 441
  6. 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 367
  7. 2021A Practical Guide to Multi-Objective Reinforcement Learning and Planningcited by 240
  8. 2014A Survey of Multi-Objective Sequential Decision-Makingcited by 229
  9. 2019Pareto Multi-Task Learningcited by 224
  10. 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 218
  11. 2022Multi-Task Learning as a Bargaining Gamecited by 209
  12. 2021Reasonable Effectiveness of Random Weighting: A Litmus Test for Multi-Task Learningcited by 100
19 more
  1. 2022Multi-Objective GFlowNetscited by 100
  2. 2020GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement Learningcited by 89
  3. 2023FAMO: Fast Adaptive Multitask Optimizationcited by 74
  4. 2022Auto-Lambda: Disentangling Dynamic Task Relationshipscited by 73
  5. 2023Independent Component Alignment for Multi-Task Learningcited by 69
  6. 2022In Defense of the Unitary Scalarization for Deep Multi-Task Learningcited by 65
  7. 2022Do Current Multi-Task Optimization Methods in Deep Learning Even Help?cited by 60
  8. 2020Efficient Continuous Pareto Exploration in Multi-Task Learningcited by 57
  9. 2023Revisiting Scalarization in Multi-Task Learning: A Theoretical Perspectivecited by 51
  10. 2024Smooth Tchebycheff Scalarization for Multi-Objective Optimizationcited by 50
  11. 2023Sample-efficient Multi-objective Molecular Optimization with GFlowNetscited by 48
  12. 2019The stochastic multi-gradient algorithm for multi-objective optimization and its application to supervised machine learningcited by 45
  13. 2023Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidancecited by 35
  14. 2015On Graduated Optimization for Stochastic Non-Convex Problemscited by 34
  15. 2023Direction-oriented Multi-objective Learning: Simple and Provable Stochastic Algorithmscited by 33
  16. 2024Robust Multi-Task Learning with Excess Riskscited by 23
  17. 2023Scalarization for Multi-Task and Multi-Domain Learning at Scalecited by 19
  18. 2024Many-Objective Multi-Solution Transportcited by 5
  19. 2024Efficient Algorithms for Sum-of-Minimum Optimizationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 6.

15 papers.

Sort:

By area: