Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimization
Not on the map. Why?
Abstract (arXiv)
Multi-objective optimization can be found in many real-world applications where some conflicting objectives can not be optimized by a single solution. Existing optimization methods often focus on finding a set of Pareto solutions with different optimal trade-offs among the objectives. However, the required number of solutions to well approximate the whole Pareto optimal set could be exponentially large with respect to the number of objectives, which makes these methods unsuitable for handling many optimization objectives. In this work, instead of finding a dense set of Pareto solutions, we propose a novel Tchebycheff set scalarization method to find a few representative solutions (e.g., 5) to cover a large number of objectives (e.g., >100) in a collaborative and complementary manner. In this way, each objective can be well addressed by at least one solution in the small solution set. In addition, we further develop a smooth Tchebycheff set scalarization approach for efficient optimization with good theoretical guarantees. Experimental studies on different problems with many optimization objectives demonstrate the effectiveness of our proposed method.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 31 of its 75 references that are in the map. First posted on arXiv 30 May 2024.
Builds on
31 of 75 references.
References · 31
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2021Convex optimizationcited by 2,479
- 2020Gradient Surgery for Multi-Task Learningcited by 1,210
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 441
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 367
- 2021A Practical Guide to Multi-Objective Reinforcement Learning and Planningcited by 240
- 2014A Survey of Multi-Objective Sequential Decision-Makingcited by 229
- 2019Pareto Multi-Task Learningcited by 224
- 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 218
- 2022Multi-Task Learning as a Bargaining Gamecited by 209
- 2021Reasonable Effectiveness of Random Weighting: A Litmus Test for Multi-Task Learningcited by 100
19 more
- 2022Multi-Objective GFlowNetscited by 100
- 2020GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement Learningcited by 89
- 2023FAMO: Fast Adaptive Multitask Optimizationcited by 74
- 2022Auto-Lambda: Disentangling Dynamic Task Relationshipscited by 73
- 2023Independent Component Alignment for Multi-Task Learningcited by 69
- 2022In Defense of the Unitary Scalarization for Deep Multi-Task Learningcited by 65
- 2022Do Current Multi-Task Optimization Methods in Deep Learning Even Help?cited by 60
- 2020Efficient Continuous Pareto Exploration in Multi-Task Learningcited by 57
- 2023Revisiting Scalarization in Multi-Task Learning: A Theoretical Perspectivecited by 51
- 2024Smooth Tchebycheff Scalarization for Multi-Objective Optimizationcited by 50
- 2023Sample-efficient Multi-objective Molecular Optimization with GFlowNetscited by 48
- 2019The stochastic multi-gradient algorithm for multi-objective optimization and its application to supervised machine learningcited by 45
- 2023Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidancecited by 35
- 2015On Graduated Optimization for Stochastic Non-Convex Problemscited by 34
- 2023Direction-oriented Multi-objective Learning: Simple and Provable Stochastic Algorithmscited by 33
- 2024Robust Multi-Task Learning with Excess Riskscited by 23
- 2023Scalarization for Multi-Task and Multi-Domain Learning at Scalecited by 19
- 2024Many-Objective Multi-Solution Transportcited by 5
- 2024Efficient Algorithms for Sum-of-Minimum Optimizationcited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 6.
15 papers.
Sort:
By area:
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyondcited by 15
- 2025Balanced Rate-Distortion Optimization in Learned Image Compressioncited by 5
- 2025AReUReDi: Annealed Rectified Updates for Refining Discrete Flows with Multi-Objective Guidancecited by 5
- 2024Federated Communication-Efficient Multi-Objective Optimizationcited by 3
- 2026UniARM: Towards a Unified Autoregressive Reward Model for Multi-Objective Test-Time Alignmentcited by 3
- 2025FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimizationcited by 2
- 2026Do We Really Need to Approach the Entire Pareto Front in Many-Objective Bayesian Optimisation?cited by 2
- 2025MOS-Attack: A Scalable Multi-objective Adversarial Attack Frameworkcited by 1
- 2025Covering Multiple Objectives with a Small Set of Solutions Using Bayesian Optimizationcited by 0
- 2025A study of EHVI vs fixed scalarization for molecule designcited by 0
- 2025Enabling Pareto-Stationarity Exploration in Multi-Objective Reinforcement Learning: A Multi-Objective Weighted-Chebyshev Actor-Critic Approachcited by 0
- 2026Quality-Diversity Optimization as Multi-Objective Optimizationcited by 0
- 2026Multi-Objective Exploration and Preference Optimization via Mutual Information1 Jul 2026
- 2026Adaptive Smooth Tchebycheff Attention for Multi-Objective Policy Optimization12 May 2026
- 2026Do We Really Need to Approach the Entire Pareto Front in Many-Objective Bayesian Optimisation?10 Apr 2026
- 2026Few-for-Many Personalized Federated Learning12 Mar 2026
- 2026UniARM: Towards a Unified Autoregressive Reward Model for Multi-Objective Test-Time Alignment10 Feb 2026
- 2026Quality-Diversity Optimization as Multi-Objective Optimization31 Jan 2026
- 2025AReUReDi: Annealed Rectified Updates for Refining Discrete Flows with Multi-Objective Guidance30 Sep 2025
- 2025FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimization3 Sep 2025
- 2025Enabling Pareto-Stationarity Exploration in Multi-Objective Reinforcement Learning: A Multi-Objective Weighted-Chebyshev Actor-Critic Approach29 Jul 2025
- 2025A study of EHVI vs fixed scalarization for molecule design18 Jul 2025
- 2025Balanced Rate-Distortion Optimization in Learned Image Compression27 Feb 2025
- 2025Covering Multiple Objectives with a Small Set of Solutions Using Bayesian Optimization31 Jan 2025
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyondcited by 15
- 2025Balanced Rate-Distortion Optimization in Learned Image Compressioncited by 5
- 2025AReUReDi: Annealed Rectified Updates for Refining Discrete Flows with Multi-Objective Guidancecited by 5
- 2024Federated Communication-Efficient Multi-Objective Optimizationcited by 3
- 2025FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimizationcited by 2
- 2026Do We Really Need to Approach the Entire Pareto Front in Many-Objective Bayesian Optimisation?cited by 2
- 2025MOS-Attack: A Scalable Multi-objective Adversarial Attack Frameworkcited by 1
- 2025Covering Multiple Objectives with a Small Set of Solutions Using Bayesian Optimizationcited by 0
- 2025A study of EHVI vs fixed scalarization for molecule designcited by 0
- 2025Enabling Pareto-Stationarity Exploration in Multi-Objective Reinforcement Learning: A Multi-Objective Weighted-Chebyshev Actor-Critic Approachcited by 0
- 2026Quality-Diversity Optimization as Multi-Objective Optimizationcited by 0
- 2026Few-for-Many Personalized Federated Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Adaptive Smooth Tchebycheff Attention for Multi-Objective Policy Optimization12 May 2026
- 2026Do We Really Need to Approach the Entire Pareto Front in Many-Objective Bayesian Optimisation?10 Apr 2026
- 2026Few-for-Many Personalized Federated Learning12 Mar 2026
- 2026Quality-Diversity Optimization as Multi-Objective Optimization31 Jan 2026
- 2025AReUReDi: Annealed Rectified Updates for Refining Discrete Flows with Multi-Objective Guidance30 Sep 2025
- 2025FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimization3 Sep 2025
- 2025Enabling Pareto-Stationarity Exploration in Multi-Objective Reinforcement Learning: A Multi-Objective Weighted-Chebyshev Actor-Critic Approach29 Jul 2025
- 2025A study of EHVI vs fixed scalarization for molecule design18 Jul 2025
- 2025Balanced Rate-Distortion Optimization in Learned Image Compression27 Feb 2025
- 2025Covering Multiple Objectives with a Small Set of Solutions Using Bayesian Optimization31 Jan 2025
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyond19 Jan 2025
- 2025MOS-Attack: A Scalable Multi-objective Adversarial Attack Framework13 Jan 2025
12 newest of 13 All 13 (JSON)