mlsanityData to 7 Oct 2026

WeCon: An Efficient Weight-Conditioned Neural Solver for Multi-Objective Combinatorial Optimization Problems

arXiv 2605.22876 ↗First posted 20 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing neural solvers for Multi-Objective Combinatorial Optimization Problems (MOCOPs) commonly adopt decomposition-based strategies that scalarize a MOCOP into multiple subproblems associated with distinct weight vectors. However, they either inject weights only once during decoding, limiting weight-conditioned context modeling, or primarily during encoding, causing weight-signal dilution during decoding. Moreover, their preference optimization methods rely on purely random sampling to construct solution pairs for training solvers, which often produces less informative pairs and thus leads to low training effectiveness. To better address these limitations, we propose an efficient Weight-Conditioned neural solver (WeCon). Specifically, we design an encoder layer with three attention blocks and our proposed Gated Residual Fusion block to facilitate harmonious interaction between instance features and weights, thereby generating informative weight-conditioned context. We further introduce a plug-and-play Residual Fusion block in the decoder to alleviate weight-signal dilution. Finally, we propose Efficient Preference Optimization, which constructs high-quality solutions, thereby generating more informative pairs to improve training effectiveness. Experimental results on four MOCOP variants across different problem scales and distribution patterns demonstrate that WeCon achieves HyperVolume (HV) performance comparable to the state-of-the-art (SOTA) solver POCCO-W, while requiring approximately 40% less inference time. Moreover, the variant WeCon-CCO, which adopts an enhanced decoder, achieves the best overall HV performance with increased inference time. Ablation studies validate the contributions of all proposed designs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 54 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

27 of 54 references.

References · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019Root Mean Square Layer Normalizationcited by 1,425
  3. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  4. 2016Language Modeling with Gated Convolutional Networkscited by 688
  5. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
  6. 2019Deep Reinforcement Learning for Multi-objective Optimizationcited by 87
  7. 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 69
  8. 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 61
  9. 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
  10. 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problemscited by 54
  11. 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
  12. 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attentioncited by 23
15 more
  1. 2023Efficient Meta Neural Heuristic for Multi-Objective Combinatorial Optimizationcited by 21
  2. 2021Meta-Learning-Based Deep Reinforcement Learning for Multiobjective Optimization Problemscited by 20
  3. 2023Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speedcited by 19
  4. 2023Equity-Transformer: Solving NP-hard Min-Max Routing Problems as Sequential Generation with Equity Contextcited by 16
  5. 2025BOPO: Neural Combinatorial Optimization via Best-anchored and Objective-guided Preference Optimizationcited by 14
  6. 2020MODRL/D-AM: Multiobjective Deep Reinforcement Learning Algorithm Using Decomposition and Attention Model for Multiobjective Optimizationcited by 11
  7. 2025Preference Optimization for Combinatorial Optimization Problemscited by 11
  8. 2025An Efficient Diffusion-based Non-Autoregressive Solver for Traveling Salesman Problemcited by 9
  9. 2025SHIELD: Multi-task Multi-distribution Vehicle Routing Solver with Sparsity and Hierarchycited by 8
  10. 2025Preference-Driven Multi-Objective Combinatorial Optimization with Conditional Computationcited by 6
  11. 2025GELD: A Unified Neural Model for Efficiently Solving Traveling Salesman Problems Across Different Scalescited by 3
  12. 2025Efficient Neural Combinatorial Optimization Solver for the Min-max Heterogeneous Capacitated Vehicle Routing Problemcited by 3
  13. 2024Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networkscited by 2
  14. 2025Diversity Optimization for Travelling Salesman Problem via Deep Reinforcement Learningcited by 2
  15. 2025VAGPO: Vision-augmented Asymmetric Group Preference Optimization for Graph Routing Problemscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SSPO: Structure-Aware Similarity-Weighted Preference Optimization for Neural Combinatorial Optimization
  2. 2026Rethinking Efficiency in Neural Combinatorial Optimization: Batched Preference Optimization with Mamba
  3. 2025FrontierCO: Real-World and Large-Scale Evaluation of Machine Learning Solvers for Combinatorial Optimization
  4. 2026AutoPref: Automatic Discovery of Task-Specific Preference Objectives for Neural Combinatorial Optimization
  5. 2026HyCO: A Hybrid Neural Solver for Combinatorial Optimization
  6. 2024Unsupervised Training of Diffusion Models for Feasible Solution Generation in Neural Combinatorial Optimization
  7. 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimization
  8. 2025Boosting Cross-problem Generalization in Diffusion-Based Neural Combinatorial Solver via Inference Time Adaptation