Neural Multi-Objective Combinatorial Optimization with Diversity Enhancement
Not on the map. Why?
Abstract (arXiv)
Most of existing neural methods for multi-objective combinatorial optimization (MOCO) problems solely rely on decomposition, which often leads to repetitive solutions for the respective subproblems, thus a limited Pareto set. Beyond decomposition, we propose a novel neural heuristic with diversity enhancement (NHDE) to produce more Pareto solutions from two perspectives. On the one hand, to hinder duplicated solutions for different subproblems, we propose an indicator-enhanced deep reinforcement learning method to guide the model, and design a heterogeneous graph attention mechanism to capture the relations between the instance graph and the Pareto front graph. On the other hand, to excavate more solutions in the neighborhood of each subproblem, we present a multiple Pareto optima strategy to sample and preserve desirable solutions. Experimental results on classic MOCO problems show that our NHDE is able to generate a Pareto front with higher diversity, thereby achieving superior overall performance. Moreover, our NHDE is generic and can be applied to different neural methods for MOCO.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 31 of its 56 references that are in the map. First posted on arXiv 22 Oct 2023.
Builds on
31 of 56 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2015Pointer Networkscited by 895
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 333
- 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 236
- 2019Pareto Multi-Task Learningcited by 224
- 2018Learning to Perform Local Rewriting for Combinatorial Optimizationcited by 185
19 more
- 2019Learning Improvement Heuristics for Solving Routing Problemscited by 164
- 2020Learning the Pareto Front with Hypernetworkscited by 125
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2020Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problemscited by 100
- 2021Matrix Encoding Networks for Neural Combinatorial Optimizationcited by 91
- 2019Deep Reinforcement Learning for Multi-objective Optimizationcited by 90
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 69
- 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 62
- 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
- 2022Pareto Set Learning for Expensive Multi-Objective Optimizationcited by 51
- 2022Efficient Neural Neighborhood Search for Pickup and Delivery Problemscited by 29
- 2021Meta-Learning-Based Deep Reinforcement Learning for Multiobjective Optimization Problemscited by 20
- 2020MODRL/D-AM: Multiobjective Deep Reinforcement Learning Algorithm Using Decomposition and Attention Model for Multiobjective Optimizationcited by 11
- 2016A Survey of Multi-Objective Optimization in Wireless Sensor Networks: Metrics, Algorithms and Open Problemscited by 9
- 2021MODRL/D-EL: Multiobjective Deep Reinforcement Learning with Evolutionary Learning for Multiobjective Optimizationcited by 8
- 2017PPLS/D: Parallel Pareto Local Search based on Decompositioncited by 3
- 2018Network Models for Multiobjective Discrete Optimizationcited by 3
- 2022HV-Net: Hypervolume Approximation based on DeepSetscited by 2
Built on by
Citing papers per year: 2024: 4; 2025: 6; 2026: 3.
13 papers.
Sort:
By area:
- 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 70
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 37
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyondcited by 18
- 2024Offline Multi-Objective Optimizationcited by 14
- 2025BOPO: Neural Combinatorial Optimization via Best-anchored and Objective-guided Preference Optimizationcited by 14
- 2025Pareto-Grid-Guided Large Language Models for Fast and High-Quality Heuristics Design in Multi-Objective Combinatorial Optimizationcited by 4
- 2025Bridging Synthetic and Real Routing Problems via LLM-Guided Instance Generation and Progressive Adaptationcited by 3
- 2024Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimizationcited by 2
- 2025Beyond Simple Graphs: Neural Multi-Objective Routing on Multigraphscited by 2
- 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPscited by 2
- 2026Two-Stage Learned Decomposition for Scalable Routing on Multigraphscited by 0
1 more
- 2026Top-k Pareto Bandits: Hypervolume Regret for Multi-Objective Slate Selection28 Jul 2026
- 2026Two-Stage Learned Decomposition for Scalable Routing on Multigraphs6 May 2026
- 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPs2 Mar 2026
- 2025Bridging Synthetic and Real Routing Problems via LLM-Guided Instance Generation and Progressive Adaptation13 Nov 2025
- 2025Pareto-Grid-Guided Large Language Models for Fast and High-Quality Heuristics Design in Multi-Objective Combinatorial Optimization28 Jul 2025
- 2025Beyond Simple Graphs: Neural Multi-Objective Routing on Multigraphs27 Jun 2025
- 2025BOPO: Neural Combinatorial Optimization via Best-anchored and Objective-guided Preference Optimization10 Mar 2025
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problems2 Mar 2025
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyond19 Jan 2025
- 2024Offline Multi-Objective Optimization6 Jun 2024
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectives1 Jun 2024
- 2024Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimization14 May 2024
1 more
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyondcited by 18
- 2024Offline Multi-Objective Optimizationcited by 14
- 2025Pareto-Grid-Guided Large Language Models for Fast and High-Quality Heuristics Design in Multi-Objective Combinatorial Optimizationcited by 4
- 2025Bridging Synthetic and Real Routing Problems via LLM-Guided Instance Generation and Progressive Adaptationcited by 3
- 2024Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimizationcited by 2
- 2025Beyond Simple Graphs: Neural Multi-Objective Routing on Multigraphscited by 2
- 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPscited by 2
- 2026Two-Stage Learned Decomposition for Scalable Routing on Multigraphscited by 0
- 2026Top-k Pareto Bandits: Hypervolume Regret for Multi-Objective Slate Selectioncited by 0
- 2026Top-k Pareto Bandits: Hypervolume Regret for Multi-Objective Slate Selection28 Jul 2026
- 2026Two-Stage Learned Decomposition for Scalable Routing on Multigraphs6 May 2026
- 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPs2 Mar 2026
- 2025Bridging Synthetic and Real Routing Problems via LLM-Guided Instance Generation and Progressive Adaptation13 Nov 2025
- 2025Pareto-Grid-Guided Large Language Models for Fast and High-Quality Heuristics Design in Multi-Objective Combinatorial Optimization28 Jul 2025
- 2025Beyond Simple Graphs: Neural Multi-Objective Routing on Multigraphs27 Jun 2025
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyond19 Jan 2025
- 2024Offline Multi-Objective Optimization6 Jun 2024
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectives1 Jun 2024
- 2024Context-aware Diversity Enhancement for Neural Multi-Objective Combinatorial Optimization14 May 2024