Neural Solver Selection for Combinatorial Optimization
Not on the map. Why?
Abstract (arXiv)
Machine learning has increasingly been employed to solve NP-hard combinatorial optimization problems, resulting in the emergence of neural solvers that demonstrate remarkable performance, even with minimal domain-specific knowledge. To date, the community has created numerous open-source neural solvers with distinct motivations and inductive biases. While considerable efforts are devoted to designing powerful single solvers, our findings reveal that existing solvers typically demonstrate complementary performance across different problem instances. This suggests that significant improvements could be achieved through effective coordination of neural solvers at the instance level. In this work, we propose the first general framework to coordinate the neural solvers, which involves feature extraction, selection model, and selection strategy, aiming to allocate each instance to the most suitable solvers. To instantiate, we collect several typical neural solvers with state-of-the-art performance as alternatives, and explore various methods for each component of the framework. We evaluated our framework on two extensively studied combinatorial optimization problems, Traveling Salesman Problem (TSP) and Capacitated Vehicle Routing Problem (CVRP). Experimental results show that the proposed framework can effectively distribute instances and the resulting composite solver can achieve significantly better performance (e.g., reduce the optimality gap by 0.88% on TSPLIB and 0.71% on CVRPLIB) than the best individual neural solver with little extra time cost.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 49 of its 71 references that are in the map. First posted on arXiv 13 Oct 2024.
Builds on
49 of 71 references.
References · 49
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Graph Attention Networkscited by 8,854
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2015Pointer Networkscited by 882
- 2018Attention, Learn to Solve Routing Problems!cited by 646
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 557
- 2019Self-Attention Graph Poolingcited by 421
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 327
37 more
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 265
- 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 260
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
- 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 161
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 140
- 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 122
- 2018Automated Algorithm Selection: Survey and Perspectivescited by 111
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2020Learning the Travelling Salesperson Problem Requires Rethinking Generalizationcited by 96
- 2021Matrix Encoding Networks for Neural Combinatorial Optimizationcited by 89
- 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 82
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
- 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 69
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 68
- 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 61
- 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 61
- 2024Graph Neural Networks for Learning Equivariant Representations of Neural Networkscited by 59
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 58
- 2022Winner Takes It All: Training Performant RL Populations for Combinatorial Optimizationcited by 57
- 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
- 2024UDC: A Unified Neural Divide-and-Conquer Framework for Large-Scale Combinatorial Optimization Problemscited by 45
- 2024INViT: A Generalizable Routing Problem Solver with Invariant Nested View Transformercited by 43
- 2022Can Push-forward Generative Models Fit Multimodal Distributions?cited by 41
- 2023Combinatorial Optimization with Policy Adaptation using Latent Space Searchcited by 41
- 2023Model Spider: Learning to Rank Pre-Trained Models Efficientlycited by 32
- 2022Learning to Solve Routing Problems via Distributionally Robust Optimizationcited by 31
- 2023ASP: Learn a Universal Neural Solver!cited by 27
- 2022On the Generalization of Neural Combinatorial Optimization Heuristicscited by 24
- 2023Large Language Model-Enhanced Algorithm Selection: Towards Comprehensive Algorithm Representationcited by 21
- 2020Deep Learning as a Competitive Feature-Free Approach for Automated Algorithm Selection on the Traveling Salesperson Problemcited by 11
- 2024Hierarchical Neural Constructive Solver for Real-world TSP Scenarioscited by 9
- 2024Prompt Learning for Generalized Vehicle Routingcited by 6
- 2021Zero Training Overhead Portfolios for Learning to Solve Combinatorial Problemscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025ASAP: Exploiting the Satisficing Generalization Edge in Neural Combinatorial Optimizationcited by 1
- 2026Leveraging Structural Constraints for Diffusion-based Neural TSP Solverscited by 1
- 2026EGAM: Extended Graph Attention Model for Solving Routing Problemscited by 0
- 2026Algorithm Selection with Zero Domain Knowledge via Text Embeddingscited by 0
- 2026Sampling Luck Masquerades as Allocation Gain: Auditing Test-Time Budget Allocation for Neural Combinatorial Optimizationcited by 0
- 2026Sampling Luck Masquerades as Allocation Gain: Auditing Test-Time Budget Allocation for Neural Combinatorial Optimization13 Aug 2026
- 2026Leveraging Structural Constraints for Diffusion-based Neural TSP Solvers8 Jun 2026
- 2026Algorithm Selection with Zero Domain Knowledge via Text Embeddings20 Mar 2026
- 2026EGAM: Extended Graph Attention Model for Solving Routing Problems29 Jan 2026
- 2025ASAP: Exploiting the Satisficing Generalization Edge in Neural Combinatorial Optimization29 Jan 2025