mlsanityData to 7 Oct 2026

Neural Solver Selection for Combinatorial Optimization

arXiv 2410.09693 ↗First posted 13 Oct 2024math.OC cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Machine learning has increasingly been employed to solve NP-hard combinatorial optimization problems, resulting in the emergence of neural solvers that demonstrate remarkable performance, even with minimal domain-specific knowledge. To date, the community has created numerous open-source neural solvers with distinct motivations and inductive biases. While considerable efforts are devoted to designing powerful single solvers, our findings reveal that existing solvers typically demonstrate complementary performance across different problem instances. This suggests that significant improvements could be achieved through effective coordination of neural solvers at the instance level. In this work, we propose the first general framework to coordinate the neural solvers, which involves feature extraction, selection model, and selection strategy, aiming to allocate each instance to the most suitable solvers. To instantiate, we collect several typical neural solvers with state-of-the-art performance as alternatives, and explore various methods for each component of the framework. We evaluated our framework on two extensively studied combinatorial optimization problems, Traveling Salesman Problem (TSP) and Capacitated Vehicle Routing Problem (CVRP). Experimental results show that the proposed framework can effectively distribute instances and the resulting composite solver can achieve significantly better performance (e.g., reduce the optimality gap by 0.88% on TSPLIB and 0.71% on CVRPLIB) than the best individual neural solver with little extra time cost.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 49 of its 71 references that are in the map. First posted on arXiv 13 Oct 2024.

Builds on

49 of 71 references.

References · 49

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2017Graph Attention Networkscited by 8,854
  4. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  5. 2015Pointer Networkscited by 882
  6. 2018Attention, Learn to Solve Routing Problems!cited by 646
  7. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
  8. 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
  9. 2017Learning Combinatorial Optimization Algorithms over Graphscited by 557
  10. 2019Self-Attention Graph Poolingcited by 421
  11. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
  12. 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 327
37 more
  1. 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
  2. 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 265
  3. 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 260
  4. 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
  5. 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 161
  6. 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 140
  7. 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 122
  8. 2018Automated Algorithm Selection: Survey and Perspectivescited by 111
  9. 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
  10. 2020Learning the Travelling Salesperson Problem Requires Rethinking Generalizationcited by 96
  11. 2021Matrix Encoding Networks for Neural Combinatorial Optimizationcited by 89
  12. 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
  13. 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 82
  14. 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
  15. 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
  16. 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
  17. 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 69
  18. 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 68
  19. 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 61
  20. 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 61
  21. 2024Graph Neural Networks for Learning Equivariant Representations of Neural Networkscited by 59
  22. 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 58
  23. 2022Winner Takes It All: Training Performant RL Populations for Combinatorial Optimizationcited by 57
  24. 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
  25. 2024UDC: A Unified Neural Divide-and-Conquer Framework for Large-Scale Combinatorial Optimization Problemscited by 45
  26. 2024INViT: A Generalizable Routing Problem Solver with Invariant Nested View Transformercited by 43
  27. 2022Can Push-forward Generative Models Fit Multimodal Distributions?cited by 41
  28. 2023Combinatorial Optimization with Policy Adaptation using Latent Space Searchcited by 41
  29. 2023Model Spider: Learning to Rank Pre-Trained Models Efficientlycited by 32
  30. 2022Learning to Solve Routing Problems via Distributionally Robust Optimizationcited by 31
  31. 2023ASP: Learn a Universal Neural Solver!cited by 27
  32. 2022On the Generalization of Neural Combinatorial Optimization Heuristicscited by 24
  33. 2023Large Language Model-Enhanced Algorithm Selection: Towards Comprehensive Algorithm Representationcited by 21
  34. 2020Deep Learning as a Competitive Feature-Free Approach for Automated Algorithm Selection on the Traveling Salesperson Problemcited by 11
  35. 2024Hierarchical Neural Constructive Solver for Real-world TSP Scenarioscited by 9
  36. 2024Prompt Learning for Generalized Vehicle Routingcited by 6
  37. 2021Zero Training Overhead Portfolios for Learning to Solve Combinatorial Problemscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.