mlsanityData to 14 Oct 2026

Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learning

arXiv 2506.02392 ↗First posted 3 Jun 2025cs.LGcited by 12

Not on the map. Why?

Abstract (arXiv)

Neural Combinatorial Optimization (NCO) has emerged as a promising learning-based paradigm for addressing Vehicle Routing Problems (VRPs) by minimizing the need for extensive manual engineering. While existing NCO methods, trained on small-scale instances (e.g., 100 nodes), have demonstrated considerable success on problems of similar scale, their performance significantly degrades when applied to large-scale scenarios. This degradation arises from the distributional shift between training and testing data, rendering policies learned on small instances ineffective for larger problems. To overcome this limitation, we introduce a novel learning framework driven by Large Language Models (LLMs). This framework learns a projection between the training and testing distributions, which is then deployed to enhance the scalability of the NCO model. Notably, unlike prevailing techniques that necessitate joint training with the neural network, our approach operates exclusively during the inference phase, obviating the need for model retraining. Extensive experiments demonstrate that our method enables a backbone model (trained on 100-node instances) to achieve superior performance on large-scale Traveling Salesman Problem (TSP) and Capacitated Vehicle Routing Problem (CVRP) of up to 100K nodes from diverse distributions.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 56 of its 85 references that are in the map. First posted on arXiv 3 Jun 2025.

Builds on

56 of 85 references.

References · 56

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Pointer Networkscited by 895
  3. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
  4. 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
  5. 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
  6. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
  7. 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 333
  8. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 276
  9. 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
  10. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
  11. 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 221
  12. 2018Learning to Perform Local Rewriting for Combinatorial Optimizationcited by 185
38 more
  1. 2018Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Searchcited by 183
  2. 2019Learning Improvement Heuristics for Solving Routing Problemscited by 164
  3. 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 162
  4. 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 142
  5. 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
  6. 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 125
  7. 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
  8. 2021Learning to Delegate for Large-scale Vehicle Routingcited by 109
  9. 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 109
  10. 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
  11. 2021NeuroLKH: Combining Deep Learning Model with Lin-Kernighan-Helsgaun Heuristic for Solving the Traveling Salesman Problemcited by 103
  12. 2020Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learningcited by 100
  13. 2021Efficient Active Search for Combinatorial Optimization Problemscited by 100
  14. 2021Deep Policy Dynamic Programming for Vehicle Routing Problemscited by 94
  15. 2021Matrix Encoding Networks for Neural Combinatorial Optimizationcited by 91
  16. 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
  17. 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 85
  18. 2019Exploratory Combinatorial Optimization with Reinforcement Learningcited by 82
  19. 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 82
  20. 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 73
  21. 2021Graph Neural Network Guided Local Search for the Traveling Salesperson Problemcited by 70
  22. 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 70
  23. 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 69
  24. 2020Combining Reinforcement Learning and Constraint Programming for Combinatorial Optimizationcited by 63
  25. 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 62
  26. 2023Pointerformer: Deep Reinforced Multi-Pointer Transformer for the Traveling Salesman Problemcited by 50
  27. 2024Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalizationcited by 50
  28. 2024UDC: A Unified Neural Divide-and-Conquer Framework for Large-Scale Combinatorial Optimization Problemscited by 47
  29. 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimizationcited by 45
  30. 2024INViT: A Generalizable Routing Problem Solver with Invariant Nested View Transformercited by 44
  31. 2023H-TSP: Hierarchically Solving the Large-Scale Travelling Salesman Problemcited by 43
  32. 2024GOAL: A Generalist Combinatorial Optimization Agent Learnercited by 42
  33. 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 37
  34. 2024Self-Improvement for Neural Combinatorial Optimization: Sample without Replacement, but Improvementcited by 34
  35. 2024LLM4AD: A Platform for Algorithm Design with Large Language Modelcited by 33
  36. 2018Ranked Reward: Enabling Self-Play Reinforcement Learning for Combinatorial Optimizationcited by 27
  37. 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attentioncited by 24
  38. 2024DPN: Decoupling Partition and Navigation for Neural Solvers of Min-max Vehicle Routing Problemscited by 18

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 11.

12 papers.