mlsanityData to 14 Oct 2026

Learning to Reduce Search Space for Generalizable Neural Routing Solver

arXiv 2503.03137 ↗First posted 5 Mar 2025cs.AI cs.LG cs.NEcited by 14

Not on the map. Why?

Abstract (arXiv)

Constructive neural combinatorial optimization (NCO) offers a promising paradigm for solving vehicle routing problems (VRPs) by directly learning to construct approximate optimal solutions, thereby reducing reliance on expert knowledge for algorithm design. However, scaling these methods to handle large-scale instances remains challenging due to high computational complexity. While recent dynamic search space reduction (SSR) methods can improve inference efficiency through geometric distance-based pruning, they often struggle on complex instances with non-uniform distributions or when optimal solutions rely heavily on non-spatial constraints. To address this critical issue, we propose Learning to Reduce (L2R), which is the first learning-based dynamic SSR framework. L2R learns to adaptively prioritize nodes by extracting patterns from problem-specific features to prune the search space at each step, enabling efficient and scalable solution construction. Extensive experiments show that our L2R framework generalizes robustly to different problem scales and data distributions on various VRP variants. To the best of our knowledge, L2R is the first neural solver to effectively scale to VRP instances with 10 million nodes while maintaining high solution quality, which significantly pushes the frontier of NCO in terms of generalization and scalability. Our code is available at https://github.com/CIAM-Group/L2R.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 46 of its 86 references that are in the map. First posted on arXiv 5 Mar 2025.

Builds on

46 of 86 references.

References · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2016Layer Normalizationcited by 5,669
  5. 2015Pointer Networkscited by 895
  6. 2018Attention, Learn to Solve Routing Problems!cited by 656
  7. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
  8. 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
  9. 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
  10. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
  11. 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 333
  12. 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
34 more
  1. 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 221
  2. 2018Learning to Perform Local Rewriting for Combinatorial Optimizationcited by 185
  3. 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 162
  4. 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 142
  5. 2020Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learningcited by 140
  6. 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
  7. 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 125
  8. 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
  9. 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
  10. 2021Learning to Delegate for Large-scale Vehicle Routingcited by 109
  11. 2020Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problemscited by 100
  12. 2021Efficient Active Search for Combinatorial Optimization Problemscited by 100
  13. 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
  14. 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 85
  15. 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 82
  16. 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 70
  17. 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 69
  18. 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 62
  19. 2023Unsupervised Learning for Solving the Travelling Salesman Problemcited by 58
  20. 2023PyVRP: a high-performance VRP solver packagecited by 52
  21. 2024Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalizationcited by 50
  22. 2024UDC: A Unified Neural Divide-and-Conquer Framework for Large-Scale Combinatorial Optimization Problemscited by 47
  23. 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimizationcited by 45
  24. 2024INViT: A Generalizable Routing Problem Solver with Invariant Nested View Transformercited by 44
  25. 2023H-TSP: Hierarchically Solving the Large-Scale Travelling Salesman Problemcited by 43
  26. 2024Self-Improved Learning for Scalable Neural Combinatorial Optimizationcited by 29
  27. 2024Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problemscited by 24
  28. 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
  29. 2021An Overview and Experimental Study of Learning-based Optimization Algorithms for Vehicle Routing Problemcited by 22
  30. 2022Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop Schedulingcited by 20
  31. 2023Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speedcited by 19
  32. 2020Generalization of Machine Learning for Problem Reduction: A Case Study on Travelling Salesman Problemscited by 17
  33. 2024Distance-aware Attention Reshaping: Enhance Generalization of Neural Solver for Large-scale Vehicle Routing Problemscited by 15
  34. 2024Instance-Conditioned Adaptation for Large-scale Generalization of Neural Routing Solvercited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 7.

14 papers.

Sort:

By area: