Learning to Reduce Search Space for Generalizable Neural Routing Solver
Not on the map. Why?
Abstract (arXiv)
Constructive neural combinatorial optimization (NCO) offers a promising paradigm for solving vehicle routing problems (VRPs) by directly learning to construct approximate optimal solutions, thereby reducing reliance on expert knowledge for algorithm design. However, scaling these methods to handle large-scale instances remains challenging due to high computational complexity. While recent dynamic search space reduction (SSR) methods can improve inference efficiency through geometric distance-based pruning, they often struggle on complex instances with non-uniform distributions or when optimal solutions rely heavily on non-spatial constraints. To address this critical issue, we propose Learning to Reduce (L2R), which is the first learning-based dynamic SSR framework. L2R learns to adaptively prioritize nodes by extracting patterns from problem-specific features to prune the search space at each step, enabling efficient and scalable solution construction. Extensive experiments show that our L2R framework generalizes robustly to different problem scales and data distributions on various VRP variants. To the best of our knowledge, L2R is the first neural solver to effectively scale to VRP instances with 10 million nodes while maintaining high solution quality, which significantly pushes the frontier of NCO in terms of generalization and scalability. Our code is available at https://github.com/CIAM-Group/L2R.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 46 of its 86 references that are in the map. First posted on arXiv 5 Mar 2025.
Builds on
46 of 86 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Layer Normalizationcited by 5,669
- 2015Pointer Networkscited by 895
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 333
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
34 more
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 221
- 2018Learning to Perform Local Rewriting for Combinatorial Optimizationcited by 185
- 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 162
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 142
- 2020Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learningcited by 140
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
- 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 125
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
- 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
- 2021Learning to Delegate for Large-scale Vehicle Routingcited by 109
- 2020Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problemscited by 100
- 2021Efficient Active Search for Combinatorial Optimization Problemscited by 100
- 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 85
- 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 82
- 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 70
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 69
- 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 62
- 2023Unsupervised Learning for Solving the Travelling Salesman Problemcited by 58
- 2023PyVRP: a high-performance VRP solver packagecited by 52
- 2024Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalizationcited by 50
- 2024UDC: A Unified Neural Divide-and-Conquer Framework for Large-Scale Combinatorial Optimization Problemscited by 47
- 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimizationcited by 45
- 2024INViT: A Generalizable Routing Problem Solver with Invariant Nested View Transformercited by 44
- 2023H-TSP: Hierarchically Solving the Large-Scale Travelling Salesman Problemcited by 43
- 2024Self-Improved Learning for Scalable Neural Combinatorial Optimizationcited by 29
- 2024Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problemscited by 24
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
- 2021An Overview and Experimental Study of Learning-based Optimization Algorithms for Vehicle Routing Problemcited by 22
- 2022Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop Schedulingcited by 20
- 2023Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speedcited by 19
- 2020Generalization of Machine Learning for Problem Reduction: A Case Study on Travelling Salesman Problemscited by 17
- 2024Distance-aware Attention Reshaping: Enhance Generalization of Neural Solver for Large-scale Vehicle Routing Problemscited by 15
- 2024Instance-Conditioned Adaptation for Large-scale Generalization of Neural Routing Solvercited by 9
Built on by
Citing papers per year: 2025: 7; 2026: 7.
14 papers.
Sort:
By area:
- 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solvercited by 13
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learningcited by 12
- 2025Learning to Insert for Constructive Neural Vehicle Routing Solvercited by 10
- 2025Rethinking Neural Combinatorial Optimization for Vehicle Routing Problems with Different Constraint Tightness Degreescited by 8
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalizationcited by 8
- 2025Learning to Segment for Vehicle Routing Problemscited by 5
- 2026Survey on Neural Routing Solverscited by 4
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solvercited by 2
- 2025Adaptation and Fine-tuning with TabPFN for Travelling Salesman Problemcited by 1
- 2026Efficient Decoder Scaling Strategy for Neural Routing Solverscited by 1
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solvercited by 1
- 2026Keep Rehearsing and Refining: Lifelong Learning Vehicle Routing under Continually Drifting Taskscited by 0
- 2026MiLoop: Selective Memory Propagation for Neural Combinatorial Optimization1 Oct 2026
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solver23 May 2026
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solver11 May 2026
- 2026Machine Learning-based Two-Stage Graph Sparsification for the Travelling Salesman Problem22 Apr 2026
- 2026Efficient Decoder Scaling Strategy for Neural Routing Solvers28 Feb 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026Keep Rehearsing and Refining: Lifelong Learning Vehicle Routing under Continually Drifting Tasks30 Jan 2026
- 2025Adaptation and Fine-tuning with TabPFN for Travelling Salesman Problem8 Nov 2025
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalization27 Sep 2025
- 2025Learning to Segment for Vehicle Routing Problems22 Jun 2025
- 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver3 Jun 2025
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learning3 Jun 2025
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learningcited by 12
- 2025Learning to Insert for Constructive Neural Vehicle Routing Solvercited by 10
- 2025Rethinking Neural Combinatorial Optimization for Vehicle Routing Problems with Different Constraint Tightness Degreescited by 8
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalizationcited by 8
- 2025Learning to Segment for Vehicle Routing Problemscited by 5
- 2026Survey on Neural Routing Solverscited by 4
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solvercited by 2
- 2025Adaptation and Fine-tuning with TabPFN for Travelling Salesman Problemcited by 1
- 2026Efficient Decoder Scaling Strategy for Neural Routing Solverscited by 1
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solvercited by 1
- 2026Keep Rehearsing and Refining: Lifelong Learning Vehicle Routing under Continually Drifting Taskscited by 0
- 2026Machine Learning-based Two-Stage Graph Sparsification for the Travelling Salesman Problemcited by 0
12 most cited of 13 All 13 (JSON)
- 2026MiLoop: Selective Memory Propagation for Neural Combinatorial Optimization1 Oct 2026
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solver23 May 2026
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solver11 May 2026
- 2026Machine Learning-based Two-Stage Graph Sparsification for the Travelling Salesman Problem22 Apr 2026
- 2026Efficient Decoder Scaling Strategy for Neural Routing Solvers28 Feb 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026Keep Rehearsing and Refining: Lifelong Learning Vehicle Routing under Continually Drifting Tasks30 Jan 2026
- 2025Adaptation and Fine-tuning with TabPFN for Travelling Salesman Problem8 Nov 2025
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalization27 Sep 2025
- 2025Learning to Segment for Vehicle Routing Problems22 Jun 2025
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learning3 Jun 2025
- 2025Rethinking Neural Combinatorial Optimization for Vehicle Routing Problems with Different Constraint Tightness Degrees30 May 2025
12 newest of 13 All 13 (JSON)