mlsanityData to 14 Oct 2026

Learning to Insert for Constructive Neural Vehicle Routing Solver

arXiv 2505.13904 ↗First posted 20 May 2025cs.LG cs.AI cs.ROcited by 10

Not on the map. Why?

Abstract (arXiv)

Neural Combinatorial Optimisation (NCO) is a promising learning-based approach for solving Vehicle Routing Problems (VRPs) without extensive manual design. While existing constructive NCO methods typically follow an appending-based paradigm that sequentially adds unvisited nodes to partial solutions, this rigid approach often leads to suboptimal results. To overcome this limitation, we explore the idea of insertion-based paradigm and propose Learning to Construct with Insertion-based Paradigm (L2C-Insert), a novel learning-based method for constructive NCO. Unlike traditional approaches, L2C-Insert builds solutions by strategically inserting unvisited nodes at any valid position in the current partial solution, which can significantly enhance the flexibility and solution quality. The proposed framework introduces three key components: a novel model architecture for precise insertion position prediction, an efficient training scheme for model optimization, and an advanced inference technique that fully exploits the insertion paradigm's flexibility. Extensive experiments on both synthetic and real-world instances of the Travelling Salesman Problem (TSP) and Capacitated Vehicle Routing Problem (CVRP) demonstrate that L2C-Insert consistently achieves superior performance across various problem sizes.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 57 of its 91 references that are in the map. First posted on arXiv 20 May 2025.

Builds on

57 of 91 references.

References · 57

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  5. 2015Pointer Networkscited by 895
  6. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
  7. 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
  8. 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
  9. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
  10. 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 333
  11. 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
  12. 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 221
38 more
  1. 2018Learning to Perform Local Rewriting for Combinatorial Optimizationcited by 185
  2. 2019Learning Improvement Heuristics for Solving Routing Problemscited by 164
  3. 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 162
  4. 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 142
  5. 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
  6. 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 125
  7. 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
  8. 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
  9. 2021Learning to Delegate for Large-scale Vehicle Routingcited by 109
  10. 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 109
  11. 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
  12. 2021NeuroLKH: Combining Deep Learning Model with Lin-Kernighan-Helsgaun Heuristic for Solving the Traveling Salesman Problemcited by 103
  13. 2020Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learningcited by 100
  14. 2020Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problemscited by 100
  15. 2021Efficient Active Search for Combinatorial Optimization Problemscited by 100
  16. 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
  17. 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 85
  18. 2022Simulation-guided Beam Search for Neural Combinatorial Optimizationcited by 84
  19. 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 82
  20. 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
  21. 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 62
  22. 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 62
  23. 2020Reinforcement Learning with Combinatorial Actions: An Application to Vehicle Routingcited by 61
  24. 2023Pointerformer: Deep Reinforced Multi-Pointer Transformer for the Traveling Salesman Problemcited by 50
  25. 2024UDC: A Unified Neural Divide-and-Conquer Framework for Large-Scale Combinatorial Optimization Problemscited by 47
  26. 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimizationcited by 45
  27. 2024INViT: A Generalizable Routing Problem Solver with Invariant Nested View Transformercited by 44
  28. 2023H-TSP: Hierarchically Solving the Large-Scale Travelling Salesman Problemcited by 43
  29. 2024GOAL: A Generalist Combinatorial Optimization Agent Learnercited by 42
  30. 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 37
  31. 2024PolyNet: Learning Diverse Solution Strategies for Neural Combinatorial Optimizationcited by 35
  32. 2024Self-Improvement for Neural Combinatorial Optimization: Sample without Replacement, but Improvementcited by 34
  33. 2024Self-Improved Learning for Scalable Neural Combinatorial Optimizationcited by 29
  34. 2024Learning to Handle Complex Constraints for Vehicle Routing Problemscited by 29
  35. 2024Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problemscited by 24
  36. 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attentioncited by 24
  37. 2023Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speedcited by 19
  38. 2024DPN: Decoupling Partition and Navigation for Neural Solvers of Min-max Vehicle Routing Problemscited by 18

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 8.

10 papers.