Graph Neural Network Guided Local Search for the Traveling Salesperson Problem
Not on the map. Why?
Abstract (arXiv)
Solutions to the Traveling Salesperson Problem (TSP) have practical applications to processes in transportation, logistics, and automation, yet must be computed with minimal delay to satisfy the real-time nature of the underlying tasks. However, solving large TSP instances quickly without sacrificing solution quality remains challenging for current approximate algorithms. To close this gap, we present a hybrid data-driven approach for solving the TSP based on Graph Neural Networks (GNNs) and Guided Local Search (GLS). Our model predicts the regret of including each edge of the problem graph in the solution; GLS uses these predictions in conjunction with the original problem graph to find solutions. Our experiments demonstrate that this approach converges to optimal solutions at a faster rate than three recent learning based approaches for the TSP. Notably, we reduce the mean optimality gap on the 100-node problem set from 1.534% to 0.705%, a 2x improvement. When generalizing from 20-node instances to the 100-node problem set, we reduce the optimality gap from 18.845% to 2.622%, a 7x improvement.
Key facts. Cited by 70 papers in the map (data through 14 Oct 2026). Builds on 21 of its 47 references that are in the map. First posted on arXiv 11 Oct 2021.
Builds on
21 of 47 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2015Pointer Networkscited by 895
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
9 more
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
- 2019Learning Improvement Heuristics for Solving Routing Problemscited by 164
- 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 162
- 2020Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learningcited by 100
- 2021Deep Policy Dynamic Programming for Vehicle Routing Problemscited by 94
- 2021Guidelines for the Computational Testing of Machine Learning approaches to Vehicle Routing Problemscited by 16
- 2021Exponential-Size Neighborhoods for the Pickup-and-Delivery Traveling Salesman Problemcited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 10; 2023: 14; 2024: 13; 2025: 20; 2026: 12.
70 papers.
Sort:
By area:
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 276
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 221
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 142
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 109
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 78
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 71
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 69
- 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
- 2023Algorithm Evolution Using Large Language Modelcited by 53
38 more
- 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimizationcited by 45
- 2022Unsupervised Learning for Combinatorial Optimization with Principled Objective Relaxationcited by 32
- 2024In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristicscited by 28
- 2024Cross-Problem Learning for Solving Vehicle Routing Problemscited by 24
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
- 2024Visual Reasoning and Multi-Agent Approach in Multimodal Large Language Models (MLLMs): Solving TSP and mTSP Combinatorial Challengescited by 21
- 2023Unsupervised Learning for Combinatorial Optimization Needs Meta-Learningcited by 20
- 2025Pareto Set Learning for Multi-Objective Reinforcement Learningcited by 20
- 2023Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speedcited by 19
- 2022Learning to Control Local Search for Combinatorial Optimizationcited by 18
- 2023Controlling Continuous Relaxation for Combinatorial Optimizationcited by 16
- 2022Reinforced Lin-Kernighan-Helsgaun Algorithms for the Traveling Salesman Problemscited by 12
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learningcited by 12
- 2022DeepSAT: An EDA-Driven Learning Framework for SATcited by 11
- 2024DISCO: Efficient Diffusion Solver for Large-Scale Combinatorial Optimization Problemscited by 11
- 2025Adversarial Generative Flow Network for Solving Vehicle Routing Problemscited by 10
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimizationcited by 9
- 2024Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimizationcited by 8
- 2024GREAT: A Graph Edge Attention Network for the Electric Vehicle Routing Problem with Asymmetric Costscited by 8
- 2026RADAR: Learning to Route with Asymmetry-aware DistAnce Representationscited by 8
- 2025Learning for routing: A guided review of recent developments and future directionscited by 7
- 2022Neural Combinatorial Optimization: a New Player in the Fieldcited by 6
- 2024Less Is More -- On the Importance of Sparsification for Transformers and Graph Neural Networks for TSPcited by 6
- 2023Reinforcement Learning-based Non-Autoregressive Solver for Traveling Salesman Problemscited by 5
- 2024Leader Reward for POMO-Based Neural Combinatorial Optimizationcited by 5
- 2024A Unified Framework for Combinatorial Optimization Based on Graph Neural Networkscited by 5
- 2025EFormer: An Effective Edge-based Transformer for Vehicle Routing Problemscited by 5
- 2022The Neural-Prediction based Acceleration Algorithm of Column Generation for Graph-Based Set Covering Problemscited by 4
- 2026Survey on Neural Routing Solverscited by 4
- 2022End-to-End Pareto Set Prediction with Graph Neural Networks for Multi-objective Facility Locationcited by 3
- 2023Revisit the Algorithm Selection Problem for TSP with Spatial Information Enhanced Graph Neural Networkscited by 3
- 2024Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solverscited by 3
- 2026Towards Efficient Constraint Handling in Neural Solvers for Routing Problemscited by 3
- 2025TuneNSearch: a hybrid transfer learning and local search approach for solving vehicle routing problemscited by 2
- 2025Beyond Simple Graphs: Neural Multi-Objective Routing on Multigraphscited by 2
- 2025Learning for Dynamic Combinatorial Optimization without Training Datacited by 1
- 2025Unsupervised Learning for the Elementary Shortest Path Problemcited by 1
- 2025ViTSP: A Vision Language Models Guided Framework for Solving Large-Scale Traveling Salesman Problemscited by 1
50 most cited of 70 All 70 (JSON)
- 2026RouteRepair: Instance-Level Failure Diagnosis and Targeted Repair in LLM-Based Automated Heuristic Design for Routing Optimization10 Sep 2026
- 2026Graph Neural Network-based Algorithm Selection for the Traveling Salesman Problem: A Systematic Study of Cost and Rank Losses under Distinct Budget Regimes21 Jul 2026
- 2026TSP with Predictions: Heatmap to Tour with Provable Guarantees4 Jul 2026
- 2026Towards Generalization-Oriented Models for Vehicle Routing Problems with Mixture-of-Experts26 May 2026
- 2026FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routing30 Apr 2026
- 2026UniHetCO: A Unified Heterogeneous Representation for Multi-Problem Learning in Unsupervised Neural Combinatorial Optimization12 Mar 2026
- 2026RADAR: Learning to Route with Asymmetry-aware DistAnce Representations3 Mar 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026Towards Efficient Constraint Handling in Neural Solvers for Routing Problems17 Feb 2026
- 2026Beyond Solving: Prescriptive Probing for Neural Routing Solvers6 Feb 2026
- 2026Test-Time Adaptation for Unsupervised Combinatorial Optimization28 Jan 2026
- 2026HeatACO: A Heatmap-Guided Max--Min Ant System for Large-Scale Travelling Salesman Problems26 Jan 2026
38 more
- 2025RoCo: Role-Based LLMs Collaboration for Automatic Heuristic Design3 Dec 2025
- 2025Using Multi-modal Large Language Model to Boost Fireworks Algorithm's Ability in Settling Challenging Optimization Tasks5 Nov 2025
- 2025ViTSP: A Vision Language Models Guided Framework for Solving Large-Scale Traveling Salesman Problems27 Sep 2025
- 2025Edge-Selector Model Applied for Local Search Neighborhood for Solving Vehicle Routing Problems12 Aug 2025
- 2025Hybrid Node-Destroyer Model with Large Neighborhood Search for Solving the Capacitated Vehicle Routing Problem12 Aug 2025
- 2025Unsupervised Learning for the Elementary Shortest Path Problem3 Aug 2025
- 2025Parametrized Multi-Agent Routing via Deep Attention Models30 Jul 2025
- 2025Learning for routing: A guided review of recent developments and future directions30 Jun 2025
- 2025Beyond Simple Graphs: Neural Multi-Objective Routing on Multigraphs27 Jun 2025
- 2025EFormer: An Effective Edge-based Transformer for Vehicle Routing Problems19 Jun 2025
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learning3 Jun 2025
- 2025RsGCN: Subgraph-Based Rescaling Enhances Generalization of GCNs for Solving Traveling Salesman Problems31 May 2025
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimization27 May 2025
- 2025Learning for Dynamic Combinatorial Optimization without Training Data26 May 2025
- 2025TuneNSearch: a hybrid transfer learning and local search approach for solving vehicle routing problems16 Mar 2025
- 2025Adversarial Generative Flow Network for Solving Vehicle Routing Problems3 Mar 2025
- 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimization5 Feb 2025
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Design15 Jan 2025
- 2025Pareto Set Learning for Multi-Objective Reinforcement Learning12 Jan 2025
- 2025Discovering new robust local search algorithms with neuro-evolution8 Jan 2025
- 2024Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solvers14 Nov 2024
- 2024In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristics7 Oct 2024
- 2024GREAT: A Graph Edge Attention Network for the Electric Vehicle Routing Problem with Asymmetric Costs29 Aug 2024
- 2024Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimization22 Aug 2024
- 2024DISCO: Efficient Diffusion Solver for Large-Scale Combinatorial Optimization Problems28 Jun 2024
- 2024Visual Reasoning and Multi-Agent Approach in Multimodal Large Language Models (MLLMs): Solving TSP and mTSP Combinatorial Challenges26 Jun 2024
- 2024A Unified Framework for Combinatorial Optimization Based on Graph Neural Networks19 Jun 2024
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectives1 Jun 2024
- 2024Leader Reward for POMO-Based Neural Combinatorial Optimization22 May 2024
- 2024Test-Time Augmentation for Traveling Salesperson Problem8 May 2024
- 2024Cross-Problem Learning for Solving Vehicle Routing Problems17 Apr 2024
- 2024Less Is More -- On the Importance of Sparsification for Transformers and Graph Neural Networks for TSP25 Mar 2024
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolution2 Feb 2024
- 2023Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed19 Dec 2023
- 2023Algorithm Evolution Using Large Language Model26 Nov 2023
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Opt27 Oct 2023
- 2023Graph Attention-based Deep Reinforcement Learning for solving the Chinese Postman Problem with Load-dependent costs24 Oct 2023
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalization12 Oct 2023
50 newest of 70 All 70 (JSON)
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 276
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 142
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 78
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 71
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 69
- 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
- 2023Algorithm Evolution Using Large Language Modelcited by 53
- 2022Unsupervised Learning for Combinatorial Optimization with Principled Objective Relaxationcited by 32
- 2024In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristicscited by 28
12 most cited of 60 All 60 (JSON)
- 2026RouteRepair: Instance-Level Failure Diagnosis and Targeted Repair in LLM-Based Automated Heuristic Design for Routing Optimization10 Sep 2026
- 2026Graph Neural Network-based Algorithm Selection for the Traveling Salesman Problem: A Systematic Study of Cost and Rank Losses under Distinct Budget Regimes21 Jul 2026
- 2026TSP with Predictions: Heatmap to Tour with Provable Guarantees4 Jul 2026
- 2026FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routing30 Apr 2026
- 2026UniHetCO: A Unified Heterogeneous Representation for Multi-Problem Learning in Unsupervised Neural Combinatorial Optimization12 Mar 2026
- 2026RADAR: Learning to Route with Asymmetry-aware DistAnce Representations3 Mar 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026Towards Efficient Constraint Handling in Neural Solvers for Routing Problems17 Feb 2026
- 2026Test-Time Adaptation for Unsupervised Combinatorial Optimization28 Jan 2026
- 2026HeatACO: A Heatmap-Guided Max--Min Ant System for Large-Scale Travelling Salesman Problems26 Jan 2026
- 2025RoCo: Role-Based LLMs Collaboration for Automatic Heuristic Design3 Dec 2025
- 2025Using Multi-modal Large Language Model to Boost Fireworks Algorithm's Ability in Settling Challenging Optimization Tasks5 Nov 2025
12 newest of 60 All 60 (JSON)