Graph Neural Networks are Heuristics
Not on the map. Why?
Abstract (arXiv)
Graph neural networks are usually treated as auxiliaries for combinatorial optimization: they imitate algorithms, guide search, or supply scores to classical procedures. We show that this auxiliary role is not intrinsic. A GNN can itself be a heuristic. For the Euclidean Travelling Salesman Problem, we train a non-autoregressive GNN with no labels, rewards, sequential decoding, search, or local improvement. A differentiable Hamiltonian-cycle objective is the only supervision. The trained model produces a complete tour in one forward pass, while dropout and snapshots from a single training trajectory provide solution diversity without engineered moves. The heuristic is therefore learned, not programmed. It is also fast: batched inference remains in the millisecond regime on GPUs. Experiments on TSP100, TSP200, and TSP500 show that the model consistently improves over nearest-neighbor greedy baselines. These results identify unsupervised GNNs as a class of fast learned heuristics for combinatorial optimization.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
16 of 23 references.
References · 16
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2017Snapshot Ensembles: Train 1, get M for freecited by 350
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
- 2018Learning Latent Permutations with Gumbel-Sinkhorn Networkscited by 175
- 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 162
- 2023Unsupervised Learning for Solving the Travelling Salesman Problemcited by 58
- 2022Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent setcited by 33
- 2022Can Hybrid Geometric Scattering Networks Help Solve the Maximum Clique Problem?cited by 25
- 2022Inability of a graph neural network heuristic to outperform greedy algorithms in solving combinatorial optimization problems like Max-Cutcited by 19
4 more
- 2020A (Slightly) Improved Approximation Algorithm for Metric TSPcited by 13
- 2023Reply to: Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent setcited by 9
- 2023Reply to: Inability of a graph neural network heuristic to outperform greedy algorithms in solving combinatorial optimization problemscited by 5
- 2025Structure As Search: Unsupervised Permutation Learning for Combinatorial Optimizationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.