A Game-Theoretic Approach for Improving Generalization Ability of TSP Solvers
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce a two-player zero-sum framework between a trainable Solver and a Data Generator to improve the generalization ability of deep learning-based solvers for Traveling Salesman Problem (TSP). Grounded in textslPolicy Space Response Oracle (PSRO) methods, our two-player framework outputs a population of best-responding Solvers, over which we can mix and output a combined model that achieves the least exploitability against the Generator, and thereby the most generalizable performance on different TSP tasks. We conduct experiments on a variety of TSP instances with different types and sizes. Results suggest that our Solvers achieve the state-of-the-art performance even on tasks the Solver never meets, whilst the performance of other deep learning-based Solvers drops sharply due to over-fitting. To demonstrate the principle of our framework, we study the learning outcome of the proposed two-player game and demonstrate that the exploitability of the Solver population decreases during training, and it eventually approximates the Nash equilibrium along with the Generator.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 23 of its 42 references that are in the map. First posted on arXiv 28 Oct 2021.
Builds on
23 of 42 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2017A Unified Game-Theoretic Approach to Multiagent Reinforcement Learningcited by 268
- 2019Learning Improvement Heuristics for Solving Routing Problemscited by 164
- 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 162
- 2019Open-ended Learning in Symmetric Zero-sum Gamescited by 96
- 2020Game-Theoretic Multiagent Reinforcement Learningcited by 94
- 2021Deep Policy Dynamic Programming for Vehicle Routing Problemscited by 94
11 more
- 2020Real World Games Look Like Spinning Topscited by 66
- 2019A Generalized Training Approach for Multiagent Learningcited by 54
- 2019α-Rank: Multi-Agent Evaluation by Evolutioncited by 51
- 2020Pipeline PSRO: A Scalable Approach for Finding Approximate Nash Equilibria in Large Gamescited by 47
- 2021Modelling Behavioural Diversity for Learning in Open-Ended Gamescited by 39
- 2021Diverse Auto-Curriculum is Critical for Successful Real-World Multiagent Learning Systemscited by 24
- 2021On the Complexity of Computing Markov Perfect Equilibrium in General-Sum Stochastic Gamescited by 19
- 2021Unifying Behavioral and Response Diversity for Open-ended Learning in Zero-sum Gamescited by 14
- 2021Iterative Empirical Game Solving via Single Policy Best Responsecited by 12
- 2021Measuring the Non-Transitivity in Chesscited by 10
- 2020Learning to Play against Any Mixture of Opponentscited by 8
Built on by
Citing papers per year: 2022: 3; 2023: 6; 2024: 3; 2025: 1; 2026: 1.
14 papers.
Sort:
By area:
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 221
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 85
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 69
- 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 62
- 2023ASP: Learn a Universal Neural Solver!cited by 27
- 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attentioncited by 24
- 2024Policy Space Response Oracles: A Surveycited by 10
- 2023Efficient Training of Multi-task Neural Solver for Combinatorial Optimizationcited by 6
- 2023General Method for Solving Four Types of SAT Problemscited by 4
- 2024Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solverscited by 3
- 2026Game-Theoretic Co-Evolution for LLM-Based Heuristic Discoverycited by 2
2 more
- 2026Game-Theoretic Co-Evolution for LLM-Based Heuristic Discovery30 Jan 2026
- 2025LRM-1B: Towards Large Routing Model4 Jul 2025
- 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attention30 Nov 2024
- 2024Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solvers14 Nov 2024
- 2024Policy Space Response Oracles: A Survey4 Mar 2024
- 2023General Method for Solving Four Types of SAT Problems27 Dec 2023
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-time13 Dec 2023
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problems31 May 2023
- 2023Efficient Training of Multi-task Neural Solver for Combinatorial Optimization10 May 2023
- 2023ASP: Learn a Universal Neural Solver!1 Mar 2023
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimization16 Feb 2023
- 2022NeuroPrim: An Attention-based Model for Solving NP-hard Spanning Tree Problems22 Oct 2022
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 85
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 69
- 2023ASP: Learn a Universal Neural Solver!cited by 27
- 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attentioncited by 24
- 2024Policy Space Response Oracles: A Surveycited by 10
- 2023Efficient Training of Multi-task Neural Solver for Combinatorial Optimizationcited by 6
- 2023General Method for Solving Four Types of SAT Problemscited by 4
- 2024Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solverscited by 3
- 2026Game-Theoretic Co-Evolution for LLM-Based Heuristic Discoverycited by 2
- 2022NeuroPrim: An Attention-based Model for Solving NP-hard Spanning Tree Problemscited by 1
- 2025LRM-1B: Towards Large Routing Modelcited by 0
- 2026Game-Theoretic Co-Evolution for LLM-Based Heuristic Discovery30 Jan 2026
- 2025LRM-1B: Towards Large Routing Model4 Jul 2025
- 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attention30 Nov 2024
- 2024Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solvers14 Nov 2024
- 2024Policy Space Response Oracles: A Survey4 Mar 2024
- 2023General Method for Solving Four Types of SAT Problems27 Dec 2023
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-time13 Dec 2023
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problems31 May 2023
- 2023Efficient Training of Multi-task Neural Solver for Combinatorial Optimization10 May 2023
- 2023ASP: Learn a Universal Neural Solver!1 Mar 2023
- 2022NeuroPrim: An Attention-based Model for Solving NP-hard Spanning Tree Problems22 Oct 2022
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problems8 Oct 2022