Symmetry-preserving graph attention network to solve routing problems at multiple resolutions
Not on the map. Why?
Abstract (arXiv)
Travelling Salesperson Problems (TSPs) and Vehicle Routing Problems (VRPs) have achieved reasonable improvement in accuracy and computation time with the adaptation of Machine Learning (ML) methods. However, none of the previous works completely respects the symmetries arising from TSPs and VRPs including rotation, translation, permutation, and scaling. In this work, we introduce the first-ever completely equivariant model and training to solve combinatorial problems. Furthermore, it is essential to capture the multiscale structure (i.e. from local to global information) of the input graph, especially for the cases of large and long-range graphs, while previous methods are limited to extracting only local information that can lead to a local or sub-optimal solution. To tackle the above limitation, we propose a Multiresolution scheme in combination with Equivariant Graph Attention network (mEGAT) architecture, which can learn the optimal route based on low-level and high-level graph resolutions in an efficient way. In particular, our approach constructs a hierarchy of coarse-graining graphs from the input graph, in which we try to solve the routing problems on simple low-level graphs first, then utilize that knowledge for the more complex high-level graphs. Experimentally, we have shown that our model outperforms existing baselines and proved that symmetry preservation and multiresolution are important recipes for solving combinatorial problems in a data-driven manner. Our source code is publicly available at https://github.com/HySonLab/Multires-NP-hard
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 55 references that are in the map. First posted on arXiv 24 Oct 2023.
Builds on
31 of 55 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2017Deep Setscited by 1,421
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2015Pointer Networkscited by 895
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2018Spherical CNNscited by 456
19 more
- 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 354
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
- 2018Invariant and Equivariant Graph Networkscited by 346
- 2016Learning Convolutional Neural Networks for Graphscited by 314
- 2016Steerable CNNscited by 305
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
- 2019Cormorant: Covariant Molecular Neural Networkscited by 263
- 2022Long Range Graph Benchmarkcited by 263
- 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
- 2017Equivariance Through Parameter-Sharingcited by 141
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
- 2021Learning to Delegate for Large-scale Vehicle Routingcited by 109
- 2020Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problemscited by 100
- 2018Learning to Solve NP-Complete Problems - A Graph Neural Network for Decision TSPcited by 58
- 2018Covariant Compositional Networks For Learning Graphscited by 54
- 2020A Deep Reinforcement Learning Algorithm Using Dynamic Attention Model for Vehicle Routing Problemscited by 30
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2015Document Context Language Modelscited by 10
Built on by
Not cited yet.