mlsanityData to 14 Oct 2026

Symmetry-preserving graph attention network to solve routing problems at multiple resolutions

arXiv 2310.15543 ↗First posted 24 Oct 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Travelling Salesperson Problems (TSPs) and Vehicle Routing Problems (VRPs) have achieved reasonable improvement in accuracy and computation time with the adaptation of Machine Learning (ML) methods. However, none of the previous works completely respects the symmetries arising from TSPs and VRPs including rotation, translation, permutation, and scaling. In this work, we introduce the first-ever completely equivariant model and training to solve combinatorial problems. Furthermore, it is essential to capture the multiscale structure (i.e. from local to global information) of the input graph, especially for the cases of large and long-range graphs, while previous methods are limited to extracting only local information that can lead to a local or sub-optimal solution. To tackle the above limitation, we propose a Multiresolution scheme in combination with Equivariant Graph Attention network (mEGAT) architecture, which can learn the optimal route based on low-level and high-level graph resolutions in an efficient way. In particular, our approach constructs a hierarchy of coarse-graining graphs from the input graph, in which we try to solve the routing problems on simple low-level graphs first, then utilize that knowledge for the more complex high-level graphs. Experimentally, we have shown that our model outperforms existing baselines and proved that symmetry preservation and multiresolution are important recipes for solving combinatorial problems in a data-driven manner. Our source code is publicly available at https://github.com/HySonLab/Multires-NP-hard

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 55 references that are in the map. First posted on arXiv 24 Oct 2023.

Builds on

31 of 55 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  5. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  6. 2017Deep Setscited by 1,421
  7. 2016Group Equivariant Convolutional Networkscited by 1,165
  8. 2015Pointer Networkscited by 895
  9. 2018Attention, Learn to Solve Routing Problems!cited by 656
  10. 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
  11. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
  12. 2018Spherical CNNscited by 456
19 more
  1. 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 354
  2. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
  3. 2018Invariant and Equivariant Graph Networkscited by 346
  4. 2016Learning Convolutional Neural Networks for Graphscited by 314
  5. 2016Steerable CNNscited by 305
  6. 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
  7. 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
  8. 2019Cormorant: Covariant Molecular Neural Networkscited by 263
  9. 2022Long Range Graph Benchmarkcited by 263
  10. 2016Molecular Graph Convolutions: Moving Beyond Fingerprintscited by 238
  11. 2017Equivariance Through Parameter-Sharingcited by 141
  12. 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
  13. 2021Learning to Delegate for Large-scale Vehicle Routingcited by 109
  14. 2020Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problemscited by 100
  15. 2018Learning to Solve NP-Complete Problems - A Graph Neural Network for Decision TSPcited by 58
  16. 2018Covariant Compositional Networks For Learning Graphscited by 54
  17. 2020A Deep Reinforcement Learning Algorithm Using Dynamic Attention Model for Vehicle Routing Problemscited by 30
  18. 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
  19. 2015Document Context Language Modelscited by 10

Built on by

Not cited yet.