mlsanityData to 14 Oct 2026

Combinatorial Optimization with Physics-Inspired Graph Neural Networks

arXiv 2107.01188 ↗First posted 2 Jul 2021cs.LG cond-mat.dis-nn cs.AIcited by 108

Not on the map. Why?

Abstract (arXiv)

Combinatorial optimization problems are pervasive across science and industry. Modern deep learning tools are poised to solve these problems at unprecedented scales, but a unifying framework that incorporates insights from statistical physics is still outstanding. Here we demonstrate how graph neural networks can be used to solve combinatorial optimization problems. Our approach is broadly applicable to canonical NP-hard problems in the form of quadratic unconstrained binary optimization problems, such as maximum cut, minimum vertex cover, maximum independent set, as well as Ising spin glasses and higher-order generalizations thereof in the form of polynomial unconstrained binary optimization problems. We apply a relaxation strategy to the problem Hamiltonian to generate a differentiable loss function with which we train the graph neural network and apply a simple projection to integer variables once the unsupervised training process has completed. We showcase our approach with numerical results for the canonical maximum cut and maximum independent set problems. We find that the graph neural network optimizer performs on par or outperforms existing solvers, with the ability to scale beyond the state of the art to problems with millions of variables.

Key facts. Cited by 108 papers in the map (data through 14 Oct 2026). Builds on 41 of its 136 references that are in the map. First posted on arXiv 2 Jul 2021.

Builds on

41 of 136 references.

References · 41

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2018How Powerful are Graph Neural Networks?cited by 4,393
  4. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  5. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  6. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  7. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  8. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
  9. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
  10. 2015Pointer Networkscited by 895
  11. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
  12. 2015Gated Graph Sequence Neural Networkscited by 796
29 more
  1. 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
  2. 2018Attention, Learn to Solve Routing Problems!cited by 656
  3. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
  4. 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
  5. 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
  6. 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
  7. 2017Representation Learning on Graphs: Methods and Applicationscited by 457
  8. 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
  9. 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
  10. 2013Ising formulations of many NP problemscited by 207
  11. 2018Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Searchcited by 183
  12. 2021End-to-End Constrained Optimization Learning: A Surveycited by 157
  13. 2020DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphscited by 139
  14. 2019Fake News Detection on Social Media using Geometric Deep Learningcited by 118
  15. 2020Erdos Goes Neural: an Unsupervised Learning Framework for Combinatorial Optimization on Graphscited by 115
  16. 2018SimGNN: A Neural Network Approach to Fast Graph Similarity Computationcited by 90
  17. 2019Combinatorial Optimization by Graph Pointer Networks and Hierarchical Reinforcement Learningcited by 78
  18. 2020PinnerSage: Multi-Modal User Embedding Framework for Recommendations at Pinterestcited by 75
  19. 2021Variational Neural Annealingcited by 47
  20. 2019Graph Colouring Meets Deep Learning: Effective Graph Neural Network Models for Combinatorial Problemscited by 40
  21. 2020It's Not What Machines Can Learn, It's What We Cannot Teachcited by 29
  22. 2020Utilising Graph Machine Learning within Drug Discovery and Developmentcited by 26
  23. 2018Graph Neural Networks for IceCube Signal Classificationcited by 24
  24. 2019Experimental performance of graph neural networks on random instances of max-cutcited by 15
  25. 2020Controlled Online Optimization Learning (COOL): Finding the ground state of spin Hamiltonians with reinforcement learningcited by 14
  26. 2018Memcomputing: Leveraging memory and physics to compute efficientlycited by 3
  27. 2014Memcomputing NP-complete problems in polynomial time using polynomial resources and collective statescited by 2
  28. 2017Optimization of population annealing Monte Carlo for large-scale spin-glass simulationscited by 2
  29. 2016A Novel Graph-based Approach for Determining Molecular Similaritycited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 10; 2023: 23; 2024: 25; 2025: 21; 2026: 28.

108 papers.

Sort:

By area:

  1. 2022Multimodal learning with graphscited by 54
  2. 2025PyG 2.0: Scalable Learning on Real World Graphscited by 52
  3. 2022Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent setcited by 33
  4. 2022Graph Coloring with Physics-Inspired Graph Neural Networkscited by 29
  5. 2023Unsupervised Learning for Combinatorial Optimization Needs Meta-Learningcited by 20
  6. 2022Inability of a graph neural network heuristic to outperform greedy algorithms in solving combinatorial optimization problems like Max-Cutcited by 19
  7. 2023Controlling Continuous Relaxation for Combinatorial Optimizationcited by 16
  8. 2022Neural Set Function Extensions: Learning with Discrete Functions in High Dimensionscited by 14
  9. 2021Graph neural network initialisation of quantum approximate optimisationcited by 13
  10. 2023Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalizationcited by 12
  11. 2023Are Graph Neural Networks Optimal Approximation Algorithms?cited by 11
  12. 2023Reply to: Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent setcited by 9
38 more
  1. 2024Tackling Prevalent Conditions in Unsupervised Combinatorial Optimization: Cardinality, Minimum, Covering, and Morecited by 7
  2. 2024Optimization by Parallel Quasi-Quantum Annealing with Gradient-Based Samplingcited by 7
  3. 2022Fast Continuous and Integer L-shaped Heuristics Through Supervised Learningcited by 6
  4. 2022Supplementing Recurrent Neural Networks with Annealing to Solve Combinatorial Optimization Problemscited by 6
  5. 2023Efficient Training of Multi-task Neural Solver for Combinatorial Optimizationcited by 6
  6. 2024Message Passing Variational Autoregressive Network for Solving Intractable Ising Modelscited by 6
  7. 2023A Graph Neural Network with Negative Message Passing for Graph Coloringcited by 5
  8. 2023Reply to: Inability of a graph neural network heuristic to outperform greedy algorithms in solving combinatorial optimization problemscited by 5
  9. 2023Monte Carlo Policy Gradient Method for Binary Optimizationcited by 5
  10. 2023Optimizing Solution-Samplers for Combinatorial Problems: The Landscape of Policy-Gradient Methodscited by 5
  11. 2023Maximum Independent Set: Self-Training through Dynamic Programmingcited by 5
  12. 2024Combinatorial Optimization with Automated Graph Neural Networkscited by 5
  13. 2024A Unified Framework for Combinatorial Optimization Based on Graph Neural Networkscited by 5
  14. 2024MaxCutPool: differentiable feature-aware Maxcut for pooling in graph neural networkscited by 5
  15. 2025Riemannian Optimization on Relaxed Indicator Matrix Manifoldcited by 5
  16. 2025Demonstrating Real Advantage of Machine-Learning-Enhanced Monte Carlo for Combinatorial Optimizationcited by 5
  17. 2023Graph Contrastive Learning for Multi-omics Datacited by 4
  18. 2023Quantum approximate optimization via learning-based adaptive optimizationcited by 4
  19. 2023A Neural Separation Algorithm for the Rounded Capacity Inequalitiescited by 4
  20. 2024Enhancing GNNs Performance on Combinatorial Optimization by Recurrent Feature Updatecited by 4
  21. 2025Geometric Algorithms for Neural Combinatorial Optimization with Constraintscited by 4
  22. 2023A Survey of Methods for Converting Unstructured Data to CSG Modelscited by 3
  23. 2024Continuous Parallel Relaxation for Finding Diverse Solutions in Combinatorial Optimization Problemscited by 3
  24. 2024torchmSAT: A GPU-Accelerated Approximation To The Maximum Satisfiability Problemcited by 3
  25. 2024Towards Single-System Illusion in Software-Defined Vehicles -- Automated, AI-Powered Workflowcited by 3
  26. 2024A Benchmark for Maximum Cut: Towards Standardization of the Evaluation of Learned Heuristics for Combinatorial Optimizationcited by 3
  27. 2025Deep Symbolic Optimization: Reinforcement Learning for Symbolic Mathematicscited by 3
  28. 2025Neural Graduated Assignment for Maximum Common Edge Subgraphscited by 3
  29. 2025IsingFormer: Augmenting Parallel Tempering With Learned Proposalscited by 3
  30. 2022Physics-Informed Graph Learningcited by 2
  31. 2022Bias Reduction via Cooperative Bargaining in Synthetic Graph Dataset Generationcited by 2
  32. 2022Graph Coloring via Neural Networks for Haplotype Assembly and Viral Quasispecies Reconstructioncited by 2
  33. 2023Graph-SCP: Accelerating Set Cover Problems with Graph Neural Networkscited by 2
  34. 2024Graph Pruning for Enumeration of Minimal Unsatisfiable Subsetscited by 2
  35. 2024Efficient Combinatorial Optimization via Heat Diffusioncited by 2
  36. 2024Graph Neural Aggregation-diffusion with Metastabilitycited by 2
  37. 2024Quadratic Binary Optimization with Graph Neural Networkscited by 2
  38. 2024Dynamic Anisotropic Smoothing for Noisy Derivative-Free Optimizationcited by 2

50 most cited of 108 All 108 (JSON)