Combinatorial Optimization with Physics-Inspired Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Combinatorial optimization problems are pervasive across science and industry. Modern deep learning tools are poised to solve these problems at unprecedented scales, but a unifying framework that incorporates insights from statistical physics is still outstanding. Here we demonstrate how graph neural networks can be used to solve combinatorial optimization problems. Our approach is broadly applicable to canonical NP-hard problems in the form of quadratic unconstrained binary optimization problems, such as maximum cut, minimum vertex cover, maximum independent set, as well as Ising spin glasses and higher-order generalizations thereof in the form of polynomial unconstrained binary optimization problems. We apply a relaxation strategy to the problem Hamiltonian to generate a differentiable loss function with which we train the graph neural network and apply a simple projection to integer variables once the unsupervised training process has completed. We showcase our approach with numerical results for the canonical maximum cut and maximum independent set problems. We find that the graph neural network optimizer performs on par or outperforms existing solvers, with the ability to scale beyond the state of the art to problems with millions of variables.
Key facts. Cited by 108 papers in the map (data through 14 Oct 2026). Builds on 41 of its 136 references that are in the map. First posted on arXiv 2 Jul 2021.
Builds on
41 of 136 references.
References · 41
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,138
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 898
- 2015Pointer Networkscited by 895
- 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 877
- 2015Gated Graph Sequence Neural Networkscited by 796
29 more
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
- 2017Representation Learning on Graphs: Methods and Applicationscited by 457
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
- 2013Ising formulations of many NP problemscited by 207
- 2018Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Searchcited by 183
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 157
- 2020DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphscited by 139
- 2019Fake News Detection on Social Media using Geometric Deep Learningcited by 118
- 2020Erdos Goes Neural: an Unsupervised Learning Framework for Combinatorial Optimization on Graphscited by 115
- 2018SimGNN: A Neural Network Approach to Fast Graph Similarity Computationcited by 90
- 2019Combinatorial Optimization by Graph Pointer Networks and Hierarchical Reinforcement Learningcited by 78
- 2020PinnerSage: Multi-Modal User Embedding Framework for Recommendations at Pinterestcited by 75
- 2021Variational Neural Annealingcited by 47
- 2019Graph Colouring Meets Deep Learning: Effective Graph Neural Network Models for Combinatorial Problemscited by 40
- 2020It's Not What Machines Can Learn, It's What We Cannot Teachcited by 29
- 2020Utilising Graph Machine Learning within Drug Discovery and Developmentcited by 26
- 2018Graph Neural Networks for IceCube Signal Classificationcited by 24
- 2019Experimental performance of graph neural networks on random instances of max-cutcited by 15
- 2020Controlled Online Optimization Learning (COOL): Finding the ground state of spin Hamiltonians with reinforcement learningcited by 14
- 2018Memcomputing: Leveraging memory and physics to compute efficientlycited by 3
- 2014Memcomputing NP-complete problems in polynomial time using polynomial resources and collective statescited by 2
- 2017Optimization of population annealing Monte Carlo for large-scale spin-glass simulationscited by 2
- 2016A Novel Graph-based Approach for Determining Molecular Similaritycited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 10; 2023: 23; 2024: 25; 2025: 21; 2026: 28.
108 papers.
Sort:
By area:
- 2022Multimodal learning with graphscited by 54
- 2025PyG 2.0: Scalable Learning on Real World Graphscited by 52
- 2022Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent setcited by 33
- 2022Graph Coloring with Physics-Inspired Graph Neural Networkscited by 29
- 2023Unsupervised Learning for Combinatorial Optimization Needs Meta-Learningcited by 20
- 2022Inability of a graph neural network heuristic to outperform greedy algorithms in solving combinatorial optimization problems like Max-Cutcited by 19
- 2023Controlling Continuous Relaxation for Combinatorial Optimizationcited by 16
- 2022Neural Set Function Extensions: Learning with Discrete Functions in High Dimensionscited by 14
- 2021Graph neural network initialisation of quantum approximate optimisationcited by 13
- 2023Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalizationcited by 12
- 2023Are Graph Neural Networks Optimal Approximation Algorithms?cited by 11
- 2023Reply to: Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent setcited by 9
38 more
- 2024Tackling Prevalent Conditions in Unsupervised Combinatorial Optimization: Cardinality, Minimum, Covering, and Morecited by 7
- 2024Optimization by Parallel Quasi-Quantum Annealing with Gradient-Based Samplingcited by 7
- 2022Fast Continuous and Integer L-shaped Heuristics Through Supervised Learningcited by 6
- 2022Supplementing Recurrent Neural Networks with Annealing to Solve Combinatorial Optimization Problemscited by 6
- 2023Efficient Training of Multi-task Neural Solver for Combinatorial Optimizationcited by 6
- 2024Message Passing Variational Autoregressive Network for Solving Intractable Ising Modelscited by 6
- 2023A Graph Neural Network with Negative Message Passing for Graph Coloringcited by 5
- 2023Reply to: Inability of a graph neural network heuristic to outperform greedy algorithms in solving combinatorial optimization problemscited by 5
- 2023Monte Carlo Policy Gradient Method for Binary Optimizationcited by 5
- 2023Optimizing Solution-Samplers for Combinatorial Problems: The Landscape of Policy-Gradient Methodscited by 5
- 2023Maximum Independent Set: Self-Training through Dynamic Programmingcited by 5
- 2024Combinatorial Optimization with Automated Graph Neural Networkscited by 5
- 2024A Unified Framework for Combinatorial Optimization Based on Graph Neural Networkscited by 5
- 2024MaxCutPool: differentiable feature-aware Maxcut for pooling in graph neural networkscited by 5
- 2025Riemannian Optimization on Relaxed Indicator Matrix Manifoldcited by 5
- 2025Demonstrating Real Advantage of Machine-Learning-Enhanced Monte Carlo for Combinatorial Optimizationcited by 5
- 2023Graph Contrastive Learning for Multi-omics Datacited by 4
- 2023Quantum approximate optimization via learning-based adaptive optimizationcited by 4
- 2023A Neural Separation Algorithm for the Rounded Capacity Inequalitiescited by 4
- 2024Enhancing GNNs Performance on Combinatorial Optimization by Recurrent Feature Updatecited by 4
- 2025Geometric Algorithms for Neural Combinatorial Optimization with Constraintscited by 4
- 2023A Survey of Methods for Converting Unstructured Data to CSG Modelscited by 3
- 2024Continuous Parallel Relaxation for Finding Diverse Solutions in Combinatorial Optimization Problemscited by 3
- 2024torchmSAT: A GPU-Accelerated Approximation To The Maximum Satisfiability Problemcited by 3
- 2024Towards Single-System Illusion in Software-Defined Vehicles -- Automated, AI-Powered Workflowcited by 3
- 2024A Benchmark for Maximum Cut: Towards Standardization of the Evaluation of Learned Heuristics for Combinatorial Optimizationcited by 3
- 2025Deep Symbolic Optimization: Reinforcement Learning for Symbolic Mathematicscited by 3
- 2025Neural Graduated Assignment for Maximum Common Edge Subgraphscited by 3
- 2025IsingFormer: Augmenting Parallel Tempering With Learned Proposalscited by 3
- 2022Physics-Informed Graph Learningcited by 2
- 2022Bias Reduction via Cooperative Bargaining in Synthetic Graph Dataset Generationcited by 2
- 2022Graph Coloring via Neural Networks for Haplotype Assembly and Viral Quasispecies Reconstructioncited by 2
- 2023Graph-SCP: Accelerating Set Cover Problems with Graph Neural Networkscited by 2
- 2024Graph Pruning for Enumeration of Minimal Unsatisfiable Subsetscited by 2
- 2024Efficient Combinatorial Optimization via Heat Diffusioncited by 2
- 2024Graph Neural Aggregation-diffusion with Metastabilitycited by 2
- 2024Quadratic Binary Optimization with Graph Neural Networkscited by 2
- 2024Dynamic Anisotropic Smoothing for Noisy Derivative-Free Optimizationcited by 2
50 most cited of 108 All 108 (JSON)
- 2026Probabilistic Algorithms for Ising Machines from Optimization to Generative AI2 Oct 2026
- 2026Self-Supervised Combinatorial Optimization with Constraints via Frank-Wolfe22 Sep 2026
- 2026Graph neural networks and the energetic cavity method for combinatorial optimization7 Sep 2026
- 2026Congruence Decomposition with Neural Block Solvers for Large-Scale PCI Assignment21 Aug 2026
- 2026Anatomy of a Sound Neural Reasoner: One-Shot Amortization, First-Pass Poisoning, and Search Inertness in Clue-Rich Completion22 Jul 2026
- 2026On the Potential of Graph Neural Networks as Metamodels for Supply Chain Optimization: Dataset, Architectures, and Directions18 Jul 2026
- 2026Local-Minima-Preserving Continuous Relaxation of Ising Problems29 Jun 2026
- 2026Scalable Physics-Inspired Transformers for Spin Glasses22 Jun 2026
- 2026Placing Degree Scales After LayerNorm12 Jun 2026
- 2026Projecting Latent RL Actions: Towards Generalizable and Scalable Graph Combinatorial Optimization19 May 2026
- 2026Distribution-Aware Algorithm Design with LLM Agents13 May 2026
- 2026Neural QAOA2: Differentiable Joint Graph Partitioning and Parameter Initialization for Quantum Combinatorial Optimization13 May 2026
38 more
- 2026Attention-based graph neural networks: a survey9 May 2026
- 2026Query-Efficient Quantum Approximate Optimization via Graph-Conditioned Trust Regions27 Apr 2026
- 2026Crystal structure prediction using graph neural combinatorial optimization27 Apr 2026
- 2026Hamiltonian Graph Inference Networks: Joint structure discovery and dynamics prediction for lattice Hamiltonian systems from trajectory data26 Apr 2026
- 2026A general optimization solver based on OP-to-MaxSAT reduction23 Apr 2026
- 2026Problem Reductions at Scale: Agentic Integration of Computationally Hard Problems13 Apr 2026
- 2026UniHetCO: A Unified Heterogeneous Representation for Multi-Problem Learning in Unsupervised Neural Combinatorial Optimization12 Mar 2026
- 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?2 Mar 2026
- 2026Exploiting Low-Rank Objective Structure in Discrete Quadratic Optimization23 Feb 2026
- 2026Benchmarking Graph Neural Networks in Solving Hard Constraint Satisfaction Problems20 Feb 2026
- 2026Learning Structural Hardness for Combinatorial Auctions: Instance-Dependent Algorithm Selection via Graph Neural Networks16 Feb 2026
- 2026VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection14 Feb 2026
- 2026Boltzmann Reinforcement Learning for Noise resilience in Analog Ising Machines9 Feb 2026
- 2026Eidolon: A Post-Quantum Signature Scheme Based on k-Colorability in the Age of Graph Neural Networks2 Feb 2026
- 2026Neural Ising Machines via Unrolling and Zeroth-Order Training30 Jan 2026
- 2026Test-Time Adaptation for Unsupervised Combinatorial Optimization28 Jan 2026
- 2025Three methods, one problem: Classical and AI approaches to no-three-in-line12 Dec 2025
- 2025Neural Tractability via Structure: Learning-Augmented Algorithms for Graph Combinatorial Optimization24 Nov 2025
- 2025Geometric Algorithms for Neural Combinatorial Optimization with Constraints28 Oct 2025
- 2025Generalizable Reasoning through Compositional Energy Minimization23 Oct 2025
- 2025Demonstrating Real Advantage of Machine-Learning-Enhanced Monte Carlo for Combinatorial Optimization22 Oct 2025
- 2025IsingFormer: Augmenting Parallel Tempering With Learned Proposals27 Sep 2025
- 2025Nonlocal Monte Carlo via Reinforcement Learning14 Aug 2025
- 2025PyG 2.0: Scalable Learning on Real World Graphs22 Jul 2025
- 2025Binarizing Physics-Inspired GNNs for Combinatorial Optimization18 Jul 2025
- 2025Deep k-grouping: An Unsupervised Learning Framework for Combinatorial Optimization on Graphs and Hypergraphs27 May 2025
- 2025Learning for Dynamic Combinatorial Optimization without Training Data26 May 2025
- 2025Unsupervised Learning of Local Updates for Maximum Independent Set in Dynamic Graphs19 May 2025
- 2025Neural Graduated Assignment for Maximum Common Edge Subgraphs18 May 2025
- 2025Deep Symbolic Optimization: Reinforcement Learning for Symbolic Mathematics16 May 2025
- 2025A QUBO Framework for Team Formation29 Mar 2025
- 2025Riemannian Optimization on Relaxed Indicator Matrix Manifold26 Mar 2025
- 2025Make Optimization Once and for All with Fine-grained Guidance14 Mar 2025
- 2025A Transfer Framework for Enhancing Temporal Graph Learning in Data-Scarce Settings2 Mar 2025
- 2025Preference-Based Gradient Estimation for ML-Guided Approximate Combinatorial Optimization26 Feb 2025
- 2025Unrealized Expectations: Comparing AI Methods vs Classical Algorithms for Maximum Independent Set5 Feb 2025
- 2025Optimizing Job Allocation using Reinforcement Learning with Graph Neural Networks31 Jan 2025
- 2024Scalable Quantum-Inspired Optimization through Dynamic Qubit Compression24 Dec 2024
50 newest of 108 All 108 (JSON)
- 2025Deep Symbolic Optimization: Reinforcement Learning for Symbolic Mathematicscited by 3
- 2024Hamiltonian-based Quantum Reinforcement Learning for Neural Combinatorial Optimizationcited by 2
- 2025Unrealized Expectations: Comparing AI Methods vs Classical Algorithms for Maximum Independent Setcited by 2
- 2025Nonlocal Monte Carlo via Reinforcement Learningcited by 1
- 2025Optimizing Job Allocation using Reinforcement Learning with Graph Neural Networkscited by 0
- 2026Boltzmann Reinforcement Learning for Noise resilience in Analog Ising Machinescited by 0
- 2026Boltzmann Reinforcement Learning for Noise resilience in Analog Ising Machines9 Feb 2026
- 2025Nonlocal Monte Carlo via Reinforcement Learning14 Aug 2025
- 2025Deep Symbolic Optimization: Reinforcement Learning for Symbolic Mathematics16 May 2025
- 2025Unrealized Expectations: Comparing AI Methods vs Classical Algorithms for Maximum Independent Set5 Feb 2025
- 2025Optimizing Job Allocation using Reinforcement Learning with Graph Neural Networks31 Jan 2025
- 2024Hamiltonian-based Quantum Reinforcement Learning for Neural Combinatorial Optimization13 May 2024
- 2022Multimodal learning with graphscited by 54
- 2025PyG 2.0: Scalable Learning on Real World Graphscited by 52
- 2022Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent setcited by 33
- 2022Graph Coloring with Physics-Inspired Graph Neural Networkscited by 29
- 2023Unsupervised Learning for Combinatorial Optimization Needs Meta-Learningcited by 20
- 2022Inability of a graph neural network heuristic to outperform greedy algorithms in solving combinatorial optimization problems like Max-Cutcited by 19
- 2023Controlling Continuous Relaxation for Combinatorial Optimizationcited by 16
- 2022Neural Set Function Extensions: Learning with Discrete Functions in High Dimensionscited by 14
- 2021Graph neural network initialisation of quantum approximate optimisationcited by 13
- 2023Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalizationcited by 12
- 2023Are Graph Neural Networks Optimal Approximation Algorithms?cited by 11
- 2023Reply to: Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent setcited by 9
12 most cited of 100 All 100 (JSON)
- 2026Probabilistic Algorithms for Ising Machines from Optimization to Generative AI2 Oct 2026
- 2026Self-Supervised Combinatorial Optimization with Constraints via Frank-Wolfe22 Sep 2026
- 2026Graph neural networks and the energetic cavity method for combinatorial optimization7 Sep 2026
- 2026Congruence Decomposition with Neural Block Solvers for Large-Scale PCI Assignment21 Aug 2026
- 2026Anatomy of a Sound Neural Reasoner: One-Shot Amortization, First-Pass Poisoning, and Search Inertness in Clue-Rich Completion22 Jul 2026
- 2026On the Potential of Graph Neural Networks as Metamodels for Supply Chain Optimization: Dataset, Architectures, and Directions18 Jul 2026
- 2026Local-Minima-Preserving Continuous Relaxation of Ising Problems29 Jun 2026
- 2026Scalable Physics-Inspired Transformers for Spin Glasses22 Jun 2026
- 2026Placing Degree Scales After LayerNorm12 Jun 2026
- 2026Projecting Latent RL Actions: Towards Generalizable and Scalable Graph Combinatorial Optimization19 May 2026
- 2026Neural QAOA2: Differentiable Joint Graph Partitioning and Parameter Initialization for Quantum Combinatorial Optimization13 May 2026
- 2026Attention-based graph neural networks: a survey9 May 2026
12 newest of 100 All 100 (JSON)