Learning Combinatorial Optimization Algorithms over Graphs
Not on the map. Why?
Abstract (arXiv)
The design of good heuristics or approximation algorithms for NP-hard combinatorial optimization problems often requires significant specialized knowledge and trial-and-error. Can we automate this challenging, tedious process, and learn the algorithms instead? In many real-world applications, it is typically the case that the same optimization problem is solved again and again on a regular basis, maintaining the same problem structure but differing in the data. This provides an opportunity for learning heuristic algorithms that exploit the structure of such recurring problems. In this paper, we propose a unique combination of reinforcement learning and graph embedding to address this challenge. The learned greedy policy behaves like a meta-algorithm that incrementally constructs a solution, and the action is determined by the output of a graph embedding network capturing the current state of the solution. We show that our framework can be applied to a diverse range of optimization problems over graphs, and learns effective algorithms for the Minimum Vertex Cover, Maximum Cut and Traveling Salesman problems.
Key facts. Cited by 557 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 129; 2022: 105; 2023: 102; 2024: 90; 2025: 72; 2026: 59.
557 papers.
Sort:
By area:
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 700
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2021Graph Learning: A Surveycited by 140
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 127
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
- 2021Learning to Delegate for Large-scale Vehicle Routingcited by 108
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2021Combinatorial Optimization with Physics-Inspired Graph Neural Networkscited by 107
- 2022The CLRS Algorithmic Reasoning Benchmarkcited by 103
38 more
- 2021NeuroLKH: Combining Deep Learning Model with Lin-Kernighan-Helsgaun Heuristic for Solving the Traveling Salesman Problemcited by 102
- 2021Efficient Active Search for Combinatorial Optimization Problemscited by 99
- 2021Matrix Encoding Networks for Neural Combinatorial Optimizationcited by 89
- 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
- 2022Simulation-guided Beam Search for Neural Combinatorial Optimizationcited by 84
- 2022Tutorial on amortized optimizationcited by 83
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
- 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 80
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
- 2021Machine Learning for Electronic Design Automation: A Surveycited by 71
- 2021Graph Neural Network Guided Local Search for the Traveling Salesperson Problemcited by 70
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 68
- 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 61
- 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 61
- 2022Theory of Graph Neural Networks: Representation and Learningcited by 60
- 2022Self-Supervised Primal-Dual Learning for Constrained Optimizationcited by 60
- 2021The Transformer Network for the Traveling Salesman Problemcited by 59
- 2022A Generalist Neural Algorithmic Learnercited by 58
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 58
- 2022GraphFramEx: Towards Systematic Evaluation of Explainability Methods for Graph Neural Networkscited by 57
- 2022Winner Takes It All: Training Performant RL Populations for Combinatorial Optimizationcited by 57
- 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
- 2021Graph Coarsening with Neural Networkscited by 55
- 2021Ordering-Based Causal Discovery with Reinforcement Learningcited by 55
- 2022Boosting the Cycle Counting Power of Graph Neural Networks with I2-GNNscited by 55
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2021Learning to schedule job-shop problems: Representation and policy learning using graph neural network and reinforcement learningcited by 52
- 2021CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraintscited by 49
- 2023Pointerformer: Deep Reinforced Multi-Pointer Transformer for the Traveling Salesman Problemcited by 49
- 2022MIP-GNN: A Data-Driven Framework for Guiding Combinatorial Solverscited by 48
- 2024GraphArena: Evaluating and Exploring Large Language Models on Graph Computationcited by 48
- 2023H-TSP: Hierarchically Solving the Large-Scale Travelling Salesman Problemcited by 43
- 2024INViT: A Generalizable Routing Problem Solver with Invariant Nested View Transformercited by 43
- 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimizationcited by 43
- 2024Can Graph Learning Improve Planning in LLM-based Agents?cited by 42
- 2021Learning a Large Neighborhood Search Algorithm for Mixed Integer Programscited by 41
- 2022Equivariant quantum circuits for learning on weighted graphscited by 41
50 most cited of 557 All 557 (JSON)
- 2026Network World Models as Environments for Algorithm Design on Complex Systems1 Oct 2026
- 2026Learning to Cover Locally: Graph Neural Combinatorial Optimization under a Hard Information Horizon30 Sep 2026
- 2026Parallel Tempering for Diffusion-Based Combinatorial Optimization29 Sep 2026
- 2026Self-Supervised Combinatorial Optimization with Constraints via Frank-Wolfe22 Sep 2026
- 2026Deep Reinforcement Learning on Item-Compatibility Graphs for One-Dimensional Bin Packing21 Sep 2026
- 2026Reinforcement Learning in Operational Research: A Technical Review and Practical Roadmap21 Sep 2026
- 2026COMPASS: Ordered Clustered Routing at 100K Scale17 Sep 2026
- 2026On the Expressive Power of Implicit Line-Graph Higher-Order Weisfeiler--Leman14 Sep 2026
- 2026Graph Neural Networks for Influence Maximization in Social Networks: An Unsupervised Minimum Dominating Set Approach12 Sep 2026
- 2026Graph neural networks and the energetic cavity method for combinatorial optimization7 Sep 2026
- 2026Learning-to-Transition for Large-scale and High-Order MIMO Detection14 Aug 2026
- 2026TANGCO: Learning Topology-Aware Capacity Allocation for Overload-driven Cascading Failures13 Aug 2026
38 more
- 2026Constrained Graph Diffusion for Mixed Integer Optimization13 Aug 2026
- 2026RCShift: Certifying When Partial Linkage Suffices for Finite-Sample Decisions11 Aug 2026
- 2026A Graph Neural Network--Guided Genetic Algorithm for Physical Internet Supply Chain Optimization under Cost Uncertainty10 Aug 2026
- 2026Machine Learning-Enhanced Tabu Search for Tactical Wireless Network Design31 Jul 2026
- 2026MPFlow: Learning Budgeted Max-Flow Optimization on the Lightning Network with Deep Graph Reinforcement Learning9 Jul 2026
- 2026TSP with Predictions: Heatmap to Tour with Provable Guarantees4 Jul 2026
- 2026Neural Certificate Pricing for Combinatorial Optimization Problems1 Jul 2026
- 2026When to Commit and When to Defer: Maturing Markov Decision Processes under Refining Information and Expiring Opportunities17 Jun 2026
- 2026N(CO)2: Neural Combinatorial Optimization with Chance Constraints to Solve Stochastic Orienteering16 Jun 2026
- 2026Deep Reinforcement Learning for Minimum Zero-Forcing Sets16 Jun 2026
- 2026Discovering Lattice Reduction Strategies via Self-Play13 Jun 2026
- 2026Placing Degree Scales After LayerNorm12 Jun 2026
- 2026From Reward-Free Representations to Preferences: Rethinking Offline Preference-Based Reinforcement Learning31 May 2026
- 2026LoRe: Adaptive Interaction-Evaluation Routing with Per-Step Interaction Budgets for Iterative Graph Solvers27 May 2026
- 2026Towards Generalization-Oriented Models for Vehicle Routing Problems with Mixture-of-Experts26 May 2026
- 2026Learning Altruistic Collaboration in Heterogeneous Multi-Team Systems20 May 2026
- 2026COAgents: Multi-Agent Framework to Learn and Navigate Routing Problems Search Space20 May 2026
- 2026Projecting Latent RL Actions: Towards Generalizable and Scalable Graph Combinatorial Optimization19 May 2026
- 2026Memory-Guided Tree Search with Cross-Branch Knowledge Transfer for LLM Solver Synthesis17 May 2026
- 2026Bridging the Gap between Sparse Matrix Reordering and Factorization: A Deep Learning Framework for Fill-in Reduction17 May 2026
- 2026Learning to Optimize at Scale: A Benders Decomposition-TransfORmers Framework for Stochastic Combinatorial Optimization13 May 2026
- 2026Distribution-Aware Algorithm Design with LLM Agents13 May 2026
- 2026Neural QAOA2: Differentiable Joint Graph Partitioning and Parameter Initialization for Quantum Combinatorial Optimization13 May 2026
- 2026NeuroRisk: Physics-Informed Neural Optimization for Risk-Aware Traffic Engineering13 May 2026
- 2026Learning to Cut: Reinforcement Learning for Benders Decomposition7 May 2026
- 2026Graph Normalization: Fast Binarizing Dynamics for Differentiable MWIS6 May 2026
- 2026Query-Efficient Quantum Approximate Optimization via Graph-Conditioned Trust Regions27 Apr 2026
- 2026Deep Learning for Sequential Decision Making under Uncertainty: Foundations, Frameworks, and Frontiers13 Apr 2026
- 2026An Algorithm for Fast Assembling Large-Scale Defect-Free Atom Arrays9 Apr 2026
- 2026Towards Near-Real-Time Telemetry-Aware Routing with Neural Routing Algorithms3 Apr 2026
- 2026SP-GCRL: Influence Maximization on Incomplete Social Graphs31 Mar 2026
- 2026Dynamic resource matching in manufacturing using deep reinforcement learning28 Mar 2026
- 2026Approximate Subgraph Matching with Neural Graph Representations and Reinforcement Learning18 Mar 2026
- 2026Constraints Matrix Diffusion based Generative Neural Solver for Vehicle Routing Problems8 Mar 2026
- 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?2 Mar 2026
- 2026Efficient Decoder Scaling Strategy for Neural Routing Solvers28 Feb 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026PACIFIER: Pacing Opinion Depolarization via a Unified Graph Learning Framework23 Feb 2026
50 newest of 557 All 557 (JSON)
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimizationcited by 58
- 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimizationcited by 43
- 2024Diffusion Models as Constrained Samplers for Optimization with Unknown Constraintscited by 33
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physicscited by 28
- 2023Accelerating Diffusion-based Combinatorial Optimization Solvers by Progressive Distillationcited by 4
- 2025DiffGED: Computing Graph Edit Distance via Diffusion-based Graph Matchingcited by 2
- 2025Boosting Cross-problem Generalization in Diffusion-Based Neural Combinatorial Solver via Inference Time Adaptationcited by 1
- 2025A Denoising Diffusion-Based Evolutionary Algorithm Framework: Application to the Maximum Independent Set Problemcited by 1
- 2026Constraints Matrix Diffusion based Generative Neural Solver for Vehicle Routing Problemscited by 0
- 2026Parallel Tempering for Diffusion-Based Combinatorial Optimizationcited by 0
- 2026Parallel Tempering for Diffusion-Based Combinatorial Optimization29 Sep 2026
- 2026Constraints Matrix Diffusion based Generative Neural Solver for Vehicle Routing Problems8 Mar 2026
- 2025A Denoising Diffusion-Based Evolutionary Algorithm Framework: Application to the Maximum Independent Set Problem8 Oct 2025
- 2025DiffGED: Computing Graph Edit Distance via Diffusion-based Graph Matching24 Mar 2025
- 2025Boosting Cross-problem Generalization in Diffusion-Based Neural Combinatorial Solver via Inference Time Adaptation15 Feb 2025
- 2025Scalable Discrete Diffusion Samplers: Combinatorial Optimization and Statistical Physics12 Feb 2025
- 2025Fast T2T: Optimization Consistency Speeds Up Diffusion-Based Training-to-Testing Solving for Combinatorial Optimization5 Feb 2025
- 2024A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimization3 Jun 2024
- 2024Diffusion Models as Constrained Samplers for Optimization with Unknown Constraints28 Feb 2024
- 2023Accelerating Diffusion-based Combinatorial Optimization Solvers by Progressive Distillation12 Aug 2023
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimization16 Feb 2023
- 2021Nearly Horizon-Free Offline Reinforcement Learningcited by 36
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
- 2022Learning to Optimize Permutation Flow Shop Scheduling via Graph-based Imitation Learningcited by 10
- 2024CAMBranch: Contrastive Learning with Augmented MILPs for Branchingcited by 10
- 2022Learning Graph Search Heuristicscited by 7
- 2024Offline reinforcement learning for job-shop scheduling problemscited by 2
- 2024A Graph-based Adversarial Imitation Learning Framework for Reliable & Realtime Fleet Scheduling in Urban Air Mobilitycited by 1
- 2021Solving Graph-based Public Good Games with Tree Search and Imitation Learningcited by 0
- 2025Imitation Learning in the Deep Learning Era: A Novel Taxonomy and Recent Advancescited by 0
- 2025Imitation Learning in the Deep Learning Era: A Novel Taxonomy and Recent Advances5 Nov 2025
- 2024Offline reinforcement learning for job-shop scheduling problems21 Oct 2024
- 2024A Graph-based Adversarial Imitation Learning Framework for Reliable & Realtime Fleet Scheduling in Urban Air Mobility16 Jul 2024
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy23 Jun 2024
- 2024CAMBranch: Contrastive Learning with Augmented MILPs for Branching6 Feb 2024
- 2022Learning Graph Search Heuristics7 Dec 2022
- 2022Learning to Optimize Permutation Flow Shop Scheduling via Graph-based Imitation Learning31 Oct 2022
- 2021Solving Graph-based Public Good Games with Tree Search and Imitation Learning12 Jun 2021
- 2021Nearly Horizon-Free Offline Reinforcement Learning25 Mar 2021
- 2025REFRAG: Rethinking RAG based Decodingcited by 8
- 2025Neural Algorithmic Reasoning for Hypergraphs with Looped Transformerscited by 3
- 2023Integrating Symbolic Reasoning into Neural Generative Models for Design Generationcited by 1
- 2025ACCORD: Autoregressive Constraint-satisfying Generation for COmbinatorial Optimization with Routing and Dynamic attentioncited by 1
- 2025REFRAG: Rethinking RAG based Decoding1 Sep 2025
- 2025ACCORD: Autoregressive Constraint-satisfying Generation for COmbinatorial Optimization with Routing and Dynamic attention22 May 2025
- 2025Neural Algorithmic Reasoning for Hypergraphs with Looped Transformers18 Jan 2025
- 2023Integrating Symbolic Reasoning into Neural Generative Models for Design Generation13 Oct 2023
- 2024Can Graph Learning Improve Planning in LLM-based Agents?cited by 42
- 2026Distribution-Aware Algorithm Design with LLM Agentscited by 0
- 2026Distribution-Aware Algorithm Design with LLM Agents13 May 2026
- 2024Can Graph Learning Improve Planning in LLM-based Agents?29 May 2024
- 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 700
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2021End-to-End Constrained Optimization Learning: A Surveycited by 154
- 2021Graph Learning: A Surveycited by 140
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 127
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
- 2021Learning to Delegate for Large-scale Vehicle Routingcited by 108
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2021Combinatorial Optimization with Physics-Inspired Graph Neural Networkscited by 107
- 2022The CLRS Algorithmic Reasoning Benchmarkcited by 103
- 2021NeuroLKH: Combining Deep Learning Model with Lin-Kernighan-Helsgaun Heuristic for Solving the Traveling Salesman Problemcited by 102
12 most cited of 527 All 527 (JSON)
- 2026Learning to Cover Locally: Graph Neural Combinatorial Optimization under a Hard Information Horizon30 Sep 2026
- 2026Self-Supervised Combinatorial Optimization with Constraints via Frank-Wolfe22 Sep 2026
- 2026Deep Reinforcement Learning on Item-Compatibility Graphs for One-Dimensional Bin Packing21 Sep 2026
- 2026Reinforcement Learning in Operational Research: A Technical Review and Practical Roadmap21 Sep 2026
- 2026COMPASS: Ordered Clustered Routing at 100K Scale17 Sep 2026
- 2026On the Expressive Power of Implicit Line-Graph Higher-Order Weisfeiler--Leman14 Sep 2026
- 2026Graph Neural Networks for Influence Maximization in Social Networks: An Unsupervised Minimum Dominating Set Approach12 Sep 2026
- 2026Graph neural networks and the energetic cavity method for combinatorial optimization7 Sep 2026
- 2026Learning-to-Transition for Large-scale and High-Order MIMO Detection14 Aug 2026
- 2026TANGCO: Learning Topology-Aware Capacity Allocation for Overload-driven Cascading Failures13 Aug 2026
- 2026Constrained Graph Diffusion for Mixed Integer Optimization13 Aug 2026
- 2026RCShift: Certifying When Partial Linkage Suffices for Finite-Sample Decisions11 Aug 2026
12 newest of 527 All 527 (JSON)