On Representing Linear Programs by Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Learning to optimize is a rapidly growing area that aims to solve optimization problems or improve existing optimization algorithms using machine learning (ML). In particular, the graph neural network (GNN) is considered a suitable ML model for optimization problems whose variables and constraints are permutation--invariant, for example, the linear program (LP). While the literature has reported encouraging numerical results, this paper establishes the theoretical foundation of applying GNNs to solving LPs. Given any size limit of LPs, we construct a GNN that maps different LPs to different outputs. We show that properly built GNNs can reliably predict feasibility, boundedness, and an optimal solution for each LP in a broad class. Our proofs are based upon the recently--discovered connections between the Weisfeiler--Lehman isomorphism test and the GNN. To validate our results, we train a simple GNN and present its accuracy in mapping LPs to their feasibilities and solutions.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 36 of its 57 references that are in the map. First posted on arXiv 25 Sep 2022.
Builds on
36 of 57 references.
References · 36
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2018Attention, Learn to Solve Routing Problems!cited by 646
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 557
- 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 411
- 2019Provably Powerful Graph Networkscited by 385
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 313
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 265
- 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 235
24 more
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2019What graph neural networks cannot learn: depth vs widthcited by 195
- 2019Universal Invariant and Equivariant Graph Neural Networkscited by 182
- 2020Solving Mixed Integer Programs Using Neural Networkscited by 178
- 2019On the equivalence between graph isomorphism testing and function approximation with GNNscited by 172
- 2019On the Universality of Invariant Networkscited by 151
- 2020A Survey on The Expressive Power of Graph Neural Networkscited by 111
- 2020Expressive Power of Invariant and Equivariant Graph Neural Networkscited by 100
- 2020Hybrid Models for Learning to Branchcited by 95
- 2019Approximation Ratios of Graph Neural Networks for Combinatorial Problemscited by 68
- 2022Expressiveness and Approximation Properties of Graph Neural Networkscited by 63
- 2022Theory of Graph Neural Networks: Representation and Learningcited by 60
- 2022Learning To Cut By Looking Ahead: Cutting Plane Selection via Imitation Learningcited by 58
- 2019DeepOPF: A Deep Neural Network Approach for Security-Constrained DC Optimal Power Flowcited by 50
- 2022MIP-GNN: A Data-Driven Framework for Guiding Combinatorial Solverscited by 48
- 2020Learning to Solve Combinatorial Optimization Problems on Real-World Graphs in Linear Timecited by 39
- 2019Learning for DC-OPF: Classifying active sets using neural netscited by 30
- 2021On the Universality of Graph Neural Networks on Large Random Graphscited by 26
- 2022Lookback for Learning to Branchcited by 26
- 2015Tight Lower and Upper Bounds for the Complexity of Canonical Colour Refinementcited by 16
- 2021Learning Primal Heuristics for Mixed Integer Programscited by 14
- 2022An Improved Reinforcement Learning Algorithm for Learning to Branchcited by 14
- 2022Learning to Reformulate for Linear Programmingcited by 10
- 2019Solving L1-regularized SVMs and related linear programs: Revisiting the effectiveness of Column and Constraint Generationcited by 7
Built on by
Citing papers per year: 2022: 1; 2023: 7; 2024: 10; 2025: 14; 2026: 7.
39 papers.
Sort:
- 2024Position: Graph Foundation Models are Already Herecited by 84
- 2023Exploring the Power of Graph Neural Networks in Solving Linear Optimization Problemscited by 24
- 2024Machine Learning Augmented Branch and Bound for Mixed Integer Linear Programmingcited by 24
- 2022On Representing Mixed-Integer Linear Programs by Graph Neural Networkscited by 23
- 2023Neural incomplete factorization: learning preconditioners for the conjugate gradient methodcited by 18
- 2024Expressive Power of Graph Neural Networks for (Mixed-Integer) Quadratic Programscited by 16
- 2025Apollo-MILP: An Alternating Prediction-Correction Neural Solving Framework for Mixed-Integer Linear Programmingcited by 16
- 2024PDHG-Unrolled Learning-to-Optimize Method for Large-Scale Linear Programmingcited by 14
- 2024Rethinking the Capacity of Graph Neural Networks for Branching Strategycited by 12
- 2023Are Graph Neural Networks Optimal Approximation Algorithms?cited by 10
- 2025EquivaMap: Leveraging LLMs for Automatic Equivalence Checking of Optimization Formulationscited by 9
- 2024Learning to Optimize for Mixed-Integer Non-linear Programming with Feasibility Guaranteescited by 8
27 more
- 2023Accelerate Presolve in Large-Scale Linear Programming via Reinforcement Learningcited by 7
- 2023DIG-MILP: a Deep Instance Generator for Mixed-Integer Linear Programming with Feasibility Guaranteecited by 7
- 2024Machine Learning Insides OptVerse AI Solver: Design Principles and Applicationscited by 7
- 2025ORGEval: Graph-Theoretic Evaluation of LLMs in Optimization Modelingcited by 7
- 2025Towards graph neural networks for provably solving convex optimization problemscited by 4
- 2023Graph-SCP: Accelerating Set Cover Problems with Graph Neural Networkscited by 2
- 2024Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networkscited by 2
- 2024An Efficient Unsupervised Framework for Convex Quadratic Programs via Deep Unrollingcited by 2
- 2025Principled Data Augmentation for Learning to Solve Quadratic Programming Problemscited by 2
- 2025Constraint Matters: Multi-Modal Representation for Reducing Mixed-Integer Linear programmingcited by 2
- 2025FORGE: Foundational Optimization Representations from Graph Embeddingscited by 2
- 2025Enforcing convex constraints in Graph Neural Networkscited by 2
- 2024Network Interdiction Goes Neuralcited by 1
- 2025Surrogate Interpretable Graph for Random Decision Forestscited by 1
- 2025Unrolled Graph Neural Networks for Constrained Optimizationcited by 1
- 2025Branching Strategies Based on Subgraph GNNs: A Study on Theoretical Promise versus Practical Realitycited by 1
- 2026On the Expressive Power of GNNs to Solve Linear SDPscited by 1
- 2023On the Equivalence of Graph Convolution and Mixupcited by 0
- 2025Traffic Engineering in Large-scale Networks with Generalizable Graph Neural Networkscited by 0
- 2025HyP-ASO: A Hybrid Policy-based Adaptive Search Optimization Framework for Large-Scale Integer Linear Programscited by 0
- 2025Feature Augmentation of GNNs for ILPs: Local Uniqueness Sufficescited by 0
- 2026Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNscited by 0
- 2026Learning to Approximate Uniform Facility Location via Graph Neural Networkscited by 0
- 2026Covariance-Aware Transformers for Quadratic Programming and Decision Makingcited by 0
- 2026Solving Max-Cut to Global Optimality via Feasibility-Preserving Graph Neural Networkscited by 0
- 2026Bifurcation Models: Learning Set-Valued Solution Maps with Weight-Tied Dynamicscited by 0
- 2026Learning-Augmented Scalable Linear Assignment Problem Optimization via Neural Dual Warm-Startscited by 0
- 2026Learning-Augmented Scalable Linear Assignment Problem Optimization via Neural Dual Warm-Starts10 May 2026
- 2026Bifurcation Models: Learning Set-Valued Solution Maps with Weight-Tied Dynamics8 May 2026
- 2026Solving Max-Cut to Global Optimality via Feasibility-Preserving Graph Neural Networks8 May 2026
- 2026On the Expressive Power of GNNs to Solve Linear SDPs30 Apr 2026
- 2026Covariance-Aware Transformers for Quadratic Programming and Decision Making16 Feb 2026
- 2026Learning to Approximate Uniform Facility Location via Graph Neural Networks13 Feb 2026
- 2026Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNs10 Feb 2026
- 2025Branching Strategies Based on Subgraph GNNs: A Study on Theoretical Promise versus Practical Reality10 Dec 2025
- 2025ORGEval: Graph-Theoretic Evaluation of LLMs in Optimization Modeling31 Oct 2025
- 2025Enforcing convex constraints in Graph Neural Networks13 Oct 2025
- 2025Feature Augmentation of GNNs for ILPs: Local Uniqueness Suffices25 Sep 2025
- 2025Unrolled Graph Neural Networks for Constrained Optimization21 Sep 2025
27 more
- 2025HyP-ASO: A Hybrid Policy-based Adaptive Search Optimization Framework for Large-Scale Integer Linear Programs19 Sep 2025
- 2025FORGE: Foundational Optimization Representations from Graph Embeddings28 Aug 2025
- 2025Constraint Matters: Multi-Modal Representation for Reducing Mixed-Integer Linear programming26 Aug 2025
- 2025Principled Data Augmentation for Learning to Solve Quadratic Programming Problems2 Jun 2025
- 2025Surrogate Interpretable Graph for Random Decision Forests17 May 2025
- 2025Traffic Engineering in Large-scale Networks with Generalizable Graph Neural Networks31 Mar 2025
- 2025Apollo-MILP: An Alternating Prediction-Correction Neural Solving Framework for Mixed-Integer Linear Programming3 Mar 2025
- 2025EquivaMap: Leveraging LLMs for Automatic Equivalence Checking of Optimization Formulations20 Feb 2025
- 2025Towards graph neural networks for provably solving convex optimization problems4 Feb 2025
- 2024An Efficient Unsupervised Framework for Convex Quadratic Programs via Deep Unrolling2 Dec 2024
- 2024Learning to Optimize for Mixed-Integer Non-linear Programming with Feasibility Guarantees14 Oct 2024
- 2024Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networks6 Sep 2024
- 2024Expressive Power of Graph Neural Networks for (Mixed-Integer) Quadratic Programs9 Jun 2024
- 2024PDHG-Unrolled Learning-to-Optimize Method for Large-Scale Linear Programming4 Jun 2024
- 2024Network Interdiction Goes Neural26 May 2024
- 2024Rethinking the Capacity of Graph Neural Networks for Branching Strategy11 Feb 2024
- 2024Machine Learning Augmented Branch and Bound for Mixed Integer Linear Programming8 Feb 2024
- 2024Position: Graph Foundation Models are Already Here3 Feb 2024
- 2024Machine Learning Insides OptVerse AI Solver: Design Principles and Applications11 Jan 2024
- 2023DIG-MILP: a Deep Instance Generator for Mixed-Integer Linear Programming with Feasibility Guarantee20 Oct 2023
- 2023Accelerate Presolve in Large-Scale Linear Programming via Reinforcement Learning18 Oct 2023
- 2023Exploring the Power of Graph Neural Networks in Solving Linear Optimization Problems16 Oct 2023
- 2023Graph-SCP: Accelerating Set Cover Problems with Graph Neural Networks12 Oct 2023
- 2023Are Graph Neural Networks Optimal Approximation Algorithms?1 Oct 2023
- 2023On the Equivalence of Graph Convolution and Mixup29 Sep 2023
- 2023Neural incomplete factorization: learning preconditioners for the conjugate gradient method25 May 2023
- 2022On Representing Mixed-Integer Linear Programs by Graph Neural Networks19 Oct 2022
- 2024Position: Graph Foundation Models are Already Herecited by 84
- 2023Exploring the Power of Graph Neural Networks in Solving Linear Optimization Problemscited by 24
- 2024Machine Learning Augmented Branch and Bound for Mixed Integer Linear Programmingcited by 24
- 2022On Representing Mixed-Integer Linear Programs by Graph Neural Networkscited by 23
- 2023Neural incomplete factorization: learning preconditioners for the conjugate gradient methodcited by 18
- 2024Expressive Power of Graph Neural Networks for (Mixed-Integer) Quadratic Programscited by 16
- 2025Apollo-MILP: An Alternating Prediction-Correction Neural Solving Framework for Mixed-Integer Linear Programmingcited by 16
- 2024PDHG-Unrolled Learning-to-Optimize Method for Large-Scale Linear Programmingcited by 14
- 2024Rethinking the Capacity of Graph Neural Networks for Branching Strategycited by 12
- 2023Are Graph Neural Networks Optimal Approximation Algorithms?cited by 10
- 2025EquivaMap: Leveraging LLMs for Automatic Equivalence Checking of Optimization Formulationscited by 9
- 2024Learning to Optimize for Mixed-Integer Non-linear Programming with Feasibility Guaranteescited by 8
12 most cited of 39 All 39 (JSON)
- 2026Learning-Augmented Scalable Linear Assignment Problem Optimization via Neural Dual Warm-Starts10 May 2026
- 2026Bifurcation Models: Learning Set-Valued Solution Maps with Weight-Tied Dynamics8 May 2026
- 2026Solving Max-Cut to Global Optimality via Feasibility-Preserving Graph Neural Networks8 May 2026
- 2026On the Expressive Power of GNNs to Solve Linear SDPs30 Apr 2026
- 2026Covariance-Aware Transformers for Quadratic Programming and Decision Making16 Feb 2026
- 2026Learning to Approximate Uniform Facility Location via Graph Neural Networks13 Feb 2026
- 2026Graph Learning Should Move Beyond Restrictive Views of Spectral and Message-Passing GNNs10 Feb 2026
- 2025Branching Strategies Based on Subgraph GNNs: A Study on Theoretical Promise versus Practical Reality10 Dec 2025
- 2025ORGEval: Graph-Theoretic Evaluation of LLMs in Optimization Modeling31 Oct 2025
- 2025Enforcing convex constraints in Graph Neural Networks13 Oct 2025
- 2025Feature Augmentation of GNNs for ILPs: Local Uniqueness Suffices25 Sep 2025
- 2025Unrolled Graph Neural Networks for Constrained Optimization21 Sep 2025
12 newest of 39 All 39 (JSON)