Principled Data Augmentation for Learning to Solve Quadratic Programming Problems
Not on the map. Why?
Abstract (arXiv)
Linear and quadratic optimization are crucial in numerous real-world applications, ranging from training machine learning models to solving integer linear programs. Recently, learning-to-optimize methods (L2O) for linear (LPs) or quadratic programs (QPs) using message-passing graph neural networks (MPNNs) have gained traction, promising lightweight, data-driven proxies for solving such optimization problems. For example, they replace the costly computation of strong branching scores in branch-and-bound solvers, thereby reducing the need to solve many such optimization problems. However, robust L2O MPNNs remain challenging in data-scarce settings, especially when addressing complex optimization problems such as QPs. This work introduces a principled approach to data augmentation tailored for QPs via MPNNs. Our method leverages theoretically justified data augmentation techniques to generate diverse yet optimality-preserving instances. Furthermore, we integrate these augmentations into a self-supervised contrastive learning framework, thereby pretraining MPNNs for improved performance on L2O tasks. Extensive experiments demonstrate that our approach improves generalization in supervised scenarios and facilitates effective transfer learning to related optimization problems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 73 of its 89 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
73 of 89 references.
References · 73
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2016Variational Graph Auto-Encoderscited by 1,382
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2018Deep Graph Infomaxcited by 1,106
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
38 more
- 2020Contrastive Multi-View Representation Learning on Graphscited by 652
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 463
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2019Diffusion Improves Graph Learningcited by 414
- 2020Graph Structure Learning for Robust Graph Neural Networkscited by 371
- 2017Residual Gated Graph ConvNetscited by 346
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 318
- 2021Graph Contrastive Learning Automatedcited by 287
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
- 2020Data Augmentation for Graph Neural Networkscited by 203
- 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
- 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 186
- 2021Self-supervised Learning on Graphs: Contrastive, Generative,or Predictivecited by 136
- 2022Data Augmentation for Deep Graph Learning: A Surveycited by 133
- 2021DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural Networkscited by 118
- 2020GraphNorm: A Principled Approach to Accelerating Graph Neural Network Trainingcited by 117
- 2022Towards Unsupervised Deep Graph Structure Learningcited by 114
- 2022FoSR: First-order spectral rewiring for addressing oversquashing in GNNscited by 105
- 2021Graph Barlow Twins: A self-supervised representation learning framework for graphscited by 85
- 2023DRew: Dynamically Rewired Message Passing with Delaycited by 82
- 2022DiffWire: Inductive Graph Rewiring via the Lov'asz Boundcited by 79
- 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
- 2020Contrastive Self-supervised Learning for Graph Classificationcited by 68
- 2020Understanding Negative Sampling in Graph Representation Learningcited by 66
- 2022Graph Data Augmentation for Graph Machine Learning: A Surveycited by 62
- 2023Locality-Aware Graph-Rewiring in GNNscited by 56
- 2021Local Augmentation for Graph Neural Networkscited by 53
- 2022MIP-GNN: A Data-Driven Framework for Guiding Combinatorial Solverscited by 49
- 2022Revisiting Graph Contrastive Learning from the Perspective of Graph Spectrumcited by 43
- 2022The Machine Learning for Combinatorial Optimization Competition (ML4CO): Results and Insightscited by 39
- 2022On Representing Linear Programs by Graph Neural Networkscited by 39
- 2022Spectral Augmentation for Self-Supervised Learning on Graphscited by 39
- 2023Searching Large Neighborhoods for Integer Linear Programs with Contrastive Learningcited by 37
- 2023SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimizationcited by 35
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.