Self-Supervised Combinatorial Optimization with Constraints via Frank-Wolfe
Not on the map. Why?
Abstract (arXiv)
Self-supervised learning for combinatorial optimization has emerged as a promising paradigm for solving discrete optimization problems with neural networks, but a central challenge remains: handling hard combinatorial constraints within continuous, gradient-based training. Continuously extending combinatorial objectives to convex domains is a powerful technique, yet existing approaches often require projection steps that constrain neural network outputs to lie inside the feasible polytope and rely on ad-hoc and problem-specific constructions. We propose a general framework in which the neural network is allowed to predict arbitrary continuous vectors that could potentially lie outside of the feasible polytope. These predictions are then approximated by sparse convex combinations of feasible solutions using a geometric decomposition algorithm based on Frank--Wolfe methods and approximate Caratheodory results. This decomposition induces an a.e.-differentiable, self-supervised loss defined as the expected value of the discrete objective. The same procedure provides an automatic rounding guarantee at inference time. We demonstrate strong empirical performance across multiple combinatorial problems, including the Quadratic Assignment Problem, Maximum Coverage, and the Traveling Salesperson Problem.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 68 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
37 of 68 references.
References · 37
- 2015Pointer Networkscited by 895
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 221
- 2021DC3: A learning method for optimization with hard constraintscited by 184
- 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 179
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
- 2020Erdos Goes Neural: an Unsupervised Learning Framework for Combinatorial Optimization on Graphscited by 115
- 2021Combinatorial Optimization with Physics-Inspired Graph Neural Networkscited by 108
- 2019Neural Graph Matching Network: Learning Lawler's Quadratic Assignment Problem with Extension to Hypergraph and Multiple-graph Matchingcited by 84
- 2015On the Global Linear Convergence of Frank-Wolfe Optimization Variantscited by 77
25 more
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 71
- 2019Approximation Ratios of Graph Neural Networks for Combinatorial Problemscited by 69
- 2019Graph Neural Networks for Maximum Constraint Satisfactioncited by 46
- 2022What's Wrong with Deep Learning in Tree Search for Combinatorial Optimizationcited by 37
- 2022Unsupervised Learning for Combinatorial Optimization with Principled Objective Relaxationcited by 32
- 2022Can Hybrid Geometric Scattering Networks Help Solve the Maximum Clique Problem?cited by 25
- 2024Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problemscited by 24
- 2022Annealed Training for Combinatorial Optimization on Graphscited by 18
- 2024LinSATNet: The Positive Linear Satisfiability Neural Networkscited by 16
- 2022Neural Set Function Extensions: Learning with Discrete Functions in High Dimensionscited by 14
- 2017A Unified Optimization View on Generalized Matching Pursuit and Frank-Wolfecited by 13
- 2020A (Slightly) Improved Approximation Algorithm for Metric TSPcited by 13
- 2023What functions can Graph Neural Networks compute on random graphs? The role of Positional Encodingcited by 12
- 2019Revisiting the Approximate Carath'eodory Problem via the Frank-Wolfe Algorithmcited by 11
- 2020Revocable Deep Reinforcement Learning with Affinity Regularization for Outlier-Robust Graph Matchingcited by 11
- 2015Barrier Frank-Wolfe for Marginal Inferencecited by 10
- 2016Linear-memory and Decomposition-invariant Linearly Convergent Conditional Gradient Algorithm for Structured Polytopescited by 9
- 2017Sinkhorn Algorithm for Lifted Assignment Problemscited by 9
- 2015Tight Bounds for Approximate Carath'eodory and Beyondcited by 8
- 2024Tackling Prevalent Conditions in Unsupervised Combinatorial Optimization: Cardinality, Minimum, Covering, and Morecited by 7
- 2024GLinSAT: The General Linear Satisfiability Neural Network Layer By Accelerated Gradient Descentcited by 7
- 2024Learning Solution-Aware Transformers for Efficiently Solving Quadratic Assignment Problemcited by 4
- 2025Neural Discovery in Mathematics: Do Machines Dream of Colored Planes?cited by 4
- 2025Geometric Algorithms for Neural Combinatorial Optimization with Constraintscited by 4
- 2024Differentiable Extensions with Rounding Guarantees for Combinatorial Optimization over Permutationscited by 2
Built on by
Not cited yet.