mlsanityData to 14 Oct 2026

Self-Supervised Combinatorial Optimization with Constraints via Frank-Wolfe

arXiv 2609.25728 ↗First posted 22 Sep 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised learning for combinatorial optimization has emerged as a promising paradigm for solving discrete optimization problems with neural networks, but a central challenge remains: handling hard combinatorial constraints within continuous, gradient-based training. Continuously extending combinatorial objectives to convex domains is a powerful technique, yet existing approaches often require projection steps that constrain neural network outputs to lie inside the feasible polytope and rely on ad-hoc and problem-specific constructions. We propose a general framework in which the neural network is allowed to predict arbitrary continuous vectors that could potentially lie outside of the feasible polytope. These predictions are then approximated by sparse convex combinations of feasible solutions using a geometric decomposition algorithm based on Frank--Wolfe methods and approximate Caratheodory results. This decomposition induces an a.e.-differentiable, self-supervised loss defined as the expected value of the discrete objective. The same procedure provides an automatic rounding guarantee at inference time. We demonstrate strong empirical performance across multiple combinatorial problems, including the Quadratic Assignment Problem, Maximum Coverage, and the Traveling Salesperson Problem.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 68 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

37 of 68 references.

References · 37

  1. 2015Pointer Networkscited by 895
  2. 2018Attention, Learn to Solve Routing Problems!cited by 656
  3. 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
  4. 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 221
  5. 2021DC3: A learning method for optimization with hard constraintscited by 184
  6. 2022Sign and Basis Invariant Networks for Spectral Graph Representation Learningcited by 179
  7. 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 129
  8. 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 119
  9. 2020Erdos Goes Neural: an Unsupervised Learning Framework for Combinatorial Optimization on Graphscited by 115
  10. 2021Combinatorial Optimization with Physics-Inspired Graph Neural Networkscited by 108
  11. 2019Neural Graph Matching Network: Learning Lawler's Quadratic Assignment Problem with Extension to Hypergraph and Multiple-graph Matchingcited by 84
  12. 2015On the Global Linear Convergence of Frank-Wolfe Optimization Variantscited by 77
25 more
  1. 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 71
  2. 2019Approximation Ratios of Graph Neural Networks for Combinatorial Problemscited by 69
  3. 2019Graph Neural Networks for Maximum Constraint Satisfactioncited by 46
  4. 2022What's Wrong with Deep Learning in Tree Search for Combinatorial Optimizationcited by 37
  5. 2022Unsupervised Learning for Combinatorial Optimization with Principled Objective Relaxationcited by 32
  6. 2022Can Hybrid Geometric Scattering Networks Help Solve the Maximum Clique Problem?cited by 25
  7. 2024Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problemscited by 24
  8. 2022Annealed Training for Combinatorial Optimization on Graphscited by 18
  9. 2024LinSATNet: The Positive Linear Satisfiability Neural Networkscited by 16
  10. 2022Neural Set Function Extensions: Learning with Discrete Functions in High Dimensionscited by 14
  11. 2017A Unified Optimization View on Generalized Matching Pursuit and Frank-Wolfecited by 13
  12. 2020A (Slightly) Improved Approximation Algorithm for Metric TSPcited by 13
  13. 2023What functions can Graph Neural Networks compute on random graphs? The role of Positional Encodingcited by 12
  14. 2019Revisiting the Approximate Carath'eodory Problem via the Frank-Wolfe Algorithmcited by 11
  15. 2020Revocable Deep Reinforcement Learning with Affinity Regularization for Outlier-Robust Graph Matchingcited by 11
  16. 2015Barrier Frank-Wolfe for Marginal Inferencecited by 10
  17. 2016Linear-memory and Decomposition-invariant Linearly Convergent Conditional Gradient Algorithm for Structured Polytopescited by 9
  18. 2017Sinkhorn Algorithm for Lifted Assignment Problemscited by 9
  19. 2015Tight Bounds for Approximate Carath'eodory and Beyondcited by 8
  20. 2024Tackling Prevalent Conditions in Unsupervised Combinatorial Optimization: Cardinality, Minimum, Covering, and Morecited by 7
  21. 2024GLinSAT: The General Linear Satisfiability Neural Network Layer By Accelerated Gradient Descentcited by 7
  22. 2024Learning Solution-Aware Transformers for Efficiently Solving Quadratic Assignment Problemcited by 4
  23. 2025Neural Discovery in Mathematics: Do Machines Dream of Colored Planes?cited by 4
  24. 2025Geometric Algorithms for Neural Combinatorial Optimization with Constraintscited by 4
  25. 2024Differentiable Extensions with Rounding Guarantees for Combinatorial Optimization over Permutationscited by 2

Built on by

Not cited yet.