Graph Normalization: Fast Binarizing Dynamics for Differentiable MWIS
Not on the map. Why?
Abstract (arXiv)
We introduce Graph Normalization (GN), a principled dynamical system on graphs that serves as a differentiable approximation engine for the NP-hard Maximum Weight Independent Set (MWIS) problem. MWIS encompasses many combinatorial challenges, including optimal assignment, scheduling, set packing, and MAP inference in discrete Markov Random Fields. Unlike Belief Propagation, we prove GN always converges to a binary indicator of a Maximum Independent Set. GN realizes a fast quasi-Newton descent through an exact Majorization-Minimization step, systematically improving the MWIS relaxed primal objective. We establish an equivalence between GN and the Replicator Dynamics of a nonlinear evolutionary game, where vertices compete for inclusion in an independent set. While a non-potential game, the GN game follows Fisher's Fundamental Theorem of Natural Selection, where the average fitness equals the MWIS primal objective and strictly increases. This connection leads to a weighted extension of the Motzkin-Straus theorem, showing MISes are in bijection with the local minima of a quadratic form over a tilted simplex. For the Assignment Problem, GN acts as a variant of the Sinkhorn algorithm that naturally converges to a hard assignment while generalizing to arbitrary constraint graphs. We demonstrate GN's performance as a fast binarization engine for the state-of-the-art Bregman-Sinkhorn relaxed MWIS solver. On real-world benchmarks with up to 1M edges, GN identifies solutions within 1% of the best known results in seconds on a CPU. GN opens new avenues for deep learning architectures requiring differentiable, "hard" decisions under constraints, with applications in structured sparse attention, dynamic network pruning, and Mixture-of-Experts. Beyond core AI, the GN framework enables end-to-end learning of constrained optimization in computer vision, computational biology, and resource allocation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 56 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
10 of 56 references.
References · 10
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2022Unified Scaling Laws for Routed Language Modelscited by 253
- 2019Differentiation of Blackbox Combinatorial Solverscited by 226
- 2018Learning Latent Permutations with Gumbel-Sinkhorn Networkscited by 175
- 2020Erdos Goes Neural: an Unsupervised Learning Framework for Combinatorial Optimization on Graphscited by 115
- 2025mHC: Manifold-Constrained Hyper-Connectionscited by 88
- 2020Polynomial-time algorithms for Multimarginal Optimal Transport problems with structurecited by 15
- 2024A Bregman-Sinkhorn Algorithm for the Maximum Weight Independent Set Problemcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Graph Reinforcement Learning for Combinatorial Optimization: A Survey and Unifying Perspective
- 2025Reinforcement Learning for Game-Theoretic Resource Allocation on Graphs
- 2025A Denoising Diffusion-Based Evolutionary Algorithm Framework: Application to the Maximum Independent Set Problem
- 2024Learning Mean Field Games on Sparse Graphs: A Hybrid Graphex Approach
- 2026Reinforcement Learning for Graph Generation under a Hard Assortativity Constraint
- 2026Parallel Tempering for Diffusion-Based Combinatorial Optimization
- 2026Agentic Algorithm Engineering: Improving Shared-Memory Exact Minimum Cuts
- 2026RLGT: A reinforcement learning framework for extremal graph theory