mlsanityData to 14 Oct 2026

Learning Multi-Agent Coordination via Sheaf-ADMM

arXiv 2605.31005 ↗First posted 29 May 2026cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We present a differentiable optimization framework for multi-agent coordination. An input is decomposed into overlapping local views, each processed by an agent that solves a convex subproblem parameterized by a neural encoder. Agents coordinate through the Alternating Direction Method of Multipliers (ADMM) with inter-agent constraints specified by a cellular sheaf. The sheaf specifies which aspects of neighboring solutions must agree, allowing for heterogeneous notions of global consensus. Backpropagating through the unrolled optimization jointly trains all components of the multi-agent system. We evaluate on maze pathfinding, image classification, and Sudoku, where agents with individually insufficient local views learn to coordinate to produce correct global outputs. On MNIST, the local-view decomposition yields improved robustness to distribution shifts relative to a standard CNN. On Sudoku, the optimization-derived structure yields markedly higher solve rates than parameter-matched MPNN baselines. Finally, the ADMM structure exposes distinct primal, consensus, and dual state variables, opening the coordination dynamics to direct analysis and intervention -- a property unavailable in standard message-passing architectures.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

24 of 43 references.

References · 24

  1. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  2. 2015Gated Graph Sequence Neural Networkscited by 796
  3. 2019Deep Equilibrium Modelscited by 615
  4. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 599
  5. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
  6. 2019Differentiable Convex Optimization Layerscited by 465
  7. 2019Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processingcited by 421
  8. 2017Learned Primal-dual Reconstructioncited by 251
  9. 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
  10. 2015Global Convergence of ADMM in Nonconvex Nonsmooth Optimizationcited by 98
  11. 2020Sheaf Neural Networkscited by 84
  12. 2014Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problemscited by 64
12 more
  1. 2025On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learningcited by 43
  2. 2021Collective Intelligence for Deep Learning: A Survey of Recent Developmentscited by 34
  3. 2013Optimal parameter selection for the alternating direction method of multipliers (ADMM): quadratic problemscited by 19
  4. 2025Cooperative Sheaf Neural Networkscited by 12
  5. 2024Deep Distributed Optimization for Large-Scale Quadratic Programmingcited by 11
  6. 2016Adaptive ADMM with Spectral Penalty Parameter Selectioncited by 10
  7. 2017ADMM Penalty Parameter Selection by Residual Balancingcited by 8
  8. 2025Distributed Multi-agent Coordination over Cellular Sheavescited by 6
  9. 2022A Survey of ADMM Variants for Distributed Optimization: Problems, Algorithms and Featurescited by 5
  10. 2025Learning to accelerate distributed ADMM using graph neural networkscited by 3
  11. 2025Heterogeneous Multi-Agent Multi-Target Tracking using Cellular Sheavescited by 3
  12. 2025DiffCoord: Differentiable Coordination for Distributed Multi-Agent Trajectory Optimizationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.