mlsanityData to 7 Oct 2026

Decentralized Statistical Inference with Unrolled Graph Neural Networks

arXiv 2104.01555 ↗First posted 4 Apr 2021cs.LG math.OCcited by 1

Not on the map. Why?

Abstract (arXiv)

In this paper, we investigate the decentralized statistical inference problem, where a network of agents cooperatively recover a (structured) vector from private noisy samples without centralized coordination. Existing optimization-based algorithms suffer from issues of model mismatch and poor convergence speed, and thus their performance would be degraded, provided that the number of communication rounds is limited. This motivates us to propose a learning-based framework, which unrolls well-noted decentralized optimization algorithms (e.g., Prox-DGD and PG-EXTRA) into graph neural networks (GNNs). By minimizing the recovery error via end-to-end training, this learning-based framework resolves the model mismatch issue. Our convergence analysis (with PG-EXTRA as the base algorithm) reveals that the learned model parameters may accelerate the convergence and reduce the recovery error to a large extent. The simulation results demonstrate that the proposed GNN-based learning methods prominently outperform several state-of-the-art optimization-based algorithms in convergence speed and recovery error.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 4 Apr 2021.

Builds on

17 of 36 references.

References · 17

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2018How Powerful are Graph Neural Networks?cited by 4,355
  3. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  4. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  5. 2020How Neural Networks Extrapolate: From Feedforward to Graph Neural Networkscited by 218
  6. 2019What graph neural networks cannot learn: depth vs widthcited by 195
  7. 2014EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimizationcited by 160
  8. 2019What Can Neural Networks Reason About?cited by 155
  9. 2019Graph Neural Networks for Decentralized Multi-Robot Path Planningcited by 84
  10. 2020Graph Neural Networks for Scalable Radio Resource Management: Architecture Design and Theoretical Analysiscited by 80
  11. 2019Approximation Ratios of Graph Neural Networks for Combinatorial Problemscited by 68
  12. 2017A decentralized proximal-gradient method with network independent step-sizes and separated convergence ratescited by 51
5 more
  1. 2016On Nonconvex Decentralized Gradient Descentcited by 42
  2. 2018COLA: Decentralized Linear Learningcited by 30
  3. 2019GLAD: Learning Sparse Graph Recoverycited by 23
  4. 2013The Squared-Error of Generalized LASSO: A Precise Analysiscited by 15
  5. 2020Graph Neural Networks for Decentralized Controllerscited by 14

Built on by

Cited by year

Citing papers per year: 2021: 1.

1 paper.