mlsanityData to 7 Oct 2026

A linear algorithm for optimization over directed graphs with geometric convergence

arXiv 1803.02503 ↗First posted 7 Mar 2018math.OCcited by 25

Not on the map. Why?

Abstract (arXiv)

In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are based on push-sum (type) techniques, which use an independent algorithm to asymptotically learn either the left or right eigenvector of the underlying weight matrices. This strategy causes additional computation, communication, and nonlinearity in the algorithm. In contrast, we propose a linear algorithm based on an inexact gradient method and a gradient estimation technique. Under the assumptions that each local function is strongly-convex with Lipschitz-continuous gradients, we show that the proposed algorithm geometrically converges to the global minimizer with a sufficiently small step-size. We present simulations to illustrate the theoretical findings.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Mar 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 5; 2023: 3; 2024: 4; 2025: 3; 2026: 5.

25 papers.

Sort:

  1. 2021RelaySum for Decentralized Deep Learning on Heterogeneous Datacited by 39
  2. 2021BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learningcited by 16
  3. 2021Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimizationcited by 11
  4. 2021Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networkscited by 10
  5. 2022Decentralized Event-Triggered Federated Learning with Heterogeneous Communication Thresholdscited by 9
  6. 2024Decentralized Directed Collaboration for Personalized Federated Learningcited by 9
  7. 2025Exact and Linear Convergence for Federated Learning under Arbitrary Client Participation is Attainablecited by 6
  8. 2023Asymmetrically Decentralized Federated Learningcited by 5
  9. 2022Distributed saddle point problems for strongly concave-convex functionscited by 3
  10. 2024Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networkscited by 3
  11. 2022Variance reduced stochastic optimization over directed graphs with row and column stochastic weightscited by 2
  12. 2023Robust Fully-Asynchronous Methods for Distributed Training over General Architecturecited by 2
13 more
  1. 2024Communication Efficient ConFederated Learning: An Event-Triggered SAGA Approachcited by 2
  2. 2024Quantization Avoids Saddle Points in Distributed Optimizationcited by 2
  3. 2021Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphscited by 1
  4. 2022Push--Pull with Device Samplingcited by 1
  5. 2026Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noisecited by 1
  6. 2022Resource-Constrained Decentralized Federated Learning via Personalized Event-Triggeringcited by 0
  7. 2023Accelerated Distributed Aggregative Optimizationcited by 0
  8. 2025Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Timecited by 0
  9. 2025Diffusion Learning with Partial Agent Participation and Local Updatescited by 0
  10. 2026Local Updates in Distributed Optimization: Provable Acceleration and Topology Effectscited by 0
  11. 2026Provably Convergent Decentralized Optimization over Directed Graphs under Generalized Smoothnesscited by 0
  12. 2026Sporadic Gradient Tracking over Directed Graphs: A Theoretical Perspective on Decentralized Federated Learningcited by 0
  13. 2026Convergence of Byzantine-Resilient Gradient Tracking via Probabilistic Edge Dropoutcited by 0