Linear convergence in optimization over directed graphs with row-stochastic matrices
Not on the map. Why?
Abstract (arXiv)
This paper considers a distributed optimization problem over a multi-agent network, in which the objective function is a sum of individual cost functions at the agents. We focus on the case when communication between the agents is described by a directed graph. Existing distributed optimization algorithms for directed graphs require at least the knowledge of the neighbors' out-degree at each agent (due to the requirement of column-stochastic matrices). In contrast, our algorithm requires no such knowledge. Moreover, the proposed algorithm achieves the best known rate of convergence for this class of problems, O(μk) for 0<μ<1, where k is the number of iterations, given that the objective functions are strongly-convex and have Lipschitz-continuous gradients. Numerical experiments are also provided to illustrate the theoretical findings.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 0; 2023: 3; 2024: 3; 2025: 0; 2026: 2.
12 papers.
- 2021RelaySum for Decentralized Deep Learning on Heterogeneous Datacited by 39
- 2021Distributed Adaptive Learning Under Communication Constraintscited by 4
- 2021Asynchronous speedup in decentralized optimizationcited by 3
- 2024Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networkscited by 3
- 2023Federated Learning in Wireless Networks via Over-the-Air Computationscited by 2
- 2023Locally Differentially Private Gradient Tracking for Distributed Online Learning over Directed Graphscited by 2
- 2024Decentralized Multi-Task Online Convex Optimization Under Random Link Failurescited by 2
- 2021Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphscited by 1
- 2024Decentralized Optimization in Time-Varying Networks with Arbitrary Delayscited by 1
- 2026Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noisecited by 1
- 2023Distributed Optimization via Kernelized Multi-armed Banditscited by 0
- 2026AGDN: Learning to Solve Traveling Salesman Problem with Anisotropic Graph Diffusion Networkcited by 0
- 2026AGDN: Learning to Solve Traveling Salesman Problem with Anisotropic Graph Diffusion Network17 Jun 2026
- 2026Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise16 Jan 2026
- 2024Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networks25 Sep 2024
- 2024Decentralized Optimization in Time-Varying Networks with Arbitrary Delays29 May 2024
- 2024Decentralized Multi-Task Online Convex Optimization Under Random Link Failures4 Jan 2024
- 2023Distributed Optimization via Kernelized Multi-armed Bandits7 Dec 2023
- 2023Locally Differentially Private Gradient Tracking for Distributed Online Learning over Directed Graphs24 Oct 2023
- 2023Federated Learning in Wireless Networks via Over-the-Air Computations8 May 2023
- 2021Distributed Adaptive Learning Under Communication Constraints3 Dec 2021
- 2021RelaySum for Decentralized Deep Learning on Heterogeneous Data8 Oct 2021
- 2021Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphs26 Jul 2021
- 2021Asynchronous speedup in decentralized optimization7 Jun 2021