A linear algorithm for optimization over directed graphs with geometric convergence
Not on the map. Why?
Abstract (arXiv)
In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are based on push-sum (type) techniques, which use an independent algorithm to asymptotically learn either the left or right eigenvector of the underlying weight matrices. This strategy causes additional computation, communication, and nonlinearity in the algorithm. In contrast, we propose a linear algorithm based on an inexact gradient method and a gradient estimation technique. Under the assumptions that each local function is strongly-convex with Lipschitz-continuous gradients, we show that the proposed algorithm geometrically converges to the global minimizer with a sufficiently small step-size. We present simulations to illustrate the theoretical findings.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 3; 2024: 4; 2025: 3; 2026: 5.
25 papers.
Sort:
- 2021RelaySum for Decentralized Deep Learning on Heterogeneous Datacited by 39
- 2021BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learningcited by 16
- 2021Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimizationcited by 11
- 2021Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networkscited by 10
- 2022Decentralized Event-Triggered Federated Learning with Heterogeneous Communication Thresholdscited by 9
- 2024Decentralized Directed Collaboration for Personalized Federated Learningcited by 9
- 2025Exact and Linear Convergence for Federated Learning under Arbitrary Client Participation is Attainablecited by 6
- 2023Asymmetrically Decentralized Federated Learningcited by 5
- 2022Distributed saddle point problems for strongly concave-convex functionscited by 3
- 2024Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networkscited by 3
- 2022Variance reduced stochastic optimization over directed graphs with row and column stochastic weightscited by 2
- 2023Robust Fully-Asynchronous Methods for Distributed Training over General Architecturecited by 2
13 more
- 2024Communication Efficient ConFederated Learning: An Event-Triggered SAGA Approachcited by 2
- 2024Quantization Avoids Saddle Points in Distributed Optimizationcited by 2
- 2021Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphscited by 1
- 2022Push--Pull with Device Samplingcited by 1
- 2026Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noisecited by 1
- 2022Resource-Constrained Decentralized Federated Learning via Personalized Event-Triggeringcited by 0
- 2023Accelerated Distributed Aggregative Optimizationcited by 0
- 2025Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Timecited by 0
- 2025Diffusion Learning with Partial Agent Participation and Local Updatescited by 0
- 2026Local Updates in Distributed Optimization: Provable Acceleration and Topology Effectscited by 0
- 2026Provably Convergent Decentralized Optimization over Directed Graphs under Generalized Smoothnesscited by 0
- 2026Sporadic Gradient Tracking over Directed Graphs: A Theoretical Perspective on Decentralized Federated Learningcited by 0
- 2026Convergence of Byzantine-Resilient Gradient Tracking via Probabilistic Edge Dropoutcited by 0
- 2026Convergence of Byzantine-Resilient Gradient Tracking via Probabilistic Edge Dropout1 Apr 2026
- 2026Sporadic Gradient Tracking over Directed Graphs: A Theoretical Perspective on Decentralized Federated Learning31 Jan 2026
- 2026Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise16 Jan 2026
- 2026Provably Convergent Decentralized Optimization over Directed Graphs under Generalized Smoothness7 Jan 2026
- 2026Local Updates in Distributed Optimization: Provable Acceleration and Topology Effects6 Jan 2026
- 2025Diffusion Learning with Partial Agent Participation and Local Updates16 May 2025
- 2025Exact and Linear Convergence for Federated Learning under Arbitrary Client Participation is Attainable25 Mar 2025
- 2025Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Time20 Mar 2025
- 2024Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networks25 Sep 2024
- 2024Decentralized Directed Collaboration for Personalized Federated Learning28 May 2024
- 2024Quantization Avoids Saddle Points in Distributed Optimization15 Mar 2024
- 2024Communication Efficient ConFederated Learning: An Event-Triggered SAGA Approach28 Feb 2024
13 more
- 2023Asymmetrically Decentralized Federated Learning8 Oct 2023
- 2023Robust Fully-Asynchronous Methods for Distributed Training over General Architecture21 Jul 2023
- 2023Accelerated Distributed Aggregative Optimization17 Apr 2023
- 2022Resource-Constrained Decentralized Federated Learning via Personalized Event-Triggering23 Nov 2022
- 2022Push--Pull with Device Sampling8 Jun 2022
- 2022Decentralized Event-Triggered Federated Learning with Heterogeneous Communication Thresholds7 Apr 2022
- 2022Distributed saddle point problems for strongly concave-convex functions11 Feb 2022
- 2022Variance reduced stochastic optimization over directed graphs with row and column stochastic weights7 Feb 2022
- 2021BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning8 Nov 2021
- 2021RelaySum for Decentralized Deep Learning on Heterogeneous Data8 Oct 2021
- 2021Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphs26 Jul 2021
- 2021Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks14 Jun 2021
- 2021Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization6 Apr 2021
- 2021RelaySum for Decentralized Deep Learning on Heterogeneous Datacited by 39
- 2021BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learningcited by 16
- 2021Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimizationcited by 11
- 2021Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networkscited by 10
- 2022Decentralized Event-Triggered Federated Learning with Heterogeneous Communication Thresholdscited by 9
- 2024Decentralized Directed Collaboration for Personalized Federated Learningcited by 9
- 2025Exact and Linear Convergence for Federated Learning under Arbitrary Client Participation is Attainablecited by 6
- 2023Asymmetrically Decentralized Federated Learningcited by 5
- 2022Distributed saddle point problems for strongly concave-convex functionscited by 3
- 2024Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networkscited by 3
- 2022Variance reduced stochastic optimization over directed graphs with row and column stochastic weightscited by 2
- 2023Robust Fully-Asynchronous Methods for Distributed Training over General Architecturecited by 2
12 most cited of 25 All 25 (JSON)
- 2026Convergence of Byzantine-Resilient Gradient Tracking via Probabilistic Edge Dropout1 Apr 2026
- 2026Sporadic Gradient Tracking over Directed Graphs: A Theoretical Perspective on Decentralized Federated Learning31 Jan 2026
- 2026Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise16 Jan 2026
- 2026Provably Convergent Decentralized Optimization over Directed Graphs under Generalized Smoothness7 Jan 2026
- 2026Local Updates in Distributed Optimization: Provable Acceleration and Topology Effects6 Jan 2026
- 2025Diffusion Learning with Partial Agent Participation and Local Updates16 May 2025
- 2025Exact and Linear Convergence for Federated Learning under Arbitrary Client Participation is Attainable25 Mar 2025
- 2025Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Time20 Mar 2025
- 2024Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networks25 Sep 2024
- 2024Decentralized Directed Collaboration for Personalized Federated Learning28 May 2024
- 2024Quantization Avoids Saddle Points in Distributed Optimization15 Mar 2024
- 2024Communication Efficient ConFederated Learning: An Event-Triggered SAGA Approach28 Feb 2024
12 newest of 25 All 25 (JSON)