mlsanityData to 7 Oct 2026

Accelerated Distributed Aggregative Optimization

arXiv 2304.08051 ↗First posted 17 Apr 2023math.OC cs.LG cs.MAcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we investigate a distributed aggregative optimization problem in a network, where each agent has its own local cost function which depends not only on the local state variable but also on an aggregated function of state variables from all agents. To accelerate the optimization process, we combine heavy ball and Nesterov's accelerated methods with distributed aggregative gradient tracking, and propose two novel algorithms named DAGT-HB and DAGT-NES for solving the distributed aggregative optimization problem. We analyse that the DAGT-HB and DAGT-NES algorithms can converge to an optimal solution at a global R-linear convergence rate when the objective function is smooth and strongly convex, and when the parameters (e.g., step size and momentum coefficients) are selected within certain ranges. A numerical experiment on the optimal placement problem is given to verify the effectiveness and superiority of our proposed algorithms.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 53 references that are in the map. First posted on arXiv 17 Apr 2023.

Builds on

15 of 53 references.

References · 15

  1. 2014EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimizationcited by 160
  2. 2013On the Convergence of Decentralized Gradient Descentcited by 158
  3. 2016Achieving Geometric Convergence for Distributed Optimization over Time-Varying Graphscited by 149
  4. 2022Topology-aware Generalization of Decentralized SGDcited by 37
  5. 2014Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learningcited by 35
  6. 2018A linear algorithm for optimization over directed graphs with geometric convergencecited by 25
  7. 2017Accelerated Distributed Nesterov Gradient Descentcited by 24
  8. 2018Distributed heavy-ball: A generalization and acceleration of first-order methods with gradient trackingcited by 14
  9. 2020Distributed Online Convex Optimization with an Aggregative Variablecited by 7
  10. 2019Distributed Nesterov gradient methods over arbitrary graphscited by 6
  11. 2016Distributed Algorithms for Aggregative Games on Graphscited by 4
  12. 2020Distributed Aggregative Optimization over Multi-Agent Networkscited by 3
3 more
  1. 2021Distributed Online Aggregative Optimization for Dynamic Multi-robot Coordinationcited by 2
  2. 2022Distributed aggregative optimization with quantization communicationcited by 1
  3. 2022Distributed Projection-free Algorithm for Constrained Aggregative Optimizationcited by 1

Built on by

Not cited yet.