mlsanityData to 7 Oct 2026

Distributed Optimization via Energy Conservation Laws in Dilated Coordinates

arXiv 2409.19279 ↗First posted 28 Sep 2024math.OC cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Continuous-time models can reveal accelerated structures in distributed optimization, but their rates need not survive direct discretization. We introduce a second-order primal--dual flow for smooth convex distributed optimization and construct an exactly conserved energy that yields an mathcal O(t-2) rate for both the aggregate objective gap and the squared consensus error. We then prove a horizon-wise Omega(k-1) lower bound for a broad class of single-loop finite-memory primal--dual discretizations, ruling out a mathcal O(k-2) aggregate-objective guarantee within this class. Motivated by this barrier, we develop a double-loop method that combines finite-step polynomial consensus with an accelerated outer update. It uses one gradient evaluation and at most m-1 communication rounds per outer iteration, m being the number of agents, maintains exact consensus and achieves an mathcal O(k-2) aggregate-objective rate. Numerical comparisons with representative distributed methods support the theory and quantify the communication cost of acceleration.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 28 Sep 2024.

Builds on

19 of 36 references.

References · 19

  1. 2015A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insightscited by 203
  2. 2014EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimizationcited by 160
  3. 2013On the Convergence of Decentralized Gradient Descentcited by 158
  4. 2016Achieving Geometric Convergence for Distributed Optimization over Time-Varying Graphscited by 149
  5. 2013Distributed optimization over time-varying directed graphscited by 77
  6. 2022An Improved Analysis of Gradient Tracking for Decentralized Machine Learningcited by 68
  7. 2017Accelerated Distributed Nesterov Gradient Descentcited by 24
  8. 2018Direct Runge-Kutta Discretization Achieves Accelerationcited by 21
  9. 2020Multi-consensus Decentralized Accelerated Gradient Descentcited by 20
  10. 2021Acceleration in Distributed Optimization under Similaritycited by 17
  11. 2021Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimizationcited by 11
  12. 2020Towards accelerated rates for distributed optimization over time-varying networkscited by 10
7 more
  1. 2018Decentralized Accelerated Gradient Methods With Increasing Penalty Parameterscited by 8
  2. 2019Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networkscited by 7
  3. 2019Exponential Convergence for Distributed Smooth Optimization Under the Restricted Secant Inequality Conditioncited by 6
  4. 2022Continuous-Time Analysis of Accelerated Gradient Methods via Conservation Laws in Dilated Coordinate Systemscited by 4
  5. 2020Distributed Gradient Methods for Nonconvex Optimization: Local and Global Convergence Guaranteescited by 3
  6. 2021Breaking the Convergence Barrier: Optimization via Fixed-Time Convergent Flowscited by 3
  7. 2019Robust Distributed Fixed-Time Economic Dispatch under Time-Varying Topologycited by 2

Built on by

Not cited yet.