# Fast and Stable Nonconvex Constrained Distributed Optimization: The ELLADA Algorithm

arXiv: https://arxiv.org/abs/2004.01977 · HTML: https://mlsanity.com/paper/2004.01977/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Apr 2020.

## Built on by (most cited first, 3 of 3)

- [Decentralized Safe Multi-agent Stochastic Optimal Control using Deep FBSDEs and ADMM](https://mlsanity.com/paper/2202.10658/) (2022)
- [FedOSAA: Improving Federated Learning with One-Step Anderson Acceleration](https://mlsanity.com/paper/2503.10961/) (2025)
- [Using Non-Lipschitz Signum-based Functions for Distributed Optimization and Machine Learning: Trade-off Between Con-vergence Rate and Optimality Gap](https://mlsanity.com/paper/2608.01220/) (2026)

## Abstract (arXiv)

Distributed optimization, where the computations are performed in a localized and coordinated manner using multiple agents, is a promising approach for solving large-scale optimization problems, e.g., those arising in model predictive control (MPC) of large-scale plants. However, a distributed optimization algorithm that is computationally efficient, globally convergent, amenable to nonconvex constraints and general inter-subsystem interactions remains an open problem. In this paper, we combine three important modifications to the classical alternating direction method of multipliers (ADMM) for distributed optimization. Specifically, (i) an extra-layer architecture is adopted to accommodate nonconvexity and handle inequality constraints, (ii) equality-constrained nonlinear programming (NLP) problems are allowed to be solved approximately, and (iii) a modified Anderson acceleration is employed for reducing the number of iterations. Theoretical convergence towards stationary solutions and computational complexity of the proposed algorithm, named ELLADA, is established. Its application to distributed nonlinear MPC is also described and illustrated through a benchmark process system.
