# A General Analysis of the Convergence of ADMM

arXiv: https://arxiv.org/abs/1502.02009 · HTML: https://mlsanity.com/paper/1502.02009/

## Key facts

- Cited by 22 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Feb 2015.

## Built on by (most cited first, 22 of 22)

- [Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Version](https://mlsanity.com/paper/2204.03341/) (2022)
- [A Reduction to Binary Approach for Debiasing Multiclass Datasets](https://mlsanity.com/paper/2205.15860/) (2022)
- [Convex Programs and Lyapunov Functions for Reinforcement Learning: A Unified Perspective on the Analysis of Value-Based Methods](https://mlsanity.com/paper/2202.06922/) (2022)
- [Solving Constrained Variational Inequalities via a First-order Interior Point-based Method](https://mlsanity.com/paper/2206.10575/) (2022)
- [Primal Methods for Variational Inequality Problems with Functional Constraints](https://mlsanity.com/paper/2403.12859/) (2024)
- [Distributed Event-Based Learning via ADMM](https://mlsanity.com/paper/2405.10618/) (2024)
- [Distributed Sparse Feature Selection in Communication-Restricted Networks](https://mlsanity.com/paper/2111.02802/) (2021)
- [Semi-supervised Symmetric Non-negative Matrix Factorization with Low-Rank Tensor Representation](https://mlsanity.com/paper/2405.02688/) (2024)
- [SADAM: Stochastic Adam, A Stochastic Operator for First-Order Gradient-based Optimizer](https://mlsanity.com/paper/2205.10247/) (2022)
- [DELMAR: Deep Linear Matrix Approximately Reconstruction to Extract Hierarchical Functional Connectivity in the Human Brain](https://mlsanity.com/paper/2205.10374/) (2022)
- [Controlling Participation in Federated Learning with Feedback](https://mlsanity.com/paper/2411.19242/) (2024)
- [LEAF: A Learning-Enabled ADMM Framework for Accelerated Convex Optimization](https://mlsanity.com/paper/2606.08993/) (2026)
- [Generalized ADMM in Distributed Learning via Variational Inequality](https://mlsanity.com/paper/2104.12608/) (2021)
- [Deep State-Space Model for Predicting Cryptocurrency Price](https://mlsanity.com/paper/2311.14731/) (2023)
- [A General Continuous-Time Formulation of Stochastic ADMM and Its Variants](https://mlsanity.com/paper/2404.14358/) (2024)
- [Stability of Primal-Dual Gradient Flow Dynamics for Multi-Block Convex Optimization Problems](https://mlsanity.com/paper/2408.15969/) (2024)
- [Differentiable Projection-based Learn to Optimize in Wireless Network-Part I: Convex Constrained (Non-)Convex Programming](https://mlsanity.com/paper/2502.00053/) (2025)
- [HOME-3: High-Order Momentum Estimator with Third-Power Gradient for Convex and Smooth Nonconvex Optimization](https://mlsanity.com/paper/2505.11748/) (2025)
- [Permutation Randomization on Nonsmooth Nonconvex Optimization: A Theoretical and Experimental Study](https://mlsanity.com/paper/2505.11752/) (2025)
- [A Systems-Theoretic View on the Convergence of Algorithms under Disturbances](https://mlsanity.com/paper/2512.17598/) (2025)
- [Learning Over-Relaxation Policies for ADMM with Convergence Guarantees](https://mlsanity.com/paper/2604.26932/) (2026)
- [Co-VLA: Consensus-based Federated Training for Vision-Language-Action Models](https://mlsanity.com/paper/2609.19923/) (2026)

## Abstract (arXiv)

We provide a new proof of the linear convergence of the alternating direction method of multipliers (ADMM) when one of the objective terms is strongly convex. Our proof is based on a framework for analyzing optimization algorithms introduced in Lessard et al. (2014), reducing algorithm convergence to verifying the stability of a dynamical system. This approach generalizes a number of existing results and obviates any assumptions about specific choices of algorithm parameters. On a numerical example, we demonstrate that minimizing the derived bound on the convergence rate provides a practical approach to selecting algorithm parameters for particular ADMM instances. We complement our upper bound by constructing a nearly-matching lower bound on the worst-case rate of convergence.