Decentralized Online Convex Optimization with Unknown Feedback Delays
Not on the map. Why?
Abstract (arXiv)
Decentralized online convex optimization (D-OCO), where multiple agents within a network collaboratively learn optimal decisions in real-time, arises naturally in applications such as federated learning, sensor networks, and multi-agent control. In this paper, we study D-OCO under unknown, time-and agent-varying feedback delays. While recent work has addressed this problem (Nguyen et al., 2024), existing algorithms assume prior knowledge of the total delay over agents and still suffer from suboptimal dependence on both the delay and network parameters. To overcome these limitations, we propose a novel algorithm that achieves an improved regret bound of O N √ d tot + N √ T (1-σ2) 1/4 , where T is the total horizon, d tot denotes the average total delay across agents, N is the number of agents, and 1 -σ 2 is the spectral gap of the network. Our approach builds upon recent advances in D-OCO (Wan et al., 2024a), but crucially incorporates an adaptive learning rate mechanism via a decentralized communication protocol. This enables each agent to estimate delays locally using a gossip-based strategy without the prior knowledge of the total delay. We further extend our framework to the strongly convex setting and derive a sharper regret bound of O N δmax ln T α , where α is the strong convexity parameter and δ max is the maximum number of missing observations averaged over agents. We also show that our upper bounds for both settings are tight up to logarithmic factors. Experimental results validate the effectiveness of our approach, showing improvements over existing benchmark algorithms.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 42 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
20 of 42 references.
References · 20
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2019Online Learning: A Modern Introduction Using Convex Optimizationcited by 417
- 2013Online Learning under Delayed Feedbackcited by 141
- 2016Delay and Cooperation in Nonstochastic Banditscited by 71
- 2019An Optimal Algorithm for Adversarial Bandits with Arbitrary Delayscited by 44
- 2020Learning Adversarial Markov Decision Processes with Delayed Feedbackcited by 33
- 2016Distributed Online Optimization in Dynamic Environments Using Mirror Descentcited by 32
- 2020Adapting to Delays and Data in Adversarial Multi-Armed Banditscited by 29
- 2019Stochastic Bandits with Delay-Dependent Payoffscited by 25
- 2020Multi-consensus Decentralized Accelerated Gradient Descentcited by 20
- 2014Online Distributed Optimization on Dynamic Networkscited by 15
- 2023A Unified Analysis of Nonstochastic Delayed Feedback for Combinatorial Semi-Bandits, Linear Bandits, and MDPscited by 15
8 more
- 2019Distributed Online Linear Regressioncited by 10
- 2024Optimal and Efficient Algorithms for Decentralized Online Convex Optimizationcited by 8
- 2025Capacity-Constrained Online Learning with Delays: Scheduling Frameworks and Regret Trade-offscited by 6
- 2025Exploiting Curvature in Online Convex Optimization with Delayed Feedbackcited by 6
- 2024Non-stochastic Bandits With Evolving Observationscited by 4
- 2020Dynamic and Distributed Online Convex Optimization for Demand Response of Commercial Buildingscited by 3
- 2024Adversarial Online Learning with Temporal Feedback Graphscited by 3
- 2024Handling Delayed Feedback in Distributed Online Optimization : A Projection-Free Approachcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.