mlsanityData to 13 Oct 2026

Decentralized Bilevel Optimization

arXiv 2206.05670 ↗First posted 12 Jun 2022math.OCcited by 23

Not on the map. Why?

Abstract (arXiv)

Bilevel optimization has been successfully applied to many important machine learning problems. Algorithms for solving bilevel optimization have been studied under various settings. In this paper, we study the nonconvex-strongly-convex bilevel optimization under a decentralized setting. We design decentralized algorithms for both deterministic and stochastic bilevel optimization problems. Moreover, we analyze the convergence rates of the proposed algorithms in difference scenarios including the case where data heterogeneity is observed across agents. Numerical experiments on both synthetic and real data demonstrate that the proposed methods are efficient.

Key facts. Cited by 23 papers in the map (data through 13 Oct 2026). First posted on arXiv 12 Jun 2022.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2022: 7; 2023: 10; 2024: 1; 2025: 3; 2026: 2.

23 papers.

Sort:

  1. 2023On Penalty-based Bilevel Gradient Descent Methodcited by 87
  2. 2022Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexitycited by 21
  3. 2023Achieving Linear Speedup in Non-IID Federated Bilevel Learningcited by 18
  4. 2022On the Convergence of Distributed Stochastic Bilevel Optimization Algorithms over a Networkcited by 14
  5. 2023SimFBO: Towards Simple, Flexible and Communication-efficient Federated Bilevel Learningcited by 14
  6. 2022Asynchronous Distributed Bilevel Optimizationcited by 13
  7. 2023Communication-Efficient Federated Hypergradient Computation via Aggregated Iterative Differentiationcited by 13
  8. 2022Alternating Implicit Projected SGD and Its Efficient Variants for Equality-constrained Bilevel Optimizationcited by 10
  9. 2023Communication-Efficient Federated Bilevel Optimization with Local and Global Lower Level Problemscited by 8
  10. 2022Fast Adaptive Federated Bilevel Optimizationcited by 7
  11. 2023A Single-Loop Algorithm for Decentralized Bilevel Optimizationcited by 7
  12. 2023Network Utility Maximization with Unknown Utility Functions: A Distributed, Data-Driven Bilevel Optimization Approachcited by 5
11 more
  1. 2025Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimizationcited by 3
  2. 2022A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programmingcited by 2
  3. 2025Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Networkcited by 2
  4. 2022Decentralized Hyper-Gradient Computation over Time-Varying Directed Networkscited by 1
  5. 2023Stochastic Nested Compositional Bi-level Optimization for Robust Feature Learningcited by 1
  6. 2024Fully First-Order Methods for Decentralized Bilevel Optimizationcited by 1
  7. 2025Nonconvex Decentralized Stochastic Bilevel Optimization under Heavy-Tailed Noisecited by 1
  8. 2026DUET: Decentralized Bilevel Optimization without Lower-Level Strong Convexitycited by 1
  9. 2023Decentralized and Privacy-Preserving Learning of Approximate Stackelberg Solutions in Energy Trading Games with Demand Response Aggregatorscited by 0
  10. 2023Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimationcited by 0
  11. 2026S3LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimizationcited by 0